{"id":16121,"date":"2024-12-12T07:40:01","date_gmt":"2024-12-12T10:40:01","guid":{"rendered":"https:\/\/www.fie.undef.edu.ar\/ceptm\/?p=16121"},"modified":"2024-12-12T07:40:01","modified_gmt":"2024-12-12T10:40:01","slug":"un-nuevo-metodo-de-optimizacion-de-trayectorias-para-vuelo-dinamico-basado-en-aprendizaje-de-refuerzo-profundo","status":"publish","type":"post","link":"https:\/\/www.fie.undef.edu.ar\/ceptm\/?p=16121","title":{"rendered":"Un nuevo m\u00e9todo de optimizaci\u00f3n de trayectorias para vuelo din\u00e1mico basado en aprendizaje de refuerzo profundo"},"content":{"rendered":"<p>Este texto analiza un nuevo enfoque para el vuelo din\u00e1mico de veh\u00edculos a\u00e9reos no tripulados (UAV), inspirado en aves como los albatros. El vuelo din\u00e1mico utiliza campos de viento para mejorar el alcance de los UAV mediante la optimizaci\u00f3n de las trayectorias de vuelo. El art\u00edculo presenta un m\u00e9todo de aprendizaje de refuerzo profundo (DRL) para mejorar la planificaci\u00f3n y optimizaci\u00f3n de trayectorias, abordando los desaf\u00edos de los m\u00e9todos existentes que se basan en valores iniciales dif\u00edciles de determinar. La trayectoria se parametriza utilizando funciones de base de Fourier, lo que permite una representaci\u00f3n flexible con menos par\u00e1metros. El problema de optimizaci\u00f3n se enmarca como un proceso de toma de decisiones de Markov, con el algoritmo de Optimizaci\u00f3n de Pol\u00edtica Proximal (PPO2) utilizado para optimizar la trayectoria. Los resultados muestran que este nuevo enfoque produce trayectorias m\u00e1s suaves y reduce las m\u00e9tricas de rendimiento clave (empuje, diferencia de empuje y diferencia de velocidad aerodin\u00e1mica) hasta en un 39%, en comparaci\u00f3n con los m\u00e9todos de programaci\u00f3n no lineal tradicionales.<\/p>\n<hr \/>\n<p class=\"section-title u-h4 u-margin-l-top u-margin-xs-bottom\"><strong>Abstract<\/strong><\/p>\n<div id=\"abssec0010\">\n<div id=\"abspara0010\" class=\"u-margin-s-bottom\">Dynamic soaring, inspired by the wind-riding flight of birds such as albatrosses, is a biomimetic technique which leverages wind fields to enhance the endurance of unmanned aerial vehicles (UAVs). Achieving a precise soaring trajectory is crucial for maximizing energy efficiency during flight. Existing nonlinear programming methods are heavily dependent on the choice of initial values which is hard to determine. Therefore, this paper introduces a deep reinforcement learning method based on a differentially flat model for dynamic soaring trajectory planning and optimization. Initially, the gliding trajectory is parameterized using Fourier basis functions, achieving a flexible trajectory representation with a minimal number of hyperparameters. Subsequently, the trajectory optimization problem is formulated as a dynamic interactive process of Markov decision-making. The hyperparameters of the trajectory are optimized using the Proximal Policy Optimization (PPO2) algorithm from deep reinforcement learning (DRL), reducing the strong reliance on initial value settings in the optimization process. Finally, a comparison between the proposed method and the nonlinear programming method reveals that the trajectory generated by the proposed approach is smoother while meeting the same performance requirements. Specifically, the proposed method achieves a 34% reduction in maximum thrust, a 39.4% decrease in maximum thrust difference, and a 33% reduction in maximum airspeed difference.<\/div>\n<\/div>\n<div><\/div>\n<div><a href=\"https:\/\/www.fie.undef.edu.ar\/ceptm\/wp-content\/uploads\/2024\/12\/1-s2.0-S2214914724002812-main.pdf\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" class=\"aligncenter wp-image-5168\" src=\"https:\/\/www.fie.undef.edu.ar\/ceptm\/wp-content\/uploads\/2020\/02\/icono-PDF-1-243x300.png\" alt=\"Descargar archivo pdf\" width=\"75\" height=\"93\" srcset=\"https:\/\/www.fie.undef.edu.ar\/ceptm\/wp-content\/uploads\/2020\/02\/icono-PDF-1-243x300.png 243w, https:\/\/www.fie.undef.edu.ar\/ceptm\/wp-content\/uploads\/2020\/02\/icono-PDF-1.png 310w\" sizes=\"(max-width: 75px) 100vw, 75px\" \/><\/a><\/div>\n<p><strong>Fuente:<\/strong> <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S2214914724002812?via%3Dihub\" target=\"_blank\" rel=\"noopener\"><em>https:\/\/www.sciencedirect.com<\/em><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Este texto analiza un nuevo enfoque para el vuelo din\u00e1mico de veh\u00edculos a\u00e9reos no tripulados (UAV), inspirado en aves como los albatros. El vuelo din\u00e1mico&hellip; <\/p>\n","protected":false},"author":1,"featured_media":16122,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[18,2,23],"tags":[],"_links":{"self":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/16121"}],"collection":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=16121"}],"version-history":[{"count":1,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/16121\/revisions"}],"predecessor-version":[{"id":16124,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/16121\/revisions\/16124"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/media\/16122"}],"wp:attachment":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=16121"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=16121"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=16121"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}