_Automation_2022__Nawigacja_dronem_za_pomocą_uczenia_przez_wzmacnianie__EN_.pdf (13.48 MB)
Download file

LiDAR-based drone navigation with reinforcement learning

Download (13.48 MB)
posted on 2023-07-30, 12:57 authored by Pawel Miera, Hubert Szolc, Tomasz KryjakTomasz Kryjak

Reinforcement learning is of increasing importance in the field of robot control and simulation plays a~key role in this process. In the unmanned aerial vehicles (UAVs, drones), there is also an increase in the number of published scientific papers involving this approach. In this work, an autonomous drone control system was prepared to fly forward (according to its coordinates system) and pass the trees encountered in the forest based on the data from a rotating LiDAR sensor. The Proximal Policy Optimization (PPO) algorithm, an example of reinforcement learning (RL), was used to prepare it. A custom simulator in the Python language was developed for this purpose. The Gazebo environment, integrated with the Robot Operating System (ROS), was also used to test the resulting control algorithm. Finally, the prepared solution was implemented in the Nvidia Jetson Nano eGPU and verified in the real tests scenarios. During them, the drone successfully completed the set task and was able to repeatably avoid trees and fly through the forest.


AGH University of Krakow project no.


Email Address of Submitting Author

ORCID of Submitting Author


Submitting Author's Institution

AGH University of Krakow

Submitting Author's Country

  • Poland

Usage metrics