YOLO-Based Terrain Classification for UAV Safe Landing Zone Detection

Autonomous mobile robots such as Unmanned Aerial Vehicles (UAVs) must be capable of navigating safely in unknown and dynamic environments. In emergency situations such as hardware failure or loss of communication links, UAVs must be able to land safely in an area that is flat and free of obstacles. Currently, most UAVs make use of global positioning system (GPS) receivers during mission and navigation which allows Return-To-Home features for advanced UAVs in emergency scenarios such as signal loss or low battery. However, problems arise if the UAV operates in a heterogeneous environment with no GPS signal accessible. In these GPS-denied areas, it is important to determine the terrain of the environment where the UAV is located to locate a safe space to land. This paper utilizes deep learning algorithms in YOLO architecture including YOLOv5, YOLOv6, YOLOv7, and YOLOv8 to determine the type of terrains obtained from aerial images. Based on the simulations done, the most recently developed YOLOv8 obtained the highest mean average precision (mAP@0.5:0.95) of 89.1, and F1 score of 90.8. Meanwhile, the YOLOv5, YOLOv6, and YOLOv7 obtained mean average precision (mAP@0.5:0.95) of 69.5, 78.1, and 68.8, respectively, and F1 scores of 77.8, 84.9, 85.7, and 81.7, respectively. With these results, it can be confirmed that YOLOv8 outweighs the performance of the other YOLO architecture models in terms of the mAP and F1 scores in determining the terrain.

[1]  Maria Gemel B. Palconit,et al.  Detection of Japanese Quails (Coturnix japonica) in Poultry Farms Using YOLOv5 and Detectron2 Faster R-CNN , 2022, J. Adv. Comput. Intell. Intell. Informatics.

[2]  Hong-chun Zhu,et al.  Detection of Camellia oleifera Fruit in Complex Scenes by Using YOLOv7 and Data Augmentation , 2022, Applied Sciences.

[3]  Haobo Liu,et al.  Vision-Based Autonomous Landing for the UAV: A Review , 2022, Aerospace.

[4]  Yi Yue,et al.  Deep Learning Based Detector YOLOv5 for Identifying Insect Pests , 2022, Applied Sciences.

[5]  L. Li,et al.  YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications , 2022, ArXiv.

[6]  Upesh Nepal,et al.  Comparing YOLOv3, YOLOv4 and YOLOv5 for Autonomous Landing Spot Detection in Faulty UAVs , 2022, Sensors.

[7]  Zeming Li,et al.  YOLOX: Exceeding YOLO Series in 2021 , 2021, ArXiv.

[8]  Min Li,et al.  Agricultural Greenhouses Detection in High-Resolution Satellite Images Based on Convolutional Neural Networks: Comparison of Faster R-CNN, YOLO v3 and SSD , 2020, Sensors.

[9]  Lu Yan,et al.  A Safe Landing Site Selection Method of UAVs Based on LiDAR Point Clouds , 2020, 2020 39th Chinese Control Conference (CCC).

[10]  Seigfred V. Prado,et al.  Development of a Deep Learning-Based Brain-Computer Interface for Visual Imagery Recognition , 2020, 2020 16th IEEE International Colloquium on Signal Processing & Its Applications (CSPA).

[11]  Husnain Mansoor Ali,et al.  Applications of unmanned aerial vehicles: a review , 2019, 3C Tecnología_Glosas de innovación aplicadas a la pyme.

[12]  Edison A. Roxas,et al.  Prediction of Diabetic Peripheral Neuropathy (DPN) using Plantar Pressure Analysis and Learning Models , 2019, 2019 IEEE 11th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management ( HNICEM ).

[13]  Qinru Qiu,et al.  Autonomous Waypoint Planning, Optimal Trajectory Generation and Nonlinear Tracking Control for Multi-rotor UAVs , 2019, 2019 18th European Control Conference (ECC).

[14]  Qinru Qiu,et al.  Autonomous waypoints planning and trajectory generation for multi-rotor UAVs , 2019, DESTION@CPSIoTWeek.

[15]  Kang Ryoung Park,et al.  LightDenseYOLO: A Fast and Accurate Marker Tracker for Autonomous UAV Landing by Visible Light Camera Sensor on Drone , 2018, Sensors.

[16]  Edison A. Roxas,et al.  Traffic sign integrity analysis using deep learning , 2018, 2018 IEEE 14th International Colloquium on Signal Processing & Its Applications (CSPA).

[17]  Ryan Rhay P. Vicerra,et al.  Sitting posture assessment using computer vision , 2017, 2017IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM).

[18]  Hao Jiang,et al.  Identification of autonomous landing sign for unmanned aerial vehicle based on faster regions with convolutional neural network , 2017, 2017 Chinese Automation Congress (CAC).

[19]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Sebastian Scherer,et al.  3D Convolutional Neural Networks for landing zone detection from LiDAR , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Philip J. Morrow,et al.  Timely autonomous identification of UAV safe landing zones , 2014, Image Vis. Comput..

[22]  Sebastian Scherer,et al.  Autonomous landing at unprepared sites by a full-scale helicopter , 2012, Robotics Auton. Syst..

[23]  G. Conte,et al.  An Integrated UAV Navigation System Based on Aerial Image Matching , 2008, 2008 IEEE Aerospace Conference.

[24]  N. Aburaed,et al.  A Study on the Autonomous Detection of Impact Craters , 2022, ANNPR.

[25]  Emanuele Frontoni,et al.  A Vision-Based Guidance System for UAV Navigation and Safe Landing using Natural Landmarks , 2010, J. Intell. Robotic Syst..

[26]  3C Tecnología_Glosas de innovación aplicadas a la pyme , 2022 .