A Vision-Based Approach for Unmanned Aerial Vehicle Landing

In this paper we present an on-board Computer Vision System for the pose estimation of an Unmanned Aerial Vehicle (UAV) with respect to a human-made landing target. The proposed methodology is based on a coarse-to-fine approach to search the target marks starting from the recognition of the characteristics visible from long distances, up to the inner details when short distances require high precisions for the final landing phase. A sequence of steps, based on a Point-to-Line Distance method, analyzes the contour information and allows the recognition of the target also in cluttered scenarios. The proposed approach enables to fully assist the UAV during its take-off and landing on the target, as it is able to detect anomalous situations, such as the loss of the target from the image field of view, and the precise evaluation of the drone attitude when only a part of the target remains visible in the image plane. Several indoor and outdoor experiments have been carried out to demonstrate the effectiveness, robustness and accuracy of developed algorithm. The outcomes have proven that our methodology outperforms the current state of art, providing high accuracies in estimating the position and the orientation of landing target with respect to the UAV.

[1]  Sebastian Scherer,et al.  Autonomous landing at unprepared sites by a full-scale helicopter , 2012, Robotics Auton. Syst..

[2]  Scott E. Umbaugh,et al.  Digital image processing and analysis : human and computer vision applications with CVIPtools , 2011 .

[3]  Matthew A. Garratt,et al.  Monocular vision-based real-time target recognition and tracking for autonomously landing an UAV in a cluttered shipboard environment , 2017, Auton. Robots.

[4]  Dianle Zhou,et al.  Deep learning for unmanned aerial vehicles landing carrier in different conditions , 2017, 2017 18th International Conference on Advanced Robotics (ICAR).

[5]  Kwang Nam Choi,et al.  Autonomous flight system using marker recognition on drone , 2015, 2015 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[6]  Lucian Busoniu,et al.  Vision and Control for UAVs: A Survey of General Methods and of Inexpensive Platforms for Infrastructure Inspection , 2015, Sensors.

[7]  M. Scarano,et al.  Applications of UAV Photogrammetric Surveys to Natural Hazard Detection and Cultural Heritage Documentation , 2017 .

[8]  G Balamurugan,et al.  Survey on UAV navigation in GPS denied environments , 2016, 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES).

[9]  Arturo de la Escalera,et al.  Survey of computer vision algorithms and applications for unmanned aerial vehicles , 2018, Expert Syst. Appl..

[10]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[11]  Liang Li-ping Improvement of position and orientation measurement algorithm of monocular vision based on circle features , 2009 .

[12]  Kwang-Ryul Baek,et al.  Implementation of vision-based real time helipad detection system , 2012, 2012 12th International Conference on Control, Automation and Systems.

[13]  Paulo Rodrigues,et al.  Saliency-based cooperative landing of a multirotor aerial vehicle on an autonomous surface vehicle , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[14]  Matthew J. Rutherford,et al.  Real-time, GPU-based pose estimation of a UAV for autonomous takeoff and landing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Pat Doody,et al.  Neural networks to aid the autonomous landing of a UAV on a ship , 2017, 2017 28th Irish Signals and Systems Conference (ISSC).

[16]  Chandran Saravanan,et al.  Autonomous robust helipad detection algorithm using computer vision , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[17]  Anis Koubâa,et al.  Design and performance analysis of global path planning techniques for autonomous mobile robots in grid environments , 2017 .

[18]  Drago Matko,et al.  Quadrocopter Hovering Using Position-estimation Information from Inertial Sensors and a High-delay Video System , 2012, J. Intell. Robotic Syst..

[19]  Ettore Stella,et al.  Helipad detection for accurate UAV pose estimation by means of a visual sensor , 2017 .

[20]  Kenichi Kanatani,et al.  Ellipse Analysis and 3D Computation of Circles , 2016 .

[21]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[22]  Christoforos Kanellakis,et al.  Survey on Computer Vision for UAVs: Current Developments and Trends , 2017, Journal of Intelligent & Robotic Systems.

[23]  Grzegorz Chmaj,et al.  Distributed Processing Applications for UAV/drones: A Survey , 2014, ICSEng.

[24]  Jianwei Zhang,et al.  Vision-based autonomous landing system for unmanned aerial vehicle: A survey , 2014, 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI).

[25]  Andreas Zell,et al.  An Onboard Monocular Vision System for Autonomous Takeoff, Hovering and Landing of a Micro Aerial Vehicle , 2012, Journal of Intelligent & Robotic Systems.

[26]  Jochen Teizer,et al.  Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system , 2014 .

[27]  Andreas Zell,et al.  Autonomous Landing of MAVs on an Arbitrarily Textured Landing Site Using Onboard Monocular Vision , 2014, J. Intell. Robotic Syst..

[28]  P. B. Sujit,et al.  A survey of autonomous landing techniques for UAVs , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[29]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[30]  Jose Luis Sanchez-Lopez,et al.  An Approach Toward Visual Autonomous Ship Board Landing of a VTOL UAV , 2013, Journal of Intelligent & Robotic Systems.

[31]  David Reiser,et al.  3-D Imaging Systems for Agricultural Applications—A Review , 2016, Sensors.

[32]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Ruhina Karani,et al.  Detection of landing areas for unmanned aerial vehicles , 2015, 2016 International Conference on Computing Communication Control and automation (ICCUBEA).

[34]  Meng Li,et al.  Direct solution for pose estimation of single circle with detected centre , 2016 .

[35]  Colin Greatwood,et al.  Learning to Perform a Perched Landing on the Ground Using Deep Reinforcement Learning , 2018, J. Intell. Robotic Syst..

[36]  Sven Lange,et al.  A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments , 2009, 2009 International Conference on Advanced Robotics.

[37]  Agathoniki Trigoni,et al.  Supporting Search and Rescue Operations with UAVs , 2010, 2010 International Conference on Emerging Security Technologies.

[38]  Vijay Kumar,et al.  Trajectory generation and control for precise aggressive maneuvers with quadrotors , 2012, Int. J. Robotics Res..

[39]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[40]  Peter Fröhlich,et al.  A multisensor platform for comprehensive detection of crop status: Results from two case studies , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[41]  D. Hilbert,et al.  Geometry and the Imagination , 1953 .

[42]  Pascual Campoy Cervera,et al.  An Approach Toward Visual Autonomous Ship Board Landing of a VTOL UAV , 2014, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).