Towards Autonomous Modular UAV Missions: The Detection, Geo-Location and Landing Paradigm

Nowadays, various unmanned aerial vehicle (UAV) applications become increasingly demanding since they require real-time, autonomous and intelligent functions. Towards this end, in the present study, a fully autonomous UAV scenario is implemented, including the tasks of area scanning, target recognition, geo-location, monitoring, following and finally landing on a high speed moving platform. The underlying methodology includes AprilTag target identification through Graphics Processing Unit (GPU) parallelized processing, image processing and several optimized locations and approach algorithms employing gimbal movement, Global Navigation Satellite System (GNSS) readings and UAV navigation. For the experimentation, a commercial and a custom made quad-copter prototype were used, portraying a high and a low-computational embedded platform alternative. Among the successful targeting and follow procedures, it is shown that the landing approach can be successfully performed even under high platform speeds.

[1]  Reg Austin,et al.  Unmanned Aircraft Systems: Uavs Design, Development and Deployment , 2010 .

[2]  Ryosuke Shibasaki,et al.  UAV-Based Sensor Web Monitoring System , 2012 .

[3]  C. Heipke,et al.  Context-based urban terrain reconstruction from uav-videos for geoinformation applications , 2012 .

[4]  Valerio Baiocchi,et al.  Development of a Software to Plan UAVs Stereoscopic Flight: An Application on Post Earthquake Scenario in L'Aquila City , 2013, ICCSA.

[5]  Hadi Moradi,et al.  SLAM-inspired simultaneous localization of UAV and RF sources with unknown transmitted power , 2016 .

[6]  Agathoniki Trigoni,et al.  Supporting Search and Rescue Operations with UAVs , 2010, 2010 International Conference on Emerging Security Technologies.

[7]  T. Vincenty.  DIRECT AND INVERSE SOLUTIONS OF GEODESICS ON THE ELLIPSOID WITH APPLICATION OF NESTED EQUATIONS , 1975 .

[8]  K. Shadan,et al.  Available online: , 2012 .

[9]  Lucian Busoniu,et al.  Vision and Control for UAVs: A Survey of General Methods and of Inexpensive Platforms for Infrastructure Inspection , 2015, Sensors.

[10]  Christopher Kurt Fourie.  The autonomous landing of an unmanned helicopter on a moving platform , 2015 .

[11]  Nabil Aouf,et al.  Vision Based Autonomous Landing of Multirotor UAV on Moving Platform , 2017, J. Intell. Robotic Syst..

[12]  Mani Golparvar-Fard,et al.  Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works , 2016 .

[13]  Ryan M. Eustice,et al.  NEEC Research : Toward GPS-denied Landing of Unmanned Aerial Vehicles on Ships at Sea , 2014 .

[14]  Andreas Zell,et al.  Automatic Take Off, Tracking and Landing of a Miniature UAV on a Moving Carrier Vehicle , 2011, J. Intell. Robotic Syst..

[15]  Ryosuke Shibasaki,et al.  Real-time monitoring system using unmanned aerial vehicle integrated with sensor observation service , 2012 .

[16]  Pascual Campoy Cervera,et al.  An Approach Toward Visual Autonomous Ship Board Landing of a VTOL UAV , 2014, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[17]  Tal Shima,et al.  UAVs Task and Motion Planning in the Presence of Obstacles and Prioritized Targets , 2015, Sensors.

[18]  Vasilis Athanasiou,et al.  On-board computational efficiency in real time UAV embedded terrain reconstruction , 2014 .

[19]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Salah Sukkarieh,et al.  Inertial Sensor-Based Simultaneous Localization and Mapping for UAVs , 2015 .

[21]  Andy J. Keane,et al.  Design Optimisation of a Reconfigurable Perching Element for Vertical Take-Off and Landing Unmanned Aerial Vehicles , 2013 .

[22]  Nian Zhang,et al.  Landmark-based localization for Unmanned Aerial Vehicles , 2013, 2013 IEEE International Systems Conference (SysCon).

[23]  Gonçalo Charters Santos Cruz,et al.  Obstacle Avoidance for Unmanned Aerial Vehicles , 2012, J. Intell. Robotic Syst..

[24]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  C.-H. Kuo,et al.  High-Resolution Multisensor Infrastructure Inspection with Unmanned Aircraft Systems , 2013 .

[26]  Kevin Ling,et al.  Precision Landing of a Quadrotor UAV on a Moving Target Using Low-Cost Sensors , 2014 .

[27]  Jianqiang Yi,et al.  Disturbance Rejection in UAV's velocity and attitude control: Problems and solutions , 2011, Proceedings of the 30th Chinese Control Conference.

[28]  Gábor Sörös.  GPU-accelerated joint 1D and 2D barcode localization on smartphones , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Tsutomu Maruyama,et al.  Performance comparison of FPGA, GPU and CPU in image processing , 2009, 2009 International Conference on Field Programmable Logic and Applications.

[30]  Srikanth Saripalli,et al.  Vision-based Autonomous Landing of an Helicopter on a Moving Target , 2009 .

[31]  Andrew J. Barry.  High‐speed autonomous obstacle avoidance with pushbroom stereo , 2018, J. Field Robotics.

[32]  Sharul Sham Dol,et al.  A Review on Marine Search and Rescue Operations Using Unmanned Aerial Vehicles , 2015 .

[33]  Adriana Leiras,et al.  LITERATURE REVIEW OF THE APPLICATIONS OF UAVS IN HUMANITARIAN RELIEF , 2015 .

[34]  David Hyunchul Shim,et al.  Outdoor autonomous landing on a moving platform for quadrotors using an omnidirectional camera , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[35]  Sergio Montenegro,et al.  Obstacle Detection and Collision Avoidance for a UAV With Complementary Low-Cost Sensors , 2015, IEEE Access.

[36]  Marcus Frølich.  Automatic Ship Landing System for Fixed-Wing UAV , 2015 .

[37]  Baiocchi Valerio,et al.  Development of a software to plan UAVs stereoscopic flight: An application on post earthquake scenario in L'Aquila city , 2013 .

[38]  Yong Zhang,et al.  Research on computer vision-based for UAV autonomous landing on a ship , 2009, Pattern Recognit. Lett..

[39]  Robert E. Mahony,et al.  Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow , 2012, IEEE Transactions on Robotics.

[40]  Clark N. Taylor,et al.  Obstacle Avoidance For Unmanned Air Vehicles Using Image Feature Tracking , 2006 .

[41]  Antidio Viguria,et al.  UAV helicopter relative state estimation for autonomous landing on moving platforms in a GPS-denied scenario , 2015 .

[42]  Jianda Han,et al.  Autonomous Landing of an Unmanned Helicopter on a Moving Platform based on LP Path Planning , 2012 .

[43]  Hong Guan,et al.  Towards UAV-based bridge inspection systems: a review and an application perspective , 2015 .

[44]  So-Ryeok Oh,et al.  Autonomous Helicopter Landing on a Moving Platform Using a Tether , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.