Remote Marker-Based Tracking for UAV Landing Using Visible-Light Camera Sensor

Unmanned aerial vehicles (UAVs), which are commonly known as drones, have proved to be useful not only on the battlefields where manned flight is considered too risky or difficult, but also in everyday life purposes such as surveillance, monitoring, rescue, unmanned cargo, aerial video, and photography. More advanced drones make use of global positioning system (GPS) receivers during the navigation and control loop which allows for smart GPS features of drone navigation. However, there are problems if the drones operate in heterogeneous areas with no GPS signal, so it is important to perform research into the development of UAVs with autonomous navigation and landing guidance using computer vision. In this research, we determined how to safely land a drone in the absence of GPS signals using our remote maker-based tracking algorithm based on the visible light camera sensor. The proposed method uses a unique marker designed as a tracking target during landing procedures. Experimental results show that our method significantly outperforms state-of-the-art object trackers in terms of both accuracy and processing time, and we perform test on an embedded system in various environments.

[1]  Hailong Pei,et al.  Improved Vision-Based Algorithm for Unmanned Aerial Vehicles Autonomous Landing , 2013, J. Multim..

[2]  Salah Sukkarieh,et al.  Inertial Sensor-Based Simultaneous Localization and Mapping for UAVs , 2015 .

[3]  C.-H. Kuo,et al.  High-Resolution Multisensor Infrastructure Inspection with Unmanned Aircraft Systems , 2013 .

[4]  Yanning Zhang,et al.  A Ground-Based Near Infrared Camera Array System for UAV Auto-Landing in GPS-Denied Environment , 2016, Sensors.

[5]  Kevin Ling,et al.  Precision Landing of a Quadrotor UAV on a Moving Target Using Low-Cost Sensors , 2014 .

[6]  Gaurav S. Sukhatme,et al.  Vision-based autonomous landing of an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  Hadi Moradi,et al.  SLAM-inspired simultaneous localization of UAV and RF sources with unknown transmitted power , 2016 .

[8]  Mehmet Türkan,et al.  Image prediction: Template matching vs. sparse approximation , 2010, 2010 IEEE International Conference on Image Processing.

[9]  Roberto Opromolla,et al.  A Model-Based 3D Template Matching Technique for Pose Acquisition of an Uncooperative Space Object , 2015, Sensors.

[10]  Yong Zhang,et al.  Research on computer vision-based for UAV autonomous landing on a ship , 2009, Pattern Recognit. Lett..

[11]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[12]  Gonçalo Charters Santos Cruz,et al.  Obstacle Avoidance for Unmanned Aerial Vehicles , 2012, J. Intell. Robotic Syst..

[13]  Xiu Chunbo,et al.  Template Matching Algorithm Based on Edge Detection , 2011, 2011 International Symposium on Computer Science and Society.

[14]  C. Heipke,et al.  Context-based urban terrain reconstruction from uav-videos for geoinformation applications , 2012 .

[15]  Hao Li,et al.  A novel image template matching based on particle filtering optimization , 2010, Pattern Recognit. Lett..

[16]  Valerio Baiocchi,et al.  Development of a Software to Plan UAVs Stereoscopic Flight: An Application on Post Earthquake Scenario in L'Aquila City , 2013, ICCSA.

[17]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[18]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[19]  ALID,et al.  IMAGE SEGMENTATION : A WATERSHED TRANSFORMATION ALGORITHM , 2009 .

[20]  Sven Lange,et al.  Autonomous landing for a multirotor UAV using vision , 2008 .

[21]  Ran Duan,et al.  Onboard Robust Visual Tracking for UAVs Using a Reliable Global-Local Object Model , 2016, Sensors.

[22]  Zhongke Shi,et al.  Detection and tracking control for air moving target based on dynamic template matching: Detection and tracking control for air moving target based on dynamic template matching , 2010 .

[23]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Hong Guan,et al.  Towards UAV-based bridge inspection systems: a review and an application perspective , 2015 .

[25]  Tal Shima,et al.  UAVs Task and Motion Planning in the Presence of Obstacles and Prioritized Targets , 2015, Sensors.

[26]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[28]  Min Hu,et al.  A Novel Model of Image Segmentation Based on Watershed Algorithm , 2013, Adv. Multim..

[29]  Jianwei Zhang,et al.  Autonomous landing of an UAV with a ground-based actuated infrared stereo vision system , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Vasilis Athanasiou,et al.  On-board computational efficiency in real time UAV embedded terrain reconstruction , 2014 .

[31]  Angelos Antonopoulos,et al.  Towards Autonomous Modular UAV Missions: The Detection, Geo-Location and Landing Paradigm , 2016, Sensors.

[32]  Ryosuke Shibasaki,et al.  Real-time monitoring system using unmanned aerial vehicle integrated with sensor observation service , 2012 .

[33]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[34]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[35]  G. Anitha,et al.  Vision Based Autonomous Landing of an Unmanned Aerial Vehicle , 2012 .

[36]  Biao Wang,et al.  Use of land's cooperative object to estimate UAV's pose for autonomous landing , 2013 .

[37]  Lucian Busoniu,et al.  Vision and Control for UAVs: A Survey of General Methods and of Inexpensive Platforms for Infrastructure Inspection , 2015, Sensors.

[38]  Ryan M. Eustice,et al.  NEEC Research : Toward GPS-denied Landing of Unmanned Aerial Vehicles on Ships at Sea , 2014 .

[39]  Emmanuel Lemoine,et al.  Amazon Prime Air , 2019 .

[40]  Ryosuke Shibasaki,et al.  UAV-Based Sensor Web Monitoring System , 2012 .

[41]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[42]  Gianluca Paravati,et al.  Relevance-Based Template Matching for Tracking Targets in FLIR Imagery , 2014, Sensors.

[43]  A. Sekar,et al.  A Survey on Image Segmentation Techniques , 2015 .

[44]  Anju Bala An Improved Watershed Image Segmentation Technique using MATLAB , 2012 .

[45]  Xiaoming Li A Software Scheme for UAV's Safe Landing Area Discovery , 2013 .

[46]  Sergio Montenegro,et al.  Obstacle Detection and Collision Avoidance for a UAV With Complementary Low-Cost Sensors , 2015, IEEE Access.

[47]  Sri Hartati,et al.  A Comparative Study of Thresholding Algorithms on Breast Area and Fibroglandular Tissue , 2015 .

[48]  Andrew J. Barry High‐speed autonomous obstacle avoidance with pushbroom stereo , 2018, J. Field Robotics.

[49]  Jiri Matas,et al.  Forward-Backward Error: Automatic Detection of Tracking Failures , 2010, 2010 20th International Conference on Pattern Recognition.

[50]  Sharul Sham Dol,et al.  A Review on Marine Search and Rescue Operations Using Unmanned Aerial Vehicles , 2015 .

[51]  Hongbo Zhou,et al.  Improved Vision-Based Algorithm for Unmanned Aerial Vehicles Autonomous Landing , 2013, J. Multim..

[52]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Reg Austin,et al.  Unmanned Aircraft Systems: Uavs Design, Development and Deployment , 2010 .

[54]  Brandon R. Call,et al.  Obstacle Avoidance for Small Unmanned Air Vehicles , 2006 .

[55]  Mani Golparvar-Fard,et al.  Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works , 2016 .

[56]  Lam A Study on Similarity Computations in Template Matching Technique for Identity Verification , 2010 .

[57]  Nassir Salman,et al.  Image Segmentation Based on Watershed and Edge Detection Techniques , 2006, Int. Arab J. Inf. Technol..

[58]  Miguel A. Olivares-Méndez,et al.  Trinocular ground system to control UAVs , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  David Hyunchul Shim,et al.  Vision-based UAV landing on the moving vehicle , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).