Vision-based autonomous landing of unmanned aerial vehicles

We present our design of a real-time vision-based landing pad detection and pose estimation for many Unmanned Aerial Vehicles(UAV) and implementation on Raspberry Pi. We describe the vision algorithm for precise landing pad detection and recognition and estimate the position and orientation of the UAV relative to the landing pad. The vision algorithm is robust, accurate, and computationally inexpensive. As a computer board which is easy to embed in the moving body, Raspberry Pi is applied to run the vision algorithm and then outputs the position and orientation information through the serial port. We present results from a simulated landing flight test on Raspberry Pi which shows the vision-based detection is accurate to 98.5% and the state estimates are fast at a frame rate of approximately 13Hz.

[1]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[2]  Thomas H Cormen.  Introduction to Algorithms and Java CD-ROM , 2003 .

[3]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[4]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  John,et al.  Strapdown Inertial Navigation Technology - 2nd Edition , 2005 .

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[8]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  G. Anitha,et al.  Vision Based Autonomous Landing of an Unmanned Aerial Vehicle , 2012 .

[10]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[11]  Zhihong Peng,et al.  Ground Target Tracking and Collision Avoidance for UAV Based Guidance Vector Field , 2015, J. Adv. Comput. Intell. Intell. Informatics.

[12]  Tom Duff,et al.  Matrix animation and polar decomposition , 1992 .

[13]  Edwin Olson,et al.  AprilTag 2: Efficient and robust fiducial detection , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Jan Wendel,et al.  An integrated GPS/MEMS-IMU navigation system for an autonomous helicopter , 2006 .

[15]  John Weston,et al.  Strapdown Inertial Navigation Technology, Second Edition , 2005 .

[16]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .