Vision-Based Odometry and SLAM for Medium and High Altitude Flying UAVs

This paper proposes vision-based techniques for localizing an unmanned aerial vehicle (UAV) by means of an on-board camera. Only natural landmarks provided by a feature tracking algorithm will be considered, without the help of visual beacons or landmarks with known positions. First, it is described a monocular visual odometer which could be used as a backup system when the accuracy of GPS is reduced to critical levels. Homography-based techniques are used to compute the UAV relative translation and rotation by means of the images gathered by an onboard camera. The analysis of the problem takes into account the stochastic nature of the estimation and practical implementation issues. The visual odometer is then integrated into a simultaneous localization and mapping (SLAM) scheme in order to reduce the impact of cumulative errors in odometry-based position estimation approaches. Novel prediction and landmark initialization for SLAM in UAVs are presented. The paper is supported by an extensive experimental work where the proposed algorithms have been tested and validated using real UAVs.

[1]  Manolis I. A. Lourakis,et al.  Estimating the Jacobian of the Singular Value Decomposition: Theory and Applications , 2000, ECCV.

[2]  Aníbal Ollero,et al.  Improving vision-based planar motion estimation for unmanned aerial vehicles through online mosaicing , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  S. Sukkarieh,et al.  Autonomous airborne navigation in unknown terrain environments , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Robert E. Mahony,et al.  Image-based visual servo control of aerial robotic systems using linear image features , 2005, IEEE Transactions on Robotics.

[5]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[6]  Jeffrey Byrne,et al.  Stereo based obstacle detection for an unmanned air vehicle , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[7]  Gaurav S. Sukhatme,et al.  Visual servoing of an autonomous helicopter in urban areas using feature tracking , 2006, J. Field Robotics.

[8]  Thomas S. Huang,et al.  Estimating three-dimensional motion parameters of a rigid planar patch, II: Singular value decomposition , 1982 .

[9]  Takeo Kanade,et al.  A visual odometer for autonomous helicopter flight , 1999, Robotics Auton. Syst..

[10]  S. Shankar Sastry,et al.  Multiple view motion estimation and control for landing an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Isaac Kaminer,et al.  Unmanned aircraft navigation for shipboard landing using infrared vision , 2002 .

[12]  Gamini Dissanayake,et al.  An efficient multiple hypothesis filter for bearing-only SLAM , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[13]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[14]  Margrit Betke,et al.  Mobile robot localization using landmarks , 1997, IEEE Trans. Robotics Autom..

[15]  Zhixiong Zhang,et al.  Evolving neural networks for video attitude and height sensor , 1995, Defense, Security, and Sensing.

[16]  Aníbal Ollero,et al.  Homography Based Kalman Filter for Mosaic Building. Applications to UAV position estimation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Ernst D. Dickmanns,et al.  Autonomous landing of airplanes by dynamic machine vision , 1992, [1992] Proceedings IEEE Workshop on Applications of Computer Vision.

[18]  Gaurav S. Sukhatme,et al.  Omnidirectional vision for an autonomous helicopter , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Eric N. Johnson,et al.  Vision‐only control and guidance for aircraft , 2006, J. Field Robotics.

[20]  Simon Lacroix,et al.  A practical 3D bearing-only SLAM algorithm , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[22]  G. Conte,et al.  An Integrated UAV Navigation System Based on Aerial Image Matching , 2008, 2008 IEEE Aerospace Conference.

[23]  John J. Leonard,et al.  Adaptive Mobile Robot Navigation and Mapping , 1999, Int. J. Robotics Res..

[24]  Pascal Vasseur,et al.  Omnidirectional vision on UAV for attitude computation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[25]  Simon Lacroix,et al.  The Autonomous Blimp Project of LAAS-CNRS: Achievements in Flight Control and Terrain Mapping , 2004, Int. J. Robotics Res..

[26]  Aníbal Ollero,et al.  Motion compensation and object detection for autonomous helicopter visual navigation in the COMETS system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[27]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[28]  Aníbal Ollero,et al.  A visual odometer without 3D reconstruction for aerial vehicles. Applications to building inspection , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[29]  Eric N. Johnson,et al.  Vision-Aided Inertial Navigation for Flight Control , 2005 .

[30]  Teresa A. Vidal-Calleja,et al.  On the Observability of Bearing-only SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[31]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[32]  Gaurav S. Sukhatme,et al.  Landing on a Moving Target Using an Autonomous Helicopter , 2003, FSR.

[33]  S. Rock,et al.  Passive GPS-Free Navigation for Small UAVs , 2005, 2005 IEEE Aerospace Conference.

[34]  Aníbal Ollero,et al.  Control and perception techniques for aerial robotics , 2003, Annu. Rev. Control..

[35]  J. A. Volpe.  Vulnerability Assessment of the Transportation Infrastructure Relying on the Global Positioning Syst , 2001 .

[36]  Simon Lacroix,et al.  The Autonomous Blimp Project of LAAS/CNRS - Current Status , 2002, ISER.

[37]  Mandyam V. Srinivasan,et al.  Landing Strategies in Honeybees, and Applications to UAVs , 2001, ISRR.

[38]  Peter I. Corke,et al.  Height Estimation for an Autonomous Helicopter , 2000, ISER.

[39]  Jonghyuk Kim,et al.  Six DoF Decentralised SLAM , 2003 .

[40]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[41]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[42]  Patrick Hébert,et al.  Uncertain map making in natural environments , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[43]  Martial Hebert,et al.  Experimental Comparison of Techniques for Localization and Mapping Using a Bearing-Only Sensor , 2000, ISER.