Monocular Vision for Mobile Robot Localization and Autonomous Navigation

This paper presents a new real-time localization system for a mobile robot. We show that autonomous navigation is possible in outdoor situation with the use of a single camera and natural landmarks. To do that, we use a three step approach. In a learning step, the robot is manually guided on a path and a video sequence is recorded with a front looking camera. Then a structure from motion algorithm is used to build a 3D map from this learning sequence. Finally in the navigation step, the robot uses this map to compute its localization in real-time and it follows the learning path or a slightly different path if desired. The vision algorithms used for map building and localization are first detailed. Then a large part of the paper is dedicated to the experimental evaluation of the accuracy and robustness of our algorithms based on experimental data collected during two years in various environments.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  C. Samson.  Control of chained systems application to path following and time-varying point-stabilization of mobile robots , 1995, IEEE Trans. Autom. Control..

[5]  Masayuki Inaba,et al.  Visual navigation using view-sequenced route representation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Carlos Canudas de Wit,et al.  Theory of Robot Control , 1996 .

[7]  Helder Araújo,et al.  A Fully Projective Formulation to Improve the Accuracy of Lowe's Pose-Estimation Algorithm , 1998, Comput. Vis. Image Underst..

[8]  Michel Dhome,et al.  Do We Really Need an Accurate Calibration Pattern to Achieve a Reliable Camera Calibration? , 1998, ECCV.

[9]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[10]  David Nistér,et al.  Frame Decimation for Structure and Motion , 2000, SMILE.

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Yoshiaki Shirai,et al.  Autonomous visual navigation of a mobile robot using a human-guided experience , 2002, Robotics Auton. Syst..

[13]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[14]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Martin Jägersand,et al.  Image-based localization with depth-enhanced image map , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[16]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Nicolas Simond,et al.  Trajectography of an uncalibrated stereo rig in urban environments , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[19]  Philippe Martinet,et al.  Accurate automatic guidance of an urban electric vehicle relying on a kinematic GPS sensor , 2004 .

[20]  Peter K. Allen,et al.  Localization methods for a mobile robot in urban environments , 2004, IEEE Transactions on Robotics.

[21]  Andrew W. Fitzgibbon,et al.  The Problem of Degeneracy in Structure and Motion Recovery from Uncalibrated Image Sequences , 1999, International Journal of Computer Vision.

[22]  Patrick Gros,et al.  Robot motion control from a visual memory , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[23]  Michel Dhome,et al.  Outdoor autonomous navigation using monocular vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Luc Van Gool,et al.  Omnidirectional sparse visual path following with occlusion-robust feature tracking , 2005 .

[25]  Philippe Martinet,et al.  Indoor Navigation of a Wheeled Mobile Robot along Visual Routes , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[26]  Antonis A. Argyros,et al.  Robot Homing by Exploiting Panoramic Vision , 2005, Auton. Robots.

[27]  Luc Van Gool,et al.  Feature based omnidirectional sparse visual path following , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Robert M. Haralick,et al.  Review and analysis of solutions of the three point perspective pose estimation problem , 1994, International Journal of Computer Vision.

[29]  Michel Dhome,et al.  Performance Evaluation of a Localization System Relying on Monocular Vision and Natural Landmarks , 2005 .

[30]  Michel Dhome,et al.  Localization in urban environments: monocular vision compared to a differential GPS sensor , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  Mathieu Perriollat,et al.  Uncertainty ellipsoids calculations for complex 3D reconstructions , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..