Experimental Evaluation of Autonomous Driving Based on Visual Memory and Image-Based Visual Servoing

In this paper, the performance of a topological-metric visual-path-following framework is investigated in different environments. The framework relies on a monocular camera as the only sensing modality. The path is represented as a series of reference images such that each neighboring pair contains a number of common landmarks. Local 3-D geometries are reconstructed between the neighboring reference images to achieve fast feature prediction. This condition allows recovery from tracking failures. During navigation, the robot is controlled using image-based visual servoing. The focus of this paper is on the results from a number of experiments that were conducted in different environments, lighting conditions, and seasons. The experiments with a robot car show that the framework is robust to moving objects and moderate illumination changes. It is also shown that the system is capable of online path learning.

[1]  Zhichao Chen,et al.  Qualitative Vision-Based Path Following , 2009, IEEE Transactions on Robotics.

[2]  Roland Siegwart,et al.  Real-time monocular visual odometry for on-road vehicles with 1-point RANSAC , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  Navid Nourani-Vatani,et al.  Practical visual odometry for car-like vehicles , 2009, 2009 IEEE International Conference on Robotics and Automation.

[4]  Stefano Soatto,et al.  Real-Time Feature Tracking and Outlier Rejection with Changes in Illumination , 2001, ICCV.

[5]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[9]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[10]  Alan M. Zhang,et al.  Robust appearance based visual route following in large scale outdoor environments , 2007 .

[11]  Larry H. Matthies,et al.  Visual odometry on the Mars exploration rovers - a tool to ensure accurate driving and science imaging , 2006, IEEE Robotics & Automation Magazine.

[12]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.

[13]  Sinisa Segvic,et al.  Outdoor visual path following experiments , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  François Chaumette,et al.  Image-based robot navigation from an image memory , 2007, Robotics Auton. Syst..

[15]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Sinisa Segvic,et al.  A mapping and localization framework for scalable appearance-based navigation , 2009, Comput. Vis. Image Underst..

[18]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[19]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[20]  Sebastian Thrun,et al.  A Personal Account of the Development of Stanley, the Robot That Won the DARPA Grand Challenge , 2006, AI Mag..

[21]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[22]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[23]  Masayuki Inaba,et al.  Visual navigation using view-sequenced route representation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[24]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[25]  Lindsay Kleeman,et al.  Robust Appearance Based Visual Route Following for Navigation in Large-scale Outdoor Environments , 2009, Int. J. Robotics Res..

[26]  Luc Van Gool,et al.  Feature based omnidirectional sparse visual path following , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Ian D. Reid,et al.  Mapping Large Loops with a Single Hand-Held Camera , 2007, Robotics: Science and Systems.

[29]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[30]  Zhichao Chen,et al.  Qualitative vision-based mobile robot navigation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[31]  Manolis I. A. Lourakis,et al.  Fast trifocal tensor estimation using virtual parallax , 2005, IEEE International Conference on Image Processing 2005.

[32]  Simon Lacroix,et al.  Vision-Based SLAM: Stereo and Monocular Approaches , 2007, International Journal of Computer Vision.

[33]  Ben J. A. Kröse,et al.  Navigation using an appearance based topological map , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[34]  Philippe Martinet,et al.  Indoor navigation of a non-holonomic mobile robot using a visual memory , 2008, Auton. Robots.

[35]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[36]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[37]  Kurt Konolige,et al.  Large-Scale Visual Odometry for Rough Terrain , 2007, ISRR.

[38]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[39]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[40]  Antonio Bicchi,et al.  Visual Servoing in the Large , 2009, Int. J. Robotics Res..

[41]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[42]  Michel Dhome,et al.  Outdoor autonomous navigation using monocular vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  David M. Bradley,et al.  Real-time image-based topological localization in large outdoor environments , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Udo Frese,et al.  Closing a Million-Landmarks Loop , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Gordon Wyeth,et al.  Mapping a Suburb With a Single Camera Using a Biologically Inspired SLAM System , 2008, IEEE Transactions on Robotics.

[46]  Philippe Martinet,et al.  Autonomous Navigation of Vehicles from a Visual Memory Using a Generic Camera Model , 2009, IEEE Transactions on Intelligent Transportation Systems.

[47]  Stefano Soatto,et al.  Real-time feature tracking and outlier rejection with changes in illumination , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.