Visual odometry based on stereo image sequences with RANSAC-based outlier rejection scheme

A common prerequisite for many vision-based driver assistance systems is the knowledge of the vehicle's own movement. In this paper we propose a novel approach for estimating the egomotion of the vehicle from a sequence of stereo images. Our method is directly based on the trifocal geometry between image triples, thus no time expensive recovery of the 3-dimensional scene structure is needed. The only assumption we make is a known camera geometry, where the calibration may also vary over time. We employ an Iterated Sigma Point Kalman Filter in combination with a RANSAC-based outlier rejection scheme which yields robust frame-to-frame motion estimation even in dynamic environments. A high-accuracy inertial navigation system is used to evaluate our results on challenging real-world video sequences. Experiments show that our approach is clearly superior compared to other filtering techniques in terms of both, accuracy and run-time.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Kurt Konolige,et al.  Real-time Localization in Outdoor Environments using Stereo Vision and Inexpensive GPS , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[4]  Yang Cheng,et al.  Path following using visual odometry for a Mars rover in high-slip environments , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[5]  Larry H. Matthies,et al.  Robust and Efficient Stereo Feature Tracking for Visual Odometry , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  Gaurav S. Sukhatme,et al.  The Iterated Sigma Point Kalman Filter with Applications to Long Range Stereo , 2006, Robotics: Science and Systems.

[7]  Kin Hong Wong,et al.  Recursive Camera-Motion Estimation With the Trifocal Tensor , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Tobias Gindele,et al.  Team AnnieWAY's autonomous system for the 2007 DARPA Urban Challenge , 2008 .

[9]  Hernán Badino,et al.  A Robust Approach for Ego-Motion Estimation Using a Mobile Stereo Platform , 2004, IWCM.

[10]  Takeo Kato,et al.  Vehicle Ego-Motion Estimation and Moving Object Detection using a Monocular Camera , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[13]  Javier Civera,et al.  1-point RANSAC for EKF-based Structure from Motion , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Christian Dornhege,et al.  Visual Odometry for Tracked Vehicles , 2006 .

[15]  Kurt Konolige,et al.  Visual Odometry Using Sparse Bundle Adjustment on an Autonomous Outdoor Vehicle , 2006, AMS.

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Roland Siegwart,et al.  Stereo-Based Ego-Motion Estimation Using Pixel Tracking and Iterative Closest Point , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[18]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[19]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[20]  David Nister,et al.  Bundle Adjustment Rules , 2006 .

[21]  John B. Moore,et al.  Optimal State Estimation , 2006 .

[22]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[23]  Larry H. Matthies,et al.  Real-time detection of moving objects from moving vehicles using dense stereo and optical flow , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[24]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  K. Konolige.  Rough Terrain Visual Odometry , 2007 .

[26]  Larry H. Matthies,et al.  Real-time detection of moving objects in a dynamic scene from moving robotic vehicles , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[27]  Roland Siegwart,et al.  Real-time monocular visual odometry for on-road vehicles with 1-point RANSAC , 2009, 2009 IEEE International Conference on Robotics and Automation.

[28]  Robert C. Bolles,et al.  Localization and Mapping for Autonomous Navigation in Outdoor Terrains : A Stereo Vision Approach , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[29]  Andrew Howard,et al.  Real-time stereo visual odometry for autonomous ground vehicles , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..