An integrated stereo visual odometry for robotic navigation

In this paper, we propose a novel method to accurately estimate the arbitrary motion of a calibrated stereo rig from a noisy sequence. In the proposed method, a projective camera model is used which is appropriate for scenes where the objects are close to the camera or where there is depth variation in the scene. We propose a feature-based method that estimates large 3D translation and rotation motion of a moving rig. The translational velocity and acceleration and angular velocity of the rig are then estimated using a recursive method. In addition, we account for different motion types such as pure rotation and pure translation in different directions. In our studies, we assume that the rig motion is noisy, i.e., the acceleration and velocity of the camera are not perfectly constant. Our experimental results show that we obtain accurate estimates of rotation matrix and translation vector parameters across different test-cases with large and small baselines. For long sequences, the estimated motion parameters are within +/-0.2 mm.

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  Larry H. Matthies,et al.  Robust and Efficient Stereo Feature Tracking for Visual Odometry , 2008, 2008 IEEE International Conference on Robotics and Automation.

[3]  Trevor Darrell,et al.  Stereo tracking using ICP and normal flow constraint , 2002, Object recognition supported by user interaction for service robots.

[4]  Jonathan M. Garibaldi,et al.  Fast, unconstrained camera motion estimation from stereo without tracking and robust statistics , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[5]  Sukhan Lee,et al.  A Kalman filter approach for accurate 3-D motion estimation from a sequence of stereo images , 1991, CVGIP Image Underst..

[6]  Larry Matthies,et al.  Stereo vision and rover navigation software for planetary exploration , 2002, Proceedings, IEEE Aerospace Conference.

[7]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[8]  Harpreet S. Sawhney,et al.  Correlation-based estimation of ego-motion and structure from motion and stereo , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  David Nistér,et al.  Preemptive RANSAC for live structure and motion estimation , 2005, Machine Vision and Applications.

[10]  Truong Nguyen,et al.  An integrated stereo ego-motion estimation framework with sparse depth map , 2012, The 2012 International Conference on Advanced Technologies for Communications.

[11]  Nobuyuki Kita,et al.  Sequential localisation and map-building for real-time computer vision and robotics , 2001, Robotics Auton. Syst..

[12]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[14]  Rama Chellappa,et al.  3-D Motion Estimation Using a Sequence of Noisy Stereo Images: Models, Estimation, and Uniqueness Results , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[16]  Nikos Komodakis,et al.  Robust 3-D motion estimation and depth layering , 1997, Proceedings of 13th International Conference on Digital Signal Processing.

[17]  Andrew Howard,et al.  Real-time stereo visual odometry for autonomous ground vehicles , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Tatsuya Suzuki,et al.  Measurement of vehicle motion and orientation using optical flow , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[19]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[20]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[21]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[23]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[24]  Dmitry B. Goldgof,et al.  Matching and motion estimation of three-dimensional point and line sets using eigenstructure without correspondences , 1992, Pattern Recognit..

[25]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[26]  Larry H. Matthies,et al.  Real-time detection of moving objects from moving vehicles using dense stereo and optical flow , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).