Recovering camera motion from points and lines in stereo images: A recursive model-less approach using trifocal tensors

Estimating the 3-D motion of a moving camera from images is a common task in robotics and augmented reality. Most existing marker-less approaches make use of either points or lines. Taking the advantages of both kinds of features in an unknown environment is more attractive due to their availability and differences in characteristics. A novel model-less method is presented in this paper to tackle the 3-D motion tracking problem. Two Bayesian filters, one for point measurements while another for line measurements, are embedded in the Interacting Probabilistic Switching (IPS) framework. They compensate for the weaknesses in one another by utilizing both kinds of features in the stereo images. The proposed method is able to obtain the 3D motion given as little as two line or two point correspondences in consecutive images with the use of multiple trifocal tensors. Our method outperformed two recent methods in terms of accuracy and the problem of drifting was very little in real scenarios.

[1]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[2]  Yubin Kuang,et al.  Pose Estimation with Unknown Focal Length Using Points, Directions and Lines , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Zhanyi Hu,et al.  MSLD: A robust descriptor for line matching , 2009, Pattern Recognit..

[4]  Luis Puig,et al.  MEVO: Multi-environment stereo visual odometry , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Simon Lacroix,et al.  Monocular-vision based SLAM using Line Segments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Patrick Rives,et al.  Real-time Quadrifocal Visual Odometry , 2010, Int. J. Robotics Res..

[7]  Éric Marchand,et al.  Real-time 3D model-based tracking: combining edge and texture information , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Kin Hong Wong,et al.  Recursive three-dimensional model reconstruction based on Kalman filtering , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Vincent Lepetit,et al.  Model Based Training, Detection and Pose Estimation of Texture-Less 3D Objects in Heavily Cluttered Scenes , 2012, ACCV.

[11]  Kin Hong Wong,et al.  Merging artificial objects with marker-less video sequences based on the interacting multiple model method , 2006, IEEE Trans. Multim..

[12]  Kin Hong Wong,et al.  Recursive Camera-Motion Estimation With the Trifocal Tensor , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Eduardo P. da Silva,et al.  Probabilistic Egomotion for Stereo Visual Odometry , 2015, J. Intell. Robotic Syst..

[14]  Kin Hong Wong,et al.  Pose estimation for augmented reality applications using genetic algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Michael Felsberg,et al.  Robust stereo visual odometry from monocular techniques , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[16]  Narendra Ahuja,et al.  Motion and Structure from Line Correspondences; Closed-Form Solution, Uniqueness, and Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Ahmed M. Elgammal,et al.  Line-based relative pose estimation , 2011, CVPR 2011.

[18]  Pascal Monasse,et al.  Global Fusion of Relative Motions for Robust, Accurate and Scalable Structure from Motion , 2013, ICCV.

[19]  Alois Knoll,et al.  Visual odometry based on a Bernoulli filter , 2015 .

[20]  Peter F. Sturm,et al.  Pose estimation using both points and lines for geo-localization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  David J. Kriegman,et al.  Moving in stereo: Efficient structure and motion using lines , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Kin Hong Wong,et al.  Robust 3-D Motion Tracking From Stereo Images: A Model-Less Method , 2008, IEEE Transactions on Instrumentation and Measurement.

[23]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[25]  Feng Zhu,et al.  A New Method for Pose Estimation from Line Correspondences , 2009 .

[26]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Patrick Rives,et al.  Accurate Quadrifocal Tracking for Robust 3D Visual Odometry , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  Carsten Rother.  Linear multiview reconstruction of points, lines, planes and cameras using a reference plane , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[29]  Stefano Soatto,et al.  Structure from Motion Causally Integrated Over Time , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Lindsay Kleeman,et al.  Fusion of multimodal visual cues for model-based object tracking , 2003 .

[31]  Gregory D. Hager,et al.  Joint probabilistic techniques for tracking multi-part objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[32]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.