Stereo Relative Pose from Line and Point Feature Triplets

Stereo relative pose problem lies at the core of stereo visual odometry systems that are used in many applications. In this work we present two minimal solvers for the stereo relative pose. We specifically consider the case when a minimal set consists of three point or line features and each of them has three known projections on two stereo cameras. We validate the importance of this formulation for practical purposes in our experiments with motion estimation. We then present a complete classification of minimal cases with three point or line correspondences each having three projections, and present two new solvers that can handle all such cases. We demonstrate a considerable effect from the integration of the new solvers into a visual SLAM system.

[1]  Reinhard Koch,et al.  An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency , 2013, J. Vis. Commun. Image Represent..

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  David J. Kriegman,et al.  Moving in stereo: Efficient structure and motion using lines , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Reinhard Koch,et al.  Pose Estimation from Line Correspondences: A Complete Analysis and a Series of Solutions , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Vincent Lepetit,et al.  An Efficient Minimal Solution for Multi-camera Motion , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[10]  Marina Weber,et al.  Using Algebraic Geometry , 2016 .

[11]  Karl Johan Åström,et al.  Solutions to Minimal Generalized Relative Pose Problems , 2005 .

[12]  Hongdong Li,et al.  Efficient Computation of Relative Pose for Multi-camera Systems , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Peter F. Sturm,et al.  A generic structure-from-motion framework , 2006, Comput. Vis. Image Underst..

[14]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[15]  Francesc Moreno-Noguer,et al.  Accurate and Linear Time Pose Estimation from Points and Lines , 2016, ECCV.

[16]  David Nistér,et al.  A Minimal Solution to the Generalised 3-Point Pose Problem , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[17]  Andreas Geiger,et al.  Object scene flow for autonomous vehicles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jan-Michael Frahm,et al.  A new minimal solution to the relative pose of a calibrated stereo camera with small field of view overlap , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Horst Wildenauer,et al.  Structure from Motion with Line Segments Under Relaxed Endpoint Constraints , 2014, 2014 2nd International Conference on 3D Vision.

[20]  Mohamed Abdellatif,et al.  A simple solution for the non perspective three point pose problem , 2014, 2014 International Conference on 3D Imaging (IC3D).

[21]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[22]  Andrew W. Fitzgibbon,et al.  Efficient Intersection of Three Quadrics and Applications in Computer Vision , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Jongwoo Lim,et al.  Egomotion Estimation Using Assorted Features , 2011, International Journal of Computer Vision.

[24]  Bruce W. Char,et al.  Maple V Library Reference Manual , 1992, Springer New York.

[25]  Jan-Michael Frahm,et al.  A geometric solver for calibrated stereo egomotion , 2011, 2011 International Conference on Computer Vision.

[26]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[28]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[29]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[30]  Helder Araújo,et al.  Direct Solution to the Minimal Generalized Pose , 2015, IEEE Transactions on Cybernetics.