A Fast and Accurate Solution for Pose Estimation from 3D Correspondences

Estimating pose from given 3D correspondences, including point-to-point, point-to-line and point-to-plane correspondences, is a fundamental task in computer vision with many applications. We present a fast and accurate solution for the least-squares problem of this task. Previous works mainly focus on studying the way to find the global minimizer of the least-squares problem. However, existing works that show the ability to achieve the global minimizer are still unsuitable for real-time applications. Furthermore, as one of contributions of this paper, we prove that there exist ambiguous configurations for any number of lines and planes. These configurations have several solutions in theory, which makes the correct solution may come from a local minimizer when the data are with noise. Previous works based on convex optimization which is unable to find local minimizers do not work in the ambiguous configuration. Our algorithm is efficient and able to reveal local minimizers. We employ the Cayley-Gibbs-Rodriguez (CGR) parameterization of the rotation to derive a general rational cost for the three cases of 3D correspondences. The main contribution of this paper is to solve the first-order optimality conditions of the least-squares problem, which are of a complicated rational form. The central idea of our algorithm is to introduce some intermediate unknowns to simplify the problem. Extensive experimental results show that our algorithm is more stable than previous algorithms when the number N of correspondences is small. Besides, when N is large, our algorithm achieves the same accuracy as the state-of-the-art algorithm [1], but our algorithm is about 7 times faster than [1] in real applications.

[1]  Andreas Birk,et al.  Fast plane detection and polygonalization in noisy 3D range images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Anders P. Eriksson,et al.  Solving quadratically constrained geometrical problems using lagrangian duality , 2008, 2008 19th International Conference on Pattern Recognition.

[3]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[4]  Stergios I. Roumeliotis,et al.  Optimal estimation of vanishing points in a Manhattan world , 2011, 2011 International Conference on Computer Vision.

[5]  Reinhard Koch,et al.  An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency , 2013, J. Vis. Commun. Image Represent..

[6]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[7]  Hongdong Li,et al.  The 3D-3D Registration Problem Revisited , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Lipu Zhou,et al.  Automatic Extrinsic Calibration of a Camera and a 3D LiDAR Using Line and Plane Correspondences , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yubin Kuang,et al.  Revisiting the PnP Problem: A Fast, General and Optimal Solution , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[12]  Reinhard Koch,et al.  Pose Estimation from Line Correspondences: A Complete Analysis and a Series of Solutions , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Kostas Daniilidis,et al.  Automatic alignment of a camera with a line scan LIDAR system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Darius Burschka,et al.  Stochastic global optimization for robust point set registration , 2011, Comput. Vis. Image Underst..

[15]  Andrea Censi,et al.  An ICP variant using a point-to-line metric , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  Ji Zhang,et al.  Visual-lidar odometry and mapping: low-drift, robust, and fast , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Viktor Larsson,et al.  Uncovering Symmetries in Polynomial Systems , 2016, ECCV.

[18]  Jiaolong Yang,et al.  Go-ICP: Solving 3D Registration Efficiently and Globally Optimally , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Joel A. Hesch,et al.  A Direct Least-Squares (DLS) method for PnP , 2011, 2011 International Conference on Computer Vision.

[20]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Carl Olsson,et al.  Branch-and-Bound Methods for Euclidean Registration Problems , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yang Gao,et al.  Probabilistic RGB-D Odometry based on Points, Lines and Planes Under Depth Uncertainty , 2017, Robotics Auton. Syst..

[23]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[24]  Marina Weber,et al.  Using Algebraic Geometry , 2016 .

[25]  Hongdong Li,et al.  UPnP: An Optimal O(n) Solution to the Absolute Pose Problem with Universal Applicability , 2014, ECCV.

[26]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[27]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[28]  Javier González,et al.  Extrinsic calibration of a 2d laser-rangefinder and a camera based on scene corners , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Vladlen Koltun,et al.  Fast Global Registration , 2016, ECCV.

[30]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Yubin Kuang,et al.  Exploiting p-fold symmetries for faster polynomial equation solving , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[32]  Javier González,et al.  Convex Global 3D Registration with Lagrangian Duality , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Arjan Kuijper,et al.  Unifying Algebraic Solvers for Scaled Euclidean Registration from Point, Line and Plane Constraints , 2016, ACCV.

[34]  Chen Feng,et al.  Point-plane SLAM for hand-held 3D sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[35]  Arjan Kuijper,et al.  A universal, closed-form approach for absolute pose problems , 2018, Comput. Vis. Image Underst..

[36]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[37]  Carl Olsson,et al.  The Registration Problem Revisited: Optimal Solutions From Points, Lines and Planes , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[38]  Viktor Larsson,et al.  Efficient Solvers for Minimal Problems by Syzygy-Based Reduction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Pavel Zemcík,et al.  Absolute pose estimation from line correspondences using direct linear transformation , 2016, Comput. Vis. Image Underst..

[40]  Giorgio Grisetti,et al.  NICP: Dense normal based point cloud registration , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).