POSEAMM: A Unified Framework for Solving Pose Problems using an Alternating Minimization Method

Pose estimation is one of the most important problems in computer vision. It can be divided in two different categories — absolute and relative — and may involve two different types of camera models: central and non-central. State-of-the-art methods have been designed to solve separately these problems. This paper presents a unified framework that is able to solve any pose problem by alternating optimization techniques between two set of parameters, rotation and translation. In order to make this possible, it is necessary to define an objective function that captures the problem at hand. Since the objective function will depend on the rotation and translation it is not possible to solve it as a simple minimization problem. Hence the use of Alternating Minimization methods, in which the function will be alternatively minimized with respect to the rotation and the translation. We show how to use our framework in three distinct pose problems. Our methods are then benchmarked with both synthetic and real data, showing their better balance between computational time and accuracy.

[1]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[2]  Roland Siegwart,et al.  Using multi-camera systems in robotics: Efficient solutions to the NPnP problem , 2013, 2013 IEEE International Conference on Robotics and Automation.

[3]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[6]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  Ping Wang,et al.  An efficient solution to the perspective-three-point pose problem , 2018, Comput. Vis. Image Underst..

[8]  Zuzana Kukelova,et al.  Polynomial Eigenvalue Solutions to the 5-pt and 6-pt Relative Pose Problems , 2008, BMVC.

[9]  Urs Niesen,et al.  Adaptive Alternating Minimization Algorithms , 2007, ISIT.

[10]  Laurent Kneip,et al.  OpenGV: A unified and generalized approach to real-time calibrated geometric vision , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Kalle Åström,et al.  Absolute pose for cameras under flat refractive interfaces , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Hongdong Li,et al.  Five-Point Motion Estimation Made Easy , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Peter F. Sturm,et al.  Pose estimation using both points and lines for geo-localization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Pedro Miraldo,et al.  A Minimal Closed-Form Solution for Multi-Perspective Pose Estimation using Points and Lines , 2018, ECCV.

[15]  Helder Araújo,et al.  Pose Estimation for General Cameras Using Lines , 2015, IEEE Transactions on Cybernetics.

[16]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Stergios I. Roumeliotis,et al.  An Efficient Algebraic Solution to the Perspective-Three-Point Problem , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[19]  Tobias Höllerer,et al.  gDLS: A Scalable Solution to the Generalized Pose and Scale Problem , 2014, ECCV.

[20]  Helder Araújo,et al.  A simple and robust solution to the minimal general pose estimation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Helder Araújo,et al.  Point-based calibration using a parametric representation of the general imaging model , 2011, 2011 International Conference on Computer Vision.

[22]  Axel Pinz,et al.  Fast and Globally Convergent Structure and Motion Estimation for General Camera Models , 2006, BMVC.

[23]  Laurent Kneip,et al.  The generalized relative pose and scale problem: View-graph fusion via 2D-2D registration , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[24]  Joel A. Hesch,et al.  A Direct Least-Squares (DLS) method for PnP , 2011, 2011 International Conference on Computer Vision.

[25]  Yubin Kuang,et al.  Revisiting the PnP Problem: A Fast, General and Optimal Solution , 2013, 2013 IEEE International Conference on Computer Vision.

[26]  Vincent Lepetit,et al.  An Efficient Minimal Solution for Multi-camera Motion , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[27]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Hongdong Li,et al.  UPnP: An Optimal O(n) Solution to the Absolute Pose Problem with Universal Applicability , 2014, ECCV.

[29]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[30]  David Nister,et al.  Recent developments on direct relative orientation , 2006 .

[31]  Helder Araújo,et al.  Planar pose estimation for general cameras using known 3D lines , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[33]  David Nistér,et al.  A Minimal Solution to the Generalised 3-Point Pose Problem , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[34]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[35]  Axel Pinz,et al.  Globally Optimal O(n) Solution to the PnP Problem for General Camera Models , 2008, BMVC.

[36]  Gim Hee Lee.  A Minimal Solution for Non-perspective Pose Estimation from Line Correspondences , 2016, ECCV.

[37]  Viktor Larsson,et al.  Efficient algorithms for robust estimation of relative translation , 2016, Image Vis. Comput..

[38]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[39]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[40]  Torsten Sattler,et al.  Hybrid Camera Pose Estimation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[41]  Dieter Schmalstieg,et al.  A Minimal Solution to the Generalized Pose-and-Scale Problem , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Hongdong Li,et al.  Efficient Computation of Relative Pose for Multi-camera Systems , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Visa Koivunen,et al.  Steepest Descent Algorithms for Optimization Under Unitary Matrix Constraint , 2008, IEEE Transactions on Signal Processing.

[44]  Hongdong Li,et al.  A linear approach to motion estimation using generalized camera models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Karl Johan Åström,et al.  Solutions to Minimal Generalized Relative Pose Problems , 2005 .

[46]  Marc Pollefeys,et al.  Motion Estimation for Self-Driving Cars with a Generalized Camera , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[48]  Peter F. Sturm,et al.  A Generic Concept for Camera Calibration , 2004, ECCV.