Minimal Solution for Uncalibrated Absolute Pose Problem with a Known Vanishing Point

We present a novel minimal solution for the uncalibrated absolute pose problem given one vanishing point. The proposed method complements state-of-the-art minimal absolute pose solvers and contributes to the handling camera localization problem in poor textured indoor environments. Those environments almost always exhibit edges aligned with the gravity direction which can be detected in images as a vanishing point. The vanishing point with suitable parametrization of the unknowns allows to cast the problem as a Quartic Eigenvalue Problem, a type of nonlinear problem for which very effective solvers exist. The proposed solution yields a reduction in one of the point correspondences which are required by PnP algorithms. In comparison to the general four point PnP algorithms, our method is numerically more stable and more robust to noise. This is demonstrated on a variety of synthetic and real data in scope of calibrating surveillance and mobile phone cameras.

[1]  Michael Elad,et al.  The Generalized Eigenvalue Problem for Nonsquare Pencils Using a Minimal Perturbation Approach , 2005, SIAM J. Matrix Anal. Appl..

[2]  Zuzana Kukelova,et al.  Closed-Form Solutions to Minimal Absolute Pose Problems with Known Vertical Direction , 2010, ACCV.

[3]  Edward Jones,et al.  Equidistant (ftheta) fish-eye perspective with application in distortion centre estimation , 2010, Image Vis. Comput..

[4]  Zuzana Kukelova,et al.  Polynomial Eigenvalue Solutions to the 5-pt and 6-pt Relative Pose Problems , 2008, BMVC.

[5]  Klas Josephson,et al.  Pose estimation with radial distortion and unknown focal length , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Stergios I. Roumeliotis,et al.  Two Efficient Solutions for Visual Odometry Using Directional Correspondence , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[8]  Zuzana Kukelova,et al.  3D reconstruction from image collections with a single known focal length , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Nicholas J. Higham,et al.  A framework for analyzing nonlinear eigenproblems and parametrized linear systems , 2011 .

[10]  Zuzana Kukelova,et al.  New Efficient Solution to the Absolute Pose Problem for Camera with Unknown Focal Length and Radial Distortion , 2010, ACCV.

[11]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[12]  Mongi A. Abidi,et al.  A New Efficient and Direct Solution for Pose Estimation Using Quadrangular Targets: Algorithm and Evaluation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Peter F. Sturm,et al.  Pose estimation using both points and lines for geo-localization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Christian Bräuer-Burchardt,et al.  Automatic correction of weak radial lens distortion in single views of urban scenes using vanishing points , 2002, Proceedings. International Conference on Image Processing.

[15]  Allan Hanbury,et al.  Robust camera self-calibration from monocular images of Manhattan worlds , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Branislav Micusík Relative pose problem for non-overlapping surveillance cameras with known gravity vector , 2011, CVPR 2011.

[17]  Marc Pollefeys,et al.  A Minimal Case Solution to the Calibrated Relative Pose Problem for the Case of Two Known Orientation Angles , 2010, ECCV.

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Amir Hashemi,et al.  A New Solution to the Relative Orientation Problem Using Only 3 Points and the Vertical Direction , 2009, Journal of Mathematical Imaging and Vision.

[20]  Tomás Pajdla,et al.  Structure from motion with wide circular field of view cameras , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[22]  Zuzana Kukelova,et al.  A general solution to the P4P problem for camera with unknown focal length , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Jorge Dias,et al.  Vision and Inertial Sensor Cooperation Using Gravity as a Vertical Reference , 2003, IEEE Trans. Pattern Anal. Mach. Intell..