Camera pose estimation based on distorted lines

PNP (Perspective-N-Point) and PNL (Perspective-N-Line) are the most commonly used methods for camera pose estimation. However, most methods are based on the hypothesis of the pinhole camera model, which ignore camera distortion’s effects. Considering the influences of camera distortion, we proposed to solve the camera pose directly by using distorted lines. In this paper, we first undistort the lines according to distortion model, then use LSD algorithm extract 2D undistorted lines from the image. Having matched 2D/3D lines, the PNL (Perspective-N-Line) was used finally to solve the camera pose. Through experiments on synthetic images and real images, it turns out that our method is effective and feasible for pose estimation.

[1]  Stergios I. Roumeliotis,et al.  Globally optimal pose estimation from line correspondences , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Christian Bräuer-Burchardt.  A Simple New Method for Precise Lens Distortion Correction of Low Cost Camera Systems , 2004, DAGM-Symposium.

[3]  Friedrich Fraundorfer,et al.  Minimal solutions for the rotational alignment of IMU-camera systems using homography constraints , 2018, Comput. Vis. Image Underst..

[4]  Joel A. Hesch,et al.  A Direct Least-Squares (DLS) method for PnP , 2011, 2011 International Conference on Computer Vision.

[5]  Matthew N. Dailey,et al.  Automatic Radial Distortion Estimation from a Single Image , 2012, Journal of Mathematical Imaging and Vision.

[6]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[7]  Feng Zhu,et al.  A New Method for Pose Estimation from Line Correspondences , 2009 .

[8]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[9]  Pascal Vasseur,et al.  Visual Odometry Using a Homography Formulation with Decoupled Rotation and Translation Estimation Using Minimal Solutions , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Homer H. Chen.  Pose Determination from Line-to-Plane Correspondences: Existence Condition and Closed-Form Solutions , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Kostas Daniilidis,et al.  Fundamental matrix for cameras with radial distortion , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Allen R. Hanson,et al.  Robust methods for estimating pose and a sensitivity analysis , 1994 .

[14]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Reinhard Koch,et al.  Pose Estimation from Line Correspondences: A Complete Analysis and a Series of Solutions , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Vincenzo Caglioti.  The planar three-line junction perspective problem with application to the recognition of polygonal patterns , 1993, Pattern Recognit..

[17]  Qifeng Yu,et al.  Planar self-calibration for stereo cameras with radial distortion. , 2017, Applied optics.

[18]  Eric Hayman,et al.  Correcting Radial Distortion by Circle Fitting , 2005, BMVC.

[19]  Christian Bräuer-Burchardt,et al.  A new algorithm to correct fish-eye- and strong wide-angle-lens-distortion from single images , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  J. Rafael Sendra,et al.  An Algebraic Approach to Lens Distortion by Line Rectification , 2009, Journal of Mathematical Imaging and Vision.

[21]  Olivier D. Faugeras,et al.  Determination of camera location from 2D to 3D line and point correspondences , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Aiqi Wang,et al.  A Simple Method of Radial Distortion Correction with Centre of Distortion Estimation , 2009, Journal of Mathematical Imaging and Vision.