A Minimal Case Solution to the Calibrated Relative Pose Problem for the Case of Two Known Orientation Angles

It this paper we present a novel minimal case solution to the calibrated relative pose problemusing 3 point correspondences for the case of two known orientation angles. This case is relevant when a camera is coupled with an inertial measurement unit (IMU) and it recently gained importance with the omnipresence of Smartphones (iPhone, Nokia N900) that are equippedwith accelerometers tomeasure the gravity normal. Similar to the 5-point (6-point), 7-point, and 8-point algorithm for computing the essential matrix in the unconstrained case, we derive a 3-point, 4-point and, 5-point algorithm for the special case of two known orientation angles. We investigate degenerate conditions and show that the new 3-point algorithm can cope with planes and even collinear points. We will show a detailed analysis and comparison on synthetic data and present results on cell phone images. As an additional application we demonstrate the algorithm on relative pose estimation for a micro aerial vehicle's (MAV) camera-IMU system.

[1]  Amir Hashemi,et al.  A New Solution to the Relative Orientation Problem Using Only 3 Points and the Vertical Direction , 2009, Journal of Mathematical Imaging and Vision.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[4]  Frederik Schaffalitzky,et al.  Four Points in Two or Three Calibrated Views: Theory and Practice , 2006, International Journal of Computer Vision.

[5]  Supun Samarasekera,et al.  VideoTrek: A vision system for a tag-along robot , 2009, CVPR.

[6]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[8]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Roberto Cipolla,et al.  An Image-Based System for Urban Navigation , 2004, BMVC.

[11]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Supun Samarasekera,et al.  Visual Odometry System Using Multiple Stereo Cameras and Inertial Measurement Unit , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Richard I. Hartley,et al.  Projective Reconstruction and Invariants from Multiple Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hanumant Singh,et al.  Relative Pose Estimation for Instrumented, Calibrated Imaging Platforms , 2003, DICTA.

[15]  Andrew C. Gallagher.  Using vanishing points to correct camera rotation in images , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[16]  Wolfram Burgard,et al.  Learning maps in 3D using attitude and noisy vision sensors , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Jiri Matas,et al.  Randomized RANSAC with sequential probability ratio test , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.