Motion Estimation for Nonoverlapping Multicamera Rigs: Linear Algebraic and L∞ Geometric Solutions

We investigate the problem of estimating the ego-motion of a multicamera rig from two positions of the rig. We describe and compare two new algorithms for finding the 6 degrees of freedom (3 for rotation and 3 for translation) of the motion. One algorithm gives a linear solution and the other is a geometric algorithm that minimizes the maximum measurement error-the optimal L∞ solution. They are described in the context of the General Camera Model (GCM), and we pay particular attention to multicamera systems in which the cameras have nonoverlapping or minimally overlapping field of view. Many nonlinear algorithms have been developed to solve the multicamera motion estimation problem. However, no linear solution or guaranteed optimal geometric solution has previously been proposed. We made two contributions: 1) a fast linear algebraic method using the GCM and 2) a guaranteed globally optimal algorithm based on the L∞ geometric error using the branch-and-bound technique. In deriving the linear method using the GCM, we give a detailed analysis of degeneracy of camera configurations. In finding the globally optimal solution, we apply a rotation space search technique recently proposed by Hartley and Kahl. Our experiments conducted on both synthetic and real data have shown excellent results.

[1]  Kristy Sim,et al.  Removing outliers using the L∞ Norm , 2006, CVPR 2006.

[2]  Hongdong Li,et al.  A linear approach to motion estimation using generalized camera models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Richard I. Hartley,et al.  Global Optimization through Rotation Space Search , 2009, International Journal of Computer Vision.

[4]  R. Hartley,et al.  The Cubic Rational Polynomial Camera Model , 2001 .

[5]  Richard I. Hartley,et al.  Removing Outliers Using The L\infty Norm , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Karl Johan Åström,et al.  Solutions to Minimal Generalized Relative Pose Problems , 2005 .

[7]  F. Kahl Multiple View Geometry and the -norm , 2005 .

[8]  Hongdong Li,et al.  A practical algorithm for L triangulation with outliers , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Jan-Michael Frahm,et al.  Robust 6DOF Motion Estimation for Non-Overlapping, Multi-Camera Systems , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[10]  Jan-Michael Frahm,et al.  Visual Odometry for Non-overlapping Views Using Second-Order Cone Programming , 2007, ACCV.

[11]  Daphna Weinshall,et al.  On the epipolar geometry of the Crossed-Slits projection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Richard Hartley Photogrammetric techniques for panoramic cameras , 1993, Defense, Security, and Sensing.

[14]  Richard I. Hartley,et al.  L-8Minimization in Geometric Reconstruction Problems , 2004, CVPR.

[15]  H. Opower Multiple view geometry in computer vision , 2002 .

[16]  Michel Dhome,et al.  Generic and Real-Time Structure from Motion , 2007, BMVC.

[17]  Maxime Lhuillier Effective and Generic Structure from Motion using Angular Error , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Peter F. Sturm,et al.  Multi-view geometry for general camera models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Richard I. Hartley,et al.  Global Optimization through Searching Rotation Space and Optimal Estimation of the Essential Matrix , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[20]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[21]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  Fredrik Kahl,et al.  Multiple view geometry and the L/sub /spl infin//-norm , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[24]  Richard I. Hartley,et al.  Projective Reconstruction and Invariants from Multiple Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Axel Pinz,et al.  Fast and Globally Convergent Structure and Motion Estimation for General Camera Models , 2006, BMVC.

[26]  Hongdong Li,et al.  Motion estimation for multi-camera systems using global optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Jorge Stolfi,et al.  Oriented projective geometry , 1987, SCG '87.

[28]  Martin Byröd,et al.  Improving Numerical Accuracy of Gröbner Basis Polynomial Equation Solvers , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[30]  Hongdong Li,et al.  Five-Point Motion Estimation Made Easy , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[31]  Reinhard Koch,et al.  Pose Estimation for Multi-camera Systems , 2004, DAGM-Symposium.