Behaviour of SFM algorithms with erroneous calibration

This paper presents an algorithm-independent geometrical analysis of the behavior of differential Structure from Motion (SFM) algorithms when there are errors in intrinsic parameters of the camera. We demonstrate both analytically and in simulation how uncertainty in the calibration parameters gets propagated to motion estimates in a differential setting. In particular, we studied how erroneous focal length and principal point estimates affect the behavior of the bas-relief ambiguity and introduce additional biasing to the translation estimate in a non-simple manner not revealed by previous analyses. Our formulation allows us to characterize the influence of various factors such as different scene-motion configurations and field of views in an analytically tractable manner. Guidelines are given as to whether one should err on the low or the high side in the estimation of the focal length depending on various operating conditions such as the feature density and the noise level. Simulations with synthetic data and real images were conducted to support our findings.

[1]  Loong Fah Cheong,et al.  Characterizing Depth Distortion under Different Generic Motions , 2004, International Journal of Computer Vision.

[2]  Andrew Zisserman,et al.  Resolving ambiguities in auto–calibration , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[3]  Tomás Svoboda,et al.  A Badly Calibrated Camera in Ego-Motion Estimation Propagation of Uncertainty , 1997, CAIP.

[4]  S. Bougnoux,et al.  From projective to Euclidean space under any practical situation, a criticism of self-calibration , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  C. Guerra Artal,et al.  Stability Study of Camera Calibration Methods , 2005 .

[6]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[7]  John Oliensis,et al.  A Critique of Structure-from-Motion Algorithms , 2000, Comput. Vis. Image Underst..

[8]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[9]  B. D. Lucas.  Generalized image matching by the method of differences , 1985 .

[10]  Olivier Faugeras,et al.  Motion of an uncalibrated stereo rig: self-calibration and metric reconstruction , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[11]  M. Brooks,et al.  Recovering unknown focal lengths in self-calibration: an essentially linear algorithm and degenerate configurations , 1996 .

[12]  Jana Kosecka,et al.  Motion bias and structure distortion induced by intrinsic calibration errors , 2008, Image Vis. Comput..

[13]  Kenichi Kanatani,et al.  Stabilizing the Focal Length Computation for 3-D Reconstruction from Two Uncalibrated Views , 2006, International Journal of Computer Vision.

[14]  John Oliensis,et al.  A Multi-Frame Structure-from-Motion Algorithm under Perspective Projection , 1999, International Journal of Computer Vision.

[15]  Bill Triggs,et al.  Critical motions in euclidean structure from motion , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  M. Subbarad,et al.  Interpretation of Visual Motion: A Computational Study , 1988 .

[17]  Peter F. Sturm,et al.  Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length , 1999, Image Vis. Comput..

[18]  Peter C. Y. Chen,et al.  Focal length calibration from two views: method and analysis of singular cases , 2005, Comput. Vis. Image Underst..

[19]  Xu Xiang,et al.  What do we perceive from motion pictures? A computational account. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Wojciech Chojnacki,et al.  Determining the egomotion of an uncalibrated camera from instantaneous optical flow , 1997 .

[21]  Lee Dn,et al.  The optic flow field: the foundation of vision. , 1980 .

[22]  Yiannis Aloimonos,et al.  Obstacle Avoidance Using Flow Field Divergence , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  S. Shankar Sastry,et al.  Optimization Criteria and Geometric Algorithms for Motion and Structure Estimation , 2001, International Journal of Computer Vision.

[24]  R. Hartley,et al.  Reconstruction from two views using approximate calibration , 2002 .

[25]  Stefano Soatto,et al.  Optimal Structure from Motion: Local Ambiguities and Global Estimates , 2004, International Journal of Computer Vision.

[26]  Loong Fah Cheong,et al.  Understanding the Behavior of SFM Algorithms: A Geometric Approach , 2004, International Journal of Computer Vision.

[27]  Loong-Fah Cheong,et al.  Error Characteristics of SFM with Erroneous Focal Length , 2006, ACCV.