Shape Ambiguities in Structure From Motion

This paper examines the fundamental ambiguities and uncertainties inherent in recovering structure from motion. By examining the eigenvectors associated with null or small eigenvalues of the Hessian matrix, we can quantify the exact nature of these ambiguities and predict how they affect the accuracy of the reconstructed shape. Our results for orthographic cameras show that the bas-relief ambiguity is significant even with many images, unless a large amount of rotation is present. Similar results for perspective cameras suggest that three or more frames and a large amount of rotation are required for metrically accurate reconstruction.

[1]  Allen R. Hanson,et al.  Understanding noise: The critical role of motion error in scene reconstruction , 1993, 1993 (4th) International Conference on Computer Vision.

[2]  Rajiv Gupta,et al.  Computing matched-epipolar projections , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1995, Int. J. Robotics Res..

[5]  J. Oliensis,et al.  Incorporating motion error in multi-frame structure from motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[6]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[7]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[8]  Andrew Zisserman,et al.  Motion From Point Matches Using Affine Epipolar Geometry , 1994, ECCV.

[9]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[10]  Amnon Shashua,et al.  Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition , 1993, 1993 (4th) International Conference on Computer Vision.

[11]  C. J. Taylor,et al.  Structure and motion in two dimensions from multiple images: a least squares approach , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[12]  J. Aloimonos,et al.  Optimal motion estimation , 1989, [1989] Proceedings. Workshop on Visual Motion.

[13]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Pietro Perona,et al.  Recursive motion and structure estimation with complete error characterization , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[16]  Paul R. Cohen,et al.  Extended structure and motion analysis from monocular image sequences , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[17]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[20]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Stephen Wolfram,et al.  Mathematica: a system for doing mathematics by computer (2nd ed.) , 1991 .

[22]  Narendra Ahuja,et al.  Optimal Motion and Structure Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[24]  Edward L. Wilson,et al.  Numerical methods in finite element analysis , 1976 .

[25]  Hans-Hellmut Nagel,et al.  Analytical results on error sensitivity of motion estimation from two views , 1990, Image Vis. Comput..

[26]  Alex Pentland,et al.  Recursive estimation of structure and motion using relative orientation constraints , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Narendra Ahuja,et al.  A direct data approximation based motion estimation algorithm , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[28]  Richard Szeliski,et al.  Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares , 1994, J. Vis. Commun. Image Represent..

[29]  Ramesh C. Jain,et al.  A nonlinear optimization algorithm for the estimation of structure and motion parameters , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Nicholas Ayache,et al.  Artificial vision for mobile robots - stereo vision and multisensory perception , 1991 .

[31]  William H. Press,et al.  Book-Review - Numerical Recipes in Pascal - the Art of Scientific Computing , 1989 .

[32]  H. C. Longuet-Higgins.  Visual motion ambiguity , 1986, Vision Research.

[33]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[34]  David J. Kriegman,et al.  Structure and motion from line segments in multiple images , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[35]  Rama Chellappa,et al.  Statistical Analysis of Inherent Ambiguities in Recovering 3-D Motion from a Noisy Flow Field , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Harold W. Sorenson,et al.  Parameter estimation: Principles and problems , 1980 .