Shape Ambiguities in Structure From Motion

This paper examines the fundamental ambiguities and uncertainties inherent in recovering structure from motion. By examining the eigenvectors associated with null or small eigenvalues of the Hessian matrix, we can quantify the exact nature of these ambiguities and predict how they will affect the accuracy of the reconstructed shape. Our results for orthographic cameras show that the bas-relief ambiguity is significant even with many images, unless a large amount of rotation is present. Similar results for perspective cameras suggest that three or more frames and a large amount of rotation are required for metrically accurate reconstruction.

[1]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[2]  Andrew Zisserman,et al.  Motion From Point Matches Using Affine Epipolar Geometry , 1994, ECCV.

[3]  William H. Press,et al.  Book-Review - Numerical Recipes in Pascal - the Art of Scientific Computing , 1989 .

[4]  Qian Chenf,et al.  A Hierarchical Method that Solves the Shape arid Motion from an Imager Sequence Problem , 1992 .

[5]  H. C. Longuet-Higgins.  Visual motion ambiguity , 1986, Vision Research.

[6]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[8]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[10]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Edward L. Wilson,et al.  Numerical methods in finite element analysis , 1976 .

[12]  Richard Szeliski,et al.  Shape Ambiguities in Structure From Motion , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1995, Int. J. Robotics Res..

[15]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[16]  Amnon Shashua,et al.  Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition , 1993, 1993 (4th) International Conference on Computer Vision.

[17]  Pietro Perona,et al.  Recursive motion and structure estimation with complete error characterization , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Richard Szeliski,et al.  Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares , 1994, J. Vis. Commun. Image Represent..

[20]  Ramesh C. Jain,et al.  A nonlinear optimization algorithm for the estimation of structure and motion parameters , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[23]  C. J. Taylor,et al.  Structure and motion in two dimensions from multiple images: a least squares approach , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[24]  Narendra Ahuja,et al.  A direct data approximation based motion estimation algorithm , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[25]  Nicholas Ayache,et al.  Artificial vision for mobile robots - stereo vision and multisensory perception , 1991 .

[26]  J. Aloimonos,et al.  Optimal motion estimation , 1989, [1989] Proceedings. Workshop on Visual Motion.

[27]  Narendra Ahuja,et al.  Optimal Motion and Structure Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Alex Pentland,et al.  Recursive estimation of structure and motion using relative orientation constraints , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Rama Chellappa,et al.  Statistical Analysis of Inherent Ambiguities in Recovering 3-D Motion from a Noisy Flow Field , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[31]  P. Sollero.  Book reviewMathematica: A system for doing mathematics by computer, 2nd edition: Stephen Wolfran, Addison-Wesley, 1991. pp. 992, hardback. £40.45. ISBN: 0 201 51502 4 , 1992 .

[32]  Hans-Hellmut Nagel,et al.  Analytical results on error sensitivity of motion estimation from two views , 1990, Image Vis. Comput..

[33]  Paul R. Cohen,et al.  Extended structure and motion analysis from monocular image sequences , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[34]  Allen R. Hanson,et al.  Understanding noise: The critical role of motion error in scene reconstruction , 1993, 1993 (4th) International Conference on Computer Vision.

[35]  Rajiv Gupta,et al.  Computing matched-epipolar projections , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[36]  R. Fateman,et al.  A System for Doing Mathematics by Computer. , 1992 .

[37]  J. Oliensis,et al.  Incorporating motion error in multi-frame structure from motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[38]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[39]  G. Saridis.  Parameter estimation: Principles and problems , 1983, Proceedings of the IEEE.