Understanding noise sensitivity in structure from motion

Solutions to the structure from motion problem have been shown to be very sensitive to measurement noise and the respective motion and geometry configuration. Statistical error analysis has become an invaluable tool in analyzing the sensitivity phenomenon. This paper presents a unifying approach to the problems of statistical bias, correlated noise, choice of error metrics, geometric instabilities and information fusion exploring several assumptions commonly used in motion estimation and reviews several promising techniques for motion estimation. The techniques are based on a small number of principles of statistics and perturbation theory. The analyticity of the approach enables the design of alternatives overcoming the observed instabilities.

[1]  Ernst Speer.  Das Problem der Sucht , 1937 .

[2]  Walter Wunderlich.  Zur Eindeutigkeitsfrage der Hauptaufgabe der Photogrammetrie , 1941 .

[3]  J. Krames.  Zur Ermittlung eines Objektes aus zwei Perspektiven. (Ein Beitrag zur Theorie der “gefährlichen Örter”.) , 1941 .

[4]  C. A. HART,et al.  Manual of Photogrammetry , 1947, Nature.

[5]  W. Hofmann.  Das Problem der "Gefahrlichen Flachen" in Theorie und Praxis , 1953 .

[6]  Cleve Moler,et al.  Mathematical Handbook for Scientists and Engineers , 1961 .

[7]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[10]  Berthold K. P. Horn,et al.  Passive navigation , 1982, Computer Vision Graphics and Image Processing.

[11]  Daryl T. Lawton,et al.  Processing translational motion sequences , 1983, Comput. Vis. Graph. Image Process..

[12]  G. Saridis.  Parameter estimation: Principles and problems , 1983, Proceedings of the IEEE.

[13]  H C Longuet-Higgins,et al.  The visual ambiguity of a moving plane , 1984, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Allen M. Waxman,et al.  Contour Evolution, Neighborhood Deformation, and Global Image Flow: Planar Surfaces in Motion , 1985 .

[16]  Shahriar Negahdaripour,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence , 2004 .

[17]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[18]  Ramesh C. Jain,et al.  Polynomial Methods For Structure From Motion , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[19]  Thomas S. Huang,et al.  Estimation of rigid body motion using straight line correspondences , 1986, Comput. Vis. Graph. Image Process..

[20]  Minas E. Spetsakis,et al.  Optimal Computing Of Structure From Motion Using Point Correspondences In Two Frames , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[21]  J. Aloimonos,et al.  Optimal motion estimation , 1989, [1989] Proceedings. Workshop on Visual Motion.

[22]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Hans-Hellmut Nagel,et al.  Analytical results on error sensitivity of motion estimation from two views , 1990, Image Vis. Comput..

[24]  Yiannis Aloimonos,et al.  Purposive and qualitative active vision , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[25]  Janet Aisbett,et al.  An Iterated Estimation of the Motion Parameters of a Rigid Body from Noisy Displacement Vectors , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Yiannis Aloimonos,et al.  Correspondenceless Stereo and Motion: Planar Surfaces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Shahriar Negahdaripour,et al.  Multiple Interpretations of the Shape and Motion of Objects from Two Perspective Images , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Yiannis Aloimonos,et al.  A Robust, Correspondenceless, Translation- Determining Algorithm , 1990, Int. J. Robotics Res..

[29]  Berthold K. P. Horn.  Relative orientation revisited , 1991 .

[30]  Chia-Hoang Lee,et al.  Time-varying images: The effect of finite resolution on uniqueness , 1991, CVGIP Image Underst..

[31]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[32]  H. Ando.  Dynamic reconstruction of 3D structure and 3D motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[33]  A. Jepson,et al.  A fast subspace algorithm for recovering rigid motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[34]  Minas E. Spetsakis.  A linear algorithm for point and line-based structure from motion , 1992, CVGIP Image Underst..

[35]  Kiriakos N. Kutulakos,et al.  Recovering shape by purposive viewpoint adjustment , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Minas E. Spetsakis,et al.  Optimal Visual Motion Estimation: A Note , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[38]  Rama Chellappa,et al.  Statistical Analysis of Inherent Ambiguities in Recovering 3-D Motion from a Noisy Flow Field , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Kenichi Kanatani,et al.  Unbiased Estimation and Statistical Analysis of 3-D Rigid Motion from Two Views , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Narendra Ahuja,et al.  Optimal Motion and Structure Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Kenichi Kanatani,et al.  Geometric computation for machine vision , 1993 .

[42]  Hans-Hellmut Nagel,et al.  The coupling of rotation and translation in motion estimation of planar surfaces , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Minas E. Spetsakis,et al.  Models of statistical visual motion estimation , 1994 .

[44]  Kostas Daniilidis,et al.  Attentive Visual Motion Processing: Computations in the Log-Polar Plane , 1994, Theoretical Foundations of Computer Vision.

[45]  Minas E. Spetsakis.  Optical Flow Estimation Using Discontinuity Conforming Filters , 1997, Comput. Vis. Image Underst..