Dense Structure from a Dense Optical Flow Sequence

This paper presents a structure-from-motion system which deliversdensestructure information from a sequence of dense optical flows. Most traditional feature-based approaches cannot be extended to compute dense structure due to impractical computational complexity. We demonstrate that by decomposing uncertainty information into independent and correlated parts and employing an eigen-based uncertainty representation, we can decrease these complexities fromO(N2) toO(N) for every frame, whereNis the number of pixels in the images. We also show that our new representation of structural information makes it easy to merge over a long image sequence even when no specific feature is tracked over multiple frames.

[1]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[3]  E. J. Baranoski Triangular factorization of inverse data covariance matrices , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[4]  Steven A. Shafer,et al.  Hypergeometric Filters for Optical Flow and Affine Matching , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  J. Oliensis,et al.  Incorporating motion error in multi-frame structure from motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[6]  Hans-Hellmut Nagel,et al.  The coupling of rotation and translation in motion estimation of planar surfaces , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Joachim Heel,et al.  Dynamical Systems and Motion Vision , 1988 .

[8]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Allen Hanson,et al.  Refining 3D reconstruction: a theoretical and experimental study of the effect of cross-correlations , 1994 .

[10]  Joachim Heel,et al.  Temporally integrated surface reconstruction , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[11]  William W. Hager,et al.  Updating the Inverse of a Matrix , 1989, SIAM Rev..

[12]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Steven A. Shafer,et al.  Dense structure from a dense optical flow sequence , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[14]  Narendra Ahuja,et al.  Closed-form solution+maximum likelihood: a robust approach to motion and structure estimation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Richard Szeliski,et al.  Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares , 1994, J. Vis. Commun. Image Represent..

[16]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[17]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[18]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[19]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Gene H. Golub,et al.  Scientific computing: an introduction with parallel computing , 1993 .

[21]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Berthold K. P. Horn,et al.  Passive navigation , 1982, Comput. Vis. Graph. Image Process..

[23]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..