Recovering the Three-Dimensional Motion and Structure of Multiple Moving Objects from Binocular Image Flows

A new method is presented for recovering the three-dimensional motion and structure of multiple, independently moving, rigid objects through the analysis of binocular image flow fields. The input to the algorithm is the image location and image velocity of a sparse set of feature points in the stereo image pair. The algorithm analyzes one rigid object at a time by simultaneously segmenting the associated feature points from the input data set, establishing the stereo correspondence of these feature points and determining the three-dimensional motion of the object. The solution method is iterative and is based on the stereo-motion algorithm presented in J. H. Duncan, L. Li, and W. Wang, “Recovering Three-Dimensional Velocity and Established Stereo Correspondence from Binocular Image Flows” (Opt. Eng.34(7), July 1995, 2157?2167.) for the analysis of scenes with only one set of three-dimensional motion components. No restrictions on the three-dimensional structure of the scene are required by the theory. Experimental results with numerically generated and laboratory image sequences are given to verify the method.

[1]  Thomas S. Huang,et al.  SOLVING THREE DIMENSIONAL SMALL-ROTATION MOTION EQUATIONS. , 1983, CVPR 1983.

[2]  Thomas S. Huang,et al.  Matching 3-D Line Segments with Applications to Multiple-Object Motion Estimation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Shahriar Negahdaripour,et al.  Direct motion stereo: Recovery of observer motion and scene structure , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Rama Chellappa,et al.  Estimating the Kinematics and Structure of a Rigid Object from a Sequence of Monocular Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Michael J. Black,et al.  A framework for the robust estimation of optical flow , 1993, 1993 (4th) International Conference on Computer Vision.

[7]  Narendra Ahuja,et al.  Motion and Structure from Line Correspondences; Closed-Form Solution, Uniqueness, and Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  John G. Harris,et al.  Rigid body motion from range image sequences , 1991, CVGIP Image Underst..

[9]  Narendra Ahuja,et al.  Motion and Structure Factorization and Segmentation of Long Multiple Motion Image Sequences , 1992, ECCV.

[10]  Masanobu Yamamoto,et al.  A General Aperture Problem for Direct Estimation of 3-D Motion Parameters , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Olivier D. Faugeras,et al.  Analysis Of A Sequence Of Stereo Scenes Containing Multiple Moving Objects Using Rigidity Constraints , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[12]  Venkataraman Sundareswaran.  A Fast Method to Estimate Sensor Translation , 1992, ECCV.

[13]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  Brian G. Schunck,et al.  Image Flow Segmentation and Estimation by Constraint Line Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Dana H. Ballard,et al.  Rigid body motion from depth and optical flow , 1983, Comput. Vis. Graph. Image Process..

[16]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.