Three-Dimensional Motion Analysis Using Shape Change Information

This paper describes a method that extracts three-dimensional (3D) motion information by analyzing 2D shape changes of object faces in an image sequence. An object image is segmented into regions, each region corresponding to a face of the object. With orthographic projections, 3D rotation angles can be computed from a set of linear shape change parameters. For perspective projections, under certain conditions the effect on shape changes of planar faces can be taken into consideration by including quadratic parameters. Iterative algorithms for estimation of linear and quadratic shape change parameters are derived and implemented, using an operator formulation. 3D translation and rotation parameters are calculated from the shape change parameters. Experimental results on segmentation and parameter estimation are presented.

[1]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[2]  Jake K. Aggarwal,et al.  A computational analysis of time-varying images. , 1986 .

[3]  Kenichi Kanatani,et al.  Detecting the motion of a planar surface by line and surface integrals , 1984, Comput. Vis. Graph. Image Process..

[4]  Tzay Y. Young,et al.  Determining Three-Dimensional Object Shape And Orientation From A Single Perspective View , 1986 .

[5]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Thomas S. Huang,et al.  Estimating three-dimensional motion parameters of a rigid planar patch , 1981 .

[7]  R. Woodham,et al.  Determining the movement of objects from a sequence of images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  John M. Prager,et al.  Extracting and Labeling Boundary Segments in Natural Scenes , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Ciro Cafforio,et al.  Methods for measuring small displacements of television images , 1976, IEEE Trans. Inf. Theory.

[10]  Thomas S. Huang,et al.  Some Experiments on Estimating the 3-D Motion Parameters of a Rigid Body from Two Consecutive Image Frames , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Valdis Berzins,et al.  Dynamic Occlusion Analysis in Optical Flow Fields , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Theodosios Pavlidis,et al.  Picture Segmentation by a Tree Traversal Algorithm , 1976, JACM.

[14]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[15]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[16]  Tzay Y. Young,et al.  Analysis of three-dimensional rotation and linear shape changes , 1984, Pattern Recognit. Lett..

[17]  Robert J. Schalkoff,et al.  A Model and Tracking Algorithm for a Class of Video Targets , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.