Analysis of long image sequence for structure and motion estimation

A motion parameter estimation technique is presented for image sequence analysis of several frames. A dynamic scene model is developed in which image sequences are processed as a temporally correlated complex. Using this model, measurement of the position of the object in a set of consecutive frames permits the estimation of motion as a function of time. The measurement consists of a sequence of image coordinates of three or more feature correspondence points in each frame. The motion sequence is represented as a discrete-time time-varying system. An iterative mathematical parameter estimation technique is used to minimize the projection error. The fundamental concept of this analysis is based on optimal control theory. Motion parameter estimates are extracted from the sequence of image correspondence by modeling the motion dynamics using motion transformation and viewing projection. Object positions are estimated by iteratively refining the parameters by small perturbations. This methodology is suitable for processing a long sequence in situations where a high rate of imagery is available. Results are presented for generalized rigid-body motion of synthesized images and real images. >

[1]  J.K. Aggarwal,et al.  Correspondence processes in dynamic scene analysis , 1981, Proceedings of the IEEE.

[2]  J. Aggarwal,et al.  LINE-BASED COMPUTATION OF STRUCTURE AND MOTION USING ANGULAR INVARIANCE. , 1986 .

[3]  R. Woodham,et al.  Determining the movement of objects from a sequence of images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[5]  Thomas S. Huang,et al.  Estimating three-dimensional motion parameters of a rigid planar patch , 1981 .

[6]  Amar Mitiche,et al.  On Kineopsis and Computation of Structure and Motion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  S. Ullman.  The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Azriel Rosenfeld,et al.  Structure and Motion of a Rigid Object Having Unknown Constant Motion , 1985 .

[9]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  H.-H. Nagel,et al.  Representation of Moving Rigid Objects Based on Visual Observations , 1981, Computer.

[11]  B.L. Yen,et al.  Determining 3-D motion and structure of a rigid body using the spherical projection , 1983, Comput. Vis. Graph. Image Process..

[12]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[14]  H. H. Nagel,et al.  Image Sequence Analysis: What Can We Learn from Applications? , 1981 .

[15]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[16]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[17]  Lee Dn,et al.  The optic flow field: the foundation of vision. , 1980 .

[18]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  B. G. Schunck.  The image flow constraint equation , 1986 .

[20]  Gérard G. Medioni,et al.  Robust Estimation of Three-Dimensional Motion Parameters from a Sequence of Image Frames Using Regularization , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Thomas S. Huang,et al.  Image sequence analysis , 1981 .

[22]  Jake K. Aggarwal,et al.  Segmentation through the detection of changes due to motion , 1979 .

[23]  Jake K. Aggarwal,et al.  MOTION AND TIME - VARYING IMAGERY - AN OVERVIEW. , 1986 .

[24]  Arun K. Sood,et al.  Engine Fault Analysis: Part II---Parameter Estimation Approach , 1985, IEEE Transactions on Industrial Electronics.

[25]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[26]  Dana H. Ballard,et al.  Rigid body motion from depth and optical flow , 1983, Comput. Vis. Graph. Image Process..

[27]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.