Experiments and uniqueness results on object structure and kinematics from a sequence of monocular images

The authors consider the problem of using a sequence of monocular images (central projections) of a three-dimensional (3-D) moving object to estimate both its structure and kinematics. The object is assumed to be rigid, and its motion is assumed to be 'smooth'. A set of object match points is assumed to be available, consisting of fixed features on the object, the image-plane coordinates of which have been extracted from successive images in the sequence. The measured data are the noisy image plane coordinates of this set of object match points, taken from each image in the sequence. Results of an experiment with real imagery are presented, involving estimation of 28 unknown translational, rotational, and structural parameters, based on 12 images with seven feature points. Uniqueness results are summarized for the case of purely translational motion. A test based on a singular-value decomposition is described that determines whether or not noise-free data from an image sequence uniquely determines the elements of any given parameter vector, and sample uniqueness results are given. It is concluded that the experimental and the uniqueness results presented demonstrate the feasibility of the proposed approach.<<ETX>>

[1]  Donald B. Gennery,et al.  Tracking Known Three-Dimensional Objects , 1982, AAAI.

[2]  Thomas S. Huang,et al.  Estimating three-dimensional motion parameters of a rigid planar patch, II: Singular value decomposition , 1982 .

[3]  B. Friedland.  Analysis Strapdown Navigation Using Quaternions , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Gérard G. Medioni,et al.  Robust Estimation of Three-Dimensional Motion Parameters from a Sequence of Image Frames Using Regularization , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  E.D. Dickmanns,et al.  An integrated approach to feature based dynamic vision , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Jake K. Aggarwal,et al.  Determining object motion in a sequence of stereo images , 1987, IEEE Journal on Robotics and Automation.

[7]  R. Woodham,et al.  Determining the movement of objects from a sequence of images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Xinhua Zhuang,et al.  A simple procedure to solve motion and structure from three orthographic views , 1988, IEEE J. Robotics Autom..

[9]  David V. Stallard,et al.  Angle-only tracking filter in modified spherical coordinates , 1991 .

[10]  Narendra Ahuja,et al.  Closed-form solution+maximum likelihood: a robust approach to motion and structure estimation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Narendra Ahuja,et al.  3-D Motion Estimation, Understanding, and Prediction from Noisy Image Sequences , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Thomas S. Huang,et al.  Some Experiments on Estimating the 3-D Motion Parameters of a Rigid Body from Two Consecutive Image Frames , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.