Performance bounds for estimating three-dimensional motion parameters from a sequence of noisy images

The problem considered here involves the use of a sequence of monocular images of a three-dimensional moving object to estimate both its structure and kinematics. The object is assumed to be rigid, and its motion is assumed to be smooth. A set of object match points is assumed to be available, consisting of fixed features on the object, the image plane coordinates of which have been extracted from successive images in the sequence. The measured data are the noisy image plane coordinates of this set of object match points, taken from each image in the sequence. In previous papers [ IEEE Trans. Pattern Anal. Mach. Intell.PAMI-8, 90 ( 1986); in Proceedings of the IEEE Workshop on Motion: Representation and Analysis ( Institute of Electrical and Electronics Engineers, New York, 1986), p. 95; in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ( Institute of Electrical and Electronics Engineers, New York, 1986), p. 176] we discussed model-based approaches for motion and structure estimation from a long sequence of images. We examine here the performance of such techniques by using a Cramer–Rao lower bounds on the estimation error variance. This method permits a priori prediction of estimation accuracy as a function of a number of factors, including the number of images in the sequence, the time at which each image is made, the number of feature points used, the image-plane noise level, and the type of motion that is involved. Theoretical performance predictions are compared with the statistics of Monte Carlo simulation, and it is shown that the actual estimation accuracy is close to the Cramer–Rao bounds in most cases. These results also show that noisy sequences with fewer than four images often do not contain enough information to permit accurate estimation of motion and structure parameters. This conclusion is consistent with the observed instability of so-called two-frame estimation methods in the presence of noise.

[1]  A. V. Balakrishnan,et al.  Kalman Filtering Theory , 1984 .

[2]  B. Friedland.  Analysis Strapdown Navigation Using Quaternions , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Thomas S. Huang,et al.  Some Experiments on Estimating the 3-D Motion Parameters of a Rigid Body from Two Consecutive Image Frames , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Narendra Ahuja,et al.  3-D Motion Estimation, Understanding, and Prediction from Noisy Image Sequences , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Donald B. Gennery,et al.  Tracking Known Three-Dimensional Objects , 1982, AAAI.

[7]  James R. Wertz,et al.  Spacecraft attitude determination and control , 1978 .

[8]  E.D. Dickmanns,et al.  An integrated approach to feature based dynamic vision , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Narendra Ahuja,et al.  Closed-form solution+maximum likelihood: a robust approach to motion and structure estimation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Gérard G. Medioni,et al.  Robust Estimation of Three-Dimensional Motion Parameters from a Sequence of Image Frames Using Regularization , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[12]  Xinhua Zhuang,et al.  A simple procedure to solve motion and structure from three orthographic views , 1988, IEEE J. Robotics Autom..

[13]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Samuel S. Blackman,et al.  Multiple-Target Tracking with Radar Applications , 1986 .

[15]  J. Roach,et al.  Determining the movement of objects from a sequence of images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jake K. Aggarwal,et al.  Determining object motion in a sequence of stereo images , 1987, IEEE Journal on Robotics and Automation.

[17]  Jon A. Webb,et al.  Quaternions in Computer Vision and Robotics , 1982 .