Tracking of nonrigid motion and 3D structure from 2D image sequences without correspondences

In this paper we present a novel method for tracking 3D nonrigid motion and 3D structure from a sequence of monocular, perspective images, where range data of the first frame is available. No a priori knowledge of point correspondences is assumed. A genneral approach and formulas for polynomial (second order) displacement functions are presented. An analysis of the number of equations versus the number of unknowns is given. Results for synthetic and real image sequences are presented.

[1]  B. A. Parvin,et al.  Tracking of Tubular Molecules for Scientific Applications , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Å. Björck.  Least squares methods , 1990 .

[3]  J. Oliensis,et al.  Multiframe structure from motion in perspective , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[4]  Dmitry B. Goldgof,et al.  Determination of motion parameters and estimation of point correspondences in small nonrigid deformations , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Alan M. Wood,et al.  Motion analysis , 1986 .

[6]  Jake K. Aggarwal,et al.  Nonrigid Motion Analysis: Articulated and Elastic Motion , 1998, Comput. Vis. Image Underst..

[7]  Liang Zhao,et al.  Qualitative and quantitative car tracking from a range image sequence , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Thomas S. Huang,et al.  Connected vibrations: a modal analysis approach for non-rigid motion tracking , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[9]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Dmitry B. Goldgof,et al.  Structure and semi-fluid motion analysis of stereoscopic satellite images for cloud tracking , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Dmitry B. Goldgof,et al.  Nonrigid motion analysis , 1994 .