Recovery of Nonrigid Motion and Structure

The authors introduce a physically correct model of elastic nonrigid motion. This model is based on the finite element method, but decouples the degrees of freedom by breaking down object motion into rigid and nonrigid vibration or deformation modes. The result is an accurate representation for both rigid and nonrigid motion that has greatly reduced dimensionality, capturing the intuition that nonrigid motion is normally coherent and not chaotic. Because of the small number of parameters involved, this representation is used to obtain accurate overstrained estimates of both rigid and nonrigid global motion. It is also shown that these estimates can be integrated over time by use of an extended Kalman filter, resulting in stable and accurate estimates of both three-dimensional shape and three-dimensional velocity. The formulation is then extended to include constrained nonrigid motion. Examples of tracking single nonrigid objects and multiple constrained objects are presented. >

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[3]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[4]  L. Segerlind.  Applied Finite Element Analysis , 1976 .

[5]  H. Saunders,et al.  Finite element procedures in engineering analysis , 1982 .

[6]  S Ullman,et al.  Maximizing Rigidity: The Incremental Recovery of 3-D Structure from Rigid and Nonrigid Motion , 1984, Perception.

[7]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Peter W. Glynn,et al.  Optimization of stochastic systems , 1986, WSC '86.

[9]  Olivier D. Faugeras,et al.  Building visual maps by combining noisy stereo measurements , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[10]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[11]  Muralidhara Subbarao.  Interpretation of Image Flow: A Spatio-Temporal Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[13]  Irfan Essa,et al.  Contact detection, collision forces and friction for physically based virtual world modeling , 1990 .

[14]  Alex Pentland,et al.  The ThingWorld modeling system: virtual sculpting by modal forces , 1990, I3D '90.

[15]  Olivier Faugeras,et al.  Maintaining representations of the environment of a mobile robot , 1988, IEEE Trans. Robotics Autom..

[16]  Alexander Toet,et al.  Displacement Estimates Through Adaptive Affinities , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Alex Pentland,et al.  Closed-Form Solutions for Physically Based Shape Modeling and Recognition , 1991, IEEE Trans. Pattern Anal. Mach. Intell..