Nonrigid Motion Analysis: Articulated and Elastic Motion

Motion of physical objects in the world is, in general, nonrigid. In robotics and computer vision, the motion of nonrigid objects is of growing interest to researchers from a wide spectrum of disciplines. The nonrigid objects being studied may be generally categorized into three groups according to the degree of deformation of body parts: articulated, elastic, and fluid. In articulated motion, individual rigid parts of an object move independently of one another and the motion of the whole object is nonrigid in nature. Elastic motion is nonrigid motion that conforms to a certain degree of continuity or smoothness. Fluid motion violates even the continuity assumption and may involve topological variations and turbulent deformations. This paper presents an overview of existing work on articulated and elastic motion, motivated by problems relating to the motion of the human body and of an animal heart, respectively. We study various approaches for recovering the 3D structure and motion of objects through a sequence of images in a bottom-up fashion, a strategy widely employed by various investigators. These approaches are classified as (1) motion recovery without shape models, and (2) model-based analysis. In the discussion of each algorithm, we also include a description of the complexity of feature and motion constraints, which are highly related to each other.

[1]  Masakazu Imai,et al.  Robust algorithm for motion analysis based on Active Tubes , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[2]  Katsushi Ikeuchi,et al.  Shape representation and image segmentation using deformable surfaces , 1992, Image Vis. Comput..

[3]  Ramakant Nevatia,et al.  Description and tracking of moving articulated objects , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[4]  Jinah Park,et al.  Volumetric deformable models with parameter functions: A new approach to the 3D motion analysis of the LV from MRI-SPAMM , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Daniel P. Huttenlocher,et al.  Tracking non-rigid objects in complex scenes , 1993, 1993 (4th) International Conference on Computer Vision.

[6]  M. B. Clowes,et al.  On Seeing Things , 1971, Artif. Intell..

[7]  Alex Pentland,et al.  Recovery of non-rigid motion and structure , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Joseph N. Wilson,et al.  Contour estimation using global shape constraints and local forces , 1991, Optics & Photonics.

[9]  Yacov Hel-Or,et al.  Constraint-fusion for interpretation of articulated objects , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ramesh C. Jain,et al.  On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  John S. Duncan,et al.  Differential geometry for characterizing 3D shape change , 1992, Optics & Photonics.

[12]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[13]  Baba C. Vemuri,et al.  Geometric Methods in Computer Vision , 1991 .

[14]  John S. Duncan,et al.  Pointwise tracking of left-ventricular motion in 3D , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[15]  Thomas S. Huang,et al.  Modeling, analysis, and visualization of nonrigid object motion , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[16]  Pietro Perona,et al.  Monocular tracking of the human arm in 3D , 1995, Proceedings of IEEE International Conference on Computer Vision.

[17]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[18]  Fred L. Bookstein,et al.  Edge information at landmarks in medical images , 1992, Other Conferences.

[19]  Nicholas Ayache,et al.  Physically based analysis of deformations in 3D images , 1993, Optics & Photonics.

[20]  A. B. Drought,et al.  WALKING PATTERNS OF NORMAL MEN. , 1964, The Journal of bone and joint surgery. American volume.

[21]  Ioannis A. Kakadiaris,et al.  Active part-decomposition, shape and motion estimation of articulated objects: a physics-based approach , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Demetri Terzopoulos,et al.  Recursive estimation of shape and nonrigid motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[23]  David C. Hogg.  Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[24]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[25]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[27]  Dmitry B. Goldgof,et al.  Point correspondence recovery in non-rigid motion , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Ramakant Nevatia,et al.  Description and tracking of moving articulated objects , 1994, Systems and Computers in Japan.

[29]  D. Kraitchman,et al.  Deformable models for tagged MR images: reconstruction of two- and three-dimensional heart wall motion , 1994, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[30]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[31]  Jake K. Aggarwal,et al.  Reconstruction of dynamic 3-D structures of biological objects using stereo microscopy , 1994, Proceedings of 1st International Conference on Image Processing.

[32]  Yoshikuni Okawa,et al.  Recognition Of Human Body Motions By Robots , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Han Wang,et al.  A Matching and Tracking Strategy for Independently Moving Objects , 1992, BMVC.

[34]  Charles R. Dyer,et al.  Cyclic motion detection using spatiotemporal surfaces and curves , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[35]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Aaron F. Bobick,et al.  A state-based technique for the summarization and recognition of gesture , 1995, Proceedings of IEEE International Conference on Computer Vision.

[37]  Max A. Viergever,et al.  A discrete dynamic contour model , 1995, IEEE Trans. Medical Imaging.

[38]  James S. Duncan,et al.  A model-based integrated approach to track myocardial deformation using displacement and velocity constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[39]  Ruzena Bajcsy,et al.  Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  James S. Duncan,et al.  Non-Rigid Motion Models for Tracking the Left Ventricular Wall , 1991, IPMI.

[41]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[42]  Yee-Hong Yang,et al.  An Empirical Approach to Human Body Motion Analysis , 1994 .

[43]  A. Pentland,et al.  Non-rigid motion and structure from contour , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[44]  Ioannis A. Kakadiaris,et al.  3D human body model acquisition from multiple views , 1995, Proceedings of IEEE International Conference on Computer Vision.

[45]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[46]  Fred L. Bookstein,et al.  Thin-Plate Splines and the Atlas Problem for Biomedical Images , 1991, IPMI.

[47]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Alex Pentland,et al.  Modal Matching for Correspondence and Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Dmitry B. Goldgof,et al.  Motion analysis of nonrigid surfaces , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[50]  Thomas S. Huang,et al.  Maximal matching of 3-D points for multiple-object motion estimation , 1988, Pattern Recognit..

[51]  Dmitry B. Goldgof,et al.  Nonrigid motion analysis , 1994 .

[52]  Nicholas Ayache,et al.  Tracking Points on Deformable Objects Using Curvature Information , 1992, ECCV.

[53]  Laurent D. Cohen,et al.  Introducing new deformable surfaces to segment 3D images , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[54]  Laurent D. Cohen,et al.  Deformable models for 3-D medical images using finite elements and balloons , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[55]  Dmitry B. Goldgof,et al.  Automatic tracking of SPAMM grid and the estimation of deformation parameters from cardiac MR images , 1994, IEEE Trans. Medical Imaging.

[56]  Dimitris N. Metaxas,et al.  Constrained deformable superquadrics and nonrigid motion tracking , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[57]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[58]  Jean Ponce,et al.  Using Geometric Distance Fits for 3-D Object Modeling and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  R. F. Rashid,et al.  Towards a system for the interpretation of moving light displays , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Peter W. Hallinan.  Recognizing human eyes , 1991, Optics & Photonics.

[61]  Robin N. Strickland,et al.  Computing correspondences in a sequence of non-rigid shapes , 1992, Pattern Recognit..

[62]  Surendra Ranganath,et al.  Contour extraction from cardiac MRI studies using snakes , 1995, IEEE Trans. Medical Imaging.

[63]  Thomas S. Huang,et al.  Surface modeling in heart motion analysis , 1992, Other Conferences.

[64]  Nigel Goddard,et al.  Incremental model-based discrimination of articulated movement from motion features , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[65]  G. Johansson.  Visual motion perception. , 1975, Scientific American.

[66]  D. Eggert,et al.  Reconstructing CAD models of articulated objects , 1994 .

[67]  Demetri Terzopoulos,et al.  Matching deformable models to images: Direct and iterative solutions , 1980 .

[68]  Jake K. Aggarwal,et al.  Structure from Motion of Rigid and Jointed Objects , 1981, Artif. Intell..

[69]  Shanti J. Aggarwal,et al.  Shape change analysis of confocal microscope images using variational techniques , 1992, Electronic Imaging.

[70]  P. Besl.  Geometric modeling and computer vision , 1988, Proc. IEEE.

[71]  Takeo Kanade,et al.  Model-based tracking of self-occluding articulated objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[72]  Minoru Asada,et al.  Representation of three-dimensional motion in dynamic scenes , 1983, Comput. Vis. Graph. Image Process..

[73]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[74]  Subhasis Chaudhuri,et al.  Estimation of motion parameters for a deformable object from range data , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[75]  J. Aggarwal,et al.  Lower limb kinematics of human walking with the medial axis transformation , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[76]  Alistair A. Young,et al.  Tracking and finite element analysis of stripe deformation in magnetic resonance tagging , 1995, IEEE Trans. Medical Imaging.

[77]  Hsi-Jian Lee,et al.  Knowledge-guided visual perception of 3-D human gait from a single image sequence , 1992, IEEE Trans. Syst. Man Cybern..

[78]  Marc Berthod,et al.  Optimal subpixel matching of contour chains and segments , 1995, Proceedings of IEEE International Conference on Computer Vision.

[79]  James S. Duncan,et al.  Deformable Fourier models for surface finding in 3-D images , 1992, Other Conferences.

[80]  Thomas S. Huang,et al.  Vision based hand modeling and tracking for virtual teleconferencing and telecollaboration , 1995, Proceedings of IEEE International Conference on Computer Vision.

[81]  R. Nelson,et al.  Low level recognition of human motion (or how to get your man without finding his body parts) , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[82]  Demetri Terzopoulos,et al.  A finite element model for 3D shape reconstruction and nonrigid motion tracking , 1993, 1993 (4th) International Conference on Computer Vision.

[83]  James S. Duncan,et al.  Boundary Finding with Parametrically Deformable Models , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[84]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Minoru Asada,et al.  Analysis of three-dimensional motions in blocks world , 1984, Pattern Recognit..

[86]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[87]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[88]  J. O'Rourke,et al.  Model-based image analysis of human motion using constraint propagation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[89]  C. Nastar,et al.  Spatio-temporal analysis of nonrigid motion from 4D data , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[90]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[91]  Francisco J. Perales,et al.  A system for human motion matching between synthetic and real images based on a biomechanic graphical model , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[92]  Andrew J. Hanson,et al.  Hyperquadrics: Smoothly deformable shapes with convex polyhedral bounds , 1988, Comput. Vis. Graph. Image Process..

[93]  Alistair A. Young,et al.  Semi-automatic tracking of myocardial motion in MR tagged images , 1995, IEEE Trans. Medical Imaging.

[94]  Thomas S. Huang,et al.  Estimating Articulated Motion by Decomposition , 1994 .

[95]  Katsushi Ikeuchi,et al.  Deformable surfaces: a free-form shape representation , 1991, Optics & Photonics.

[96]  Richard Szeliski,et al.  Physically based and probabilistic models for computer vision , 1991, Optics & Photonics.

[97]  Michel Paindavoine,et al.  Human movement analysis with image processing in real time , 1991 .

[98]  Katsushi Ikeuchi,et al.  Shape representation and image segmentation using deformable surfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[99]  Koichiro Akita,et al.  Image sequence analysis of real world human motion , 1984, Pattern Recognit..

[100]  K. Rohr.  Towards model-based recognition of human movements in image sequences , 1994 .

[101]  Jake K. Aggarwal,et al.  Articulated and elastic non-rigid motion: a review , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.