Model-based image analysis of human motion using constraint propagation

A system capable of analyzing image sequences of human motion is described. The system is structured as a feedback loop between high and low levels: predictions are made at the semantic level and verifications are sought at the image level. The domain of human motion lends itself to a model-driven analysis, and the system includes a detailed model of the human body. All information extracted from the image is interpreted through a constraint network based on the structure of the human model. A constraint propagation operator is defined and its theoretical properties outlined. An implementation of this operator is described, and results of the analysis system for short image sequences are presented.

[1]  Julian R. Ullmann,et al.  Associating Parts of Patterns , 1966, Inf. Control..

[2]  Adolfo Guzmán-Arenas,et al.  Decomposition of a visual scene into three-dimensional bodies , 1968, AFIPS Fall Joint Computing Conference.

[3]  Adolfo Guzman,et al.  Decomposition of a visual scene into three-dimensional bodies , 1968 .

[4]  Richard Fikes,et al.  REF-ARF: A System for Solving Problems Stated as Procedures , 1970, Artif. Intell..

[5]  Charles M. Eastman,et al.  Automated Space Planning , 1973, Artif. Intell..

[6]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[7]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[8]  Robert P. Futrelle.  GALATEA: Interactive Graphics for the Analysis of Moving Images , 1974, IFIP Congress.

[9]  Ugo Montanari,et al.  Networks of constraints: Fundamental properties and applications to picture processing , 1974, Inf. Sci..

[10]  Norman I. Badler,et al.  Temporal scene analysis: conceptual descriptions of object movements. , 1975 .

[11]  Jake K. Aggarwal,et al.  Computer Analysis of Moving Polygonal Images , 1975, IEEE Transactions on Computers.

[12]  H. Chien,et al.  Acquisition Of Moving Objects And Hand-Eye Coordination , 1975, IJCAI.

[13]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[14]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[15]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  James H. Clark,et al.  Hierarchical geometric models for visible surface algorithms , 1976, CACM.

[17]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  U. Neisser.  Cognition and reality: principles and implications , 1976 .

[19]  Saburo Tsuji,et al.  Understanding a Simple Cartoon Film by a Computer Vision System , 1977, IJCAI.

[20]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[21]  WeilerKevin,et al.  Hidden surface removal using polygon area sorting , 1977 .

[22]  C. Trevarthen.  Review: Cognition and Reality: Principles and Implications of Cognitive Psychology , 1977 .

[23]  Gerald J. Sussman,et al.  Forward Reasoning and Dependency-Directed Backtracking in a System for Computer-Aided Circuit Analysis , 1976, Artif. Intell..

[24]  Dana H. Ballard,et al.  An Approach to Knowledge-Directed Image Analysis , 1977, IJCAI.

[25]  John K. Tsotsos.  Knowledge-Base Driven Analysis of Cinecardioangiograms , 1977, IJCAI.

[26]  John K. Tsotsos.  Some Notes on Motion Understanding , 1977, IJCAI.

[27]  Alan K. Mackworth.  Consistency in Networks of Relations , 1977, Artif. Intell..

[28]  R. Eskenazi,et al.  A Random Access Picture Digitizer, Display, and Memory System , 1977, IJCAI.

[29]  J. Potter.  Scene segmentation using motion information , 1977 .

[30]  W N Martin,et al.  Dynamic Scene Analysis: The Study of Moving Images, , 1977 .

[31]  Jake K. Aggarwal,et al.  Computer Analysis of Planar Curvilinear Moving Images , 1977, IEEE Transactions on Computers.

[32]  Martin Herman.  Understanding Stick Figures. , 1977 .

[33]  Leonard Uhr,et al.  A 'Recognition Cone' Perceptual System: Brief Test Results , 1977, IJCAI.

[34]  Michael Shneier,et al.  Recognition Using Semantic Constraints , 1977, IJCAI.

[35]  Norman I. Badler,et al.  A Human Body Modelling System for Motion Studies , 1977 .

[36]  Peter R. Atherton,et al.  Hidden surface removal using polygon area sorting , 1977, SIGGRAPH.

[37]  Martin D. Levine,et al.  An Automatic Picture Processing Method for Tracking and Quantifying the Dynamics of Blood Cell Motion , 1978 .

[38]  N. Badler,et al.  The Simulation of Human Movement by Computer , 1978 .

[39]  Eugene C. Freuder.  Synthesizing constraint expressions , 1978, CACM.

[40]  Gabor T. Herman,et al.  Dynamic boundary surface detection , 1978 .

[41]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[42]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[43]  Hans-Hellmut Nagel,et al.  Formation of an object concept by analysis of systematic time variations in the optically perceptible environment , 1978 .

[44]  Masahiko Yachida,et al.  Three Dimensional Movement Analysis of Dynamic Line Images , 1979, IJCAI.

[45]  Martin Herman,et al.  Understanding body postures of human stick figures , 1979 .

[46]  Norman I. Badler,et al.  Digital Representations of Human Movement , 1979, CSUR.

[47]  J. O'Rourke,et al.  A spherical representation of a human body for visualizing movement , 1979, Proceedings of the IEEE.

[48]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[49]  Herbert Freeman,et al.  The cyclic order property of vertices as an aid in scene analysis , 1979, CACM.

[50]  R M Haralick,et al.  The consistent labeling problem: part I. , 1979, IEEE transactions on pattern analysis and machine intelligence.

[51]  Ramesh C. Jain,et al.  On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  S. Ullman.  The Interpretation of Visual Motion , 1979 .

[53]  Jake K. Aggarwal,et al.  Computer Tracking of Objects Moving in Space , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Robert M. Haralick,et al.  The Consistent Labeling Problem: Part I , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Walt Scacchi.  Visual motion perception by intelligent systems , 1979 .

[56]  Takeo Kanade,et al.  Region segmentation: Signal vs semantics , 1980 .

[57]  R. F. Rashid,et al.  Towards a system for the interpretation of moving light displays , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Joseph O'Rourke,et al.  Image analysis of human motion , 1980 .

[59]  T. P. Wallace,et al.  Analysis of three-dimensional movement using Fourier descriptors , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.