Decomposing biological motion: a framework for analysis and synthesis of human gait patterns.

Biological motion contains information about the identity of an agent as well as about his or her actions, intentions, and emotions. The human visual system is highly sensitive to biological motion and capable of extracting socially relevant information from it. Here we investigate the question of how such information is encoded in biological motion patterns and how such information can be retrieved. A framework is developed that transforms biological motion into a representation allowing for analysis using linear methods from statistics and pattern recognition. Using gender classification as an example, simple classifiers are constructed and compared to psychophysical data from human observers. The analysis reveals that the dynamic part of the motion contains more information about gender than motion-mediated structural cues. The proposed framework can be used not only for analysis of biological motion but also to synthesize new motion patterns. A simple motion modeler is presented that can be used to visualize and exaggerate the differences in male and female walking patterns.

[1]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  M. P. Murray,et al.  Walking patterns of normal women. , 1970, Archives of physical medicine and rehabilitation.

[3]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[4]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[5]  G Johansson,et al.  Spatio-temporal differentiation and integration in visual motion perception , 1976, Psychological research.

[6]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[7]  J. Cutting,et al.  Recognizing friends by their walk: Gait perception without familiarity cues , 1977 .

[8]  J. Cutting.  Generation of Synthetic Male and Female Walkers through Manipulation of a Biomechanical Invariant , 1978, Perception.

[9]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[10]  J. Winn,et al.  Brain , 1878, The Lancet.

[11]  J. Cutting,et al.  Temporal and spatial factors in gait perception that influence gender recognition , 1978, Perception & psychophysics.

[12]  James E. Cutting,et al.  A program to generate synthetic walkers as dynamic point-light displays , 1978 .

[13]  J E Cutting,et al.  A biomechanical invariant for gait perception. , 1978, Journal of experimental psychology. Human perception and performance.

[14]  R M Alexander,et al.  Fourier analysis of forces exerted in walking and running. , 1980, Journal of biomechanics.

[15]  T. Beardsworth,et al.  The ability to recognize oneself from a video recording of one’s movements without seeing one’s body , 1981 .

[16]  R. M. Alexander,et al.  Optimization and gaits in the locomotion of vertebrates. , 1989, Physiological reviews.

[17]  Munetoshi Unuma,et al.  Generation of Human Motion with Emotion , 1991 .

[18]  W. Dittrich.  Action Categories and the Perception of Biological Motion , 1993, Perception.

[19]  Bennett I. Bertenthal,et al.  Global Processing of Biological Motions , 1994 .

[20]  G. Mather,et al.  Gender discrimination in biological motion displays based on dynamic cues , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[22]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[23]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[24]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[25]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[26]  Shang Guo,et al.  A high-level control mechanism for human locomotion based on parametric frame space interpolation , 1996 .

[27]  S. Lea,et al.  Perception of Emotion from Dynamic Point-Light Displays Represented in Dance , 1996, Perception.

[28]  T. Vetter,et al.  Representations of human faces , 1996 .

[29]  Michael J. Black,et al.  Cardboard people: a parameterized model of articulated image motion , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[30]  J. Hahn,et al.  Interpolation Synthesis of Articulated Figure Motion , 1997, IEEE Computer Graphics and Applications.

[31]  W. Prinz.  Perception and Action Planning , 1997 .

[32]  A F Bobick,et al.  Movement, activity and action: the role of knowledge in the perception of motion. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[33]  Mubarak Shah,et al.  VISUALLY RECOGNIZING SPEECH USING EIGENSEQUENCES , 1997 .

[34]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Nikolaus F. Troje,et al.  Separation of texture and shape in images of faces for image coding and synthesis , 1997 .

[36]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[37]  Jake K. Aggarwal,et al.  Nonrigid Motion Analysis: Articulated and Elastic Motion , 1998, Comput. Vis. Image Underst..

[38]  Ian Stewart,et al.  A modular network for legged locomotion , 1998 .

[39]  J. Ramsay.  Estimating smooth monotone functions , 1998 .

[40]  M. Golubitsky,et al.  Symmetry in locomotor central pattern generators and animal gaits , 1999, Nature.

[41]  Natasha Loder,et al.  Journal under attack over controversial paper on GM food , 1999, Nature.

[42]  T. Poggio,et al.  Synthesis and recognition of biological motion patterns based on linear superposition of prototypical motion sequences , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[43]  Charles F. Rose,et al.  Verbs and adverbs: multidimensional motion interpolation using radial basis functions , 1999 .

[44]  Michael J. Black,et al.  Parameterized Modeling and Recognition of Activities , 1999, Comput. Vis. Image Underst..

[45]  F. Pollick,et al.  Exaggerating Temporal Differences Enhances Recognition of Individuals from Point Light Displays , 2000, Psychological science.

[46]  Michael J. Black,et al.  Learning and Tracking Cyclic Human Motion , 2000, NIPS.

[47]  Rómer Rosales,et al.  Specialized mappings and the estimation of human body pose from a single image , 2000, Proceedings Workshop on Human Motion.

[48]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[49]  James W. Davis,et al.  Categorical representation and recognition of oscillatory motion patterns , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[50]  A. Johnston,et al.  Categorizing sex and identity from the biological motion of faces , 2001, Current Biology.

[51]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[52]  F. Pollick,et al.  Recognising the style of spatially exaggerated tennis , 2001 .

[53]  Vic Braden,et al.  Recognising the Style of Spatially Exaggerated Tennis Serves , 2001, Perception.

[54]  James W. Davis,et al.  Visual Categorization of Children and Adult Walking Styles , 2001, AVBPA.

[55]  J A Beintema,et al.  Perception of biological motion without local image motion , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[56]  Michael Jones,et al.  Multidimensional Morphable Models: A Framework for Representing and Matching Object Classes , 2004, International Journal of Computer Vision.

[57]  Martin A. Giese,et al.  Morphable Models for the Analysis and Synthesis of Complex Motion Patterns , 2000, International Journal of Computer Vision.

[58]  Christian R. Shelton,et al.  Morphable Surface Models , 2000, International Journal of Computer Vision.

[59]  Thomas Vetter,et al.  Synthesis of Novel Views from a Single Face Image , 1998, International Journal of Computer Vision.