Statistical analysis of natural human motion for animation

Generating human motion that appears natural is a long standing problem in character animation. Researchers have explored many different approaches including physics-based simulation, optimization, and data-driven methods such as motion graphs and motion interpolation. One major difficulty in applying most of these approaches is the lack of an implementable definition of what it means for motion to be natural or human-like. In this thesis, we explore two techniques to fill this gap. The first technique creates a naturalness measure for quantifying natural human motion. The second technique involves a statistical analysis of human motion to compute aggregate statistics that are needed to guide animation algorithms for human figures toward natural looking solutions. A naturalness measure should be useful in verifying that a motion editing operation has not destroyed the naturalness of a motion capture clip or that a synthetic motion transition is within the space of those seen in natural human motion. To develop such a measure, we argue that the evaluation of naturalness is not intrinsically a subjective criterion imposed by a human observer but is, instead, an objective measure that can be computed from a large set of representative motions. We base our approach on a statistical analysis of a large motion database. Using positive training data only, the system learns a set of statistical models that represent the motion of individual joints, limbs, and the whole body. Each model produces a score for the naturalness of the test motion and these scores are then combined into an aggregate score to classify the input motion as natural or unnatural. We present ROC curves of the performance of these techniques on a broad set of test sequences and compare the results to human performance in a user study. Aggregate statistics about the properties of human motion are needed to guide animation algorithms to generate natural looking motion. We compute and report a variety of statistics for joint angle range of motion, joint velocities, and dimensionality reduction using a large and representative motion capture database. We also develop new techniques for identifying motion synergies and summarizing motion in a visually intuitive way.

[1]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[2]  Jovan Popovic,et al.  Adaptation of performed ballistic motion , 2005, TOGS.

[3]  Eugene Fiume,et al.  An efficient search algorithm for motion data using weighted PCA , 2005, SCA '05.

[4]  Siwei Lyu,et al.  Higher-order Wavelet Statistics and their Application to Digital Forensics , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[5]  Thanh Giang,et al.  Evaluating the visual fidelity of physically based animations , 2003, ACM Trans. Graph..

[6]  Okan Arikan,et al.  Quick Motion Transitions with Cached Multi-way Blends , 2006 .

[7]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[8]  Michael Gleicher,et al.  Comparing Constraint-Based Motion Editing Methods , 2001, Graph. Model..

[9]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[10]  Bobby Bodenheimer,et al.  Computing the duration of motion transitions: an empirical approach , 2004, SCA '04.

[11]  Vladimir Pavlovic,et al.  Learning Switching Linear Models of Human Motion , 2000, NIPS.

[12]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[14]  Joshua G. Hale,et al.  Visual Perception of Humanoid Movement , 2003 .

[15]  Graham Coleman,et al.  Detection and explanation of anomalous activities: representing activities as bags of event n-grams , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[17]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[18]  A. Gagalowicz,et al.  Interactive Animation of Object Orientations , 1989 .

[19]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[20]  Anderson Maciel,et al.  Anatomy-based joint models for virtual human skeletons , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[21]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[22]  Okan Arikan Compression of motion capture databases , 2006, SIGGRAPH 2006.

[23]  Stephen H. Lane,et al.  Synergy-based learning of hybrid position/force control for redundant manipulators , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[24]  Daniel Cohen-Or,et al.  Action synopsis: pose selection and illustration , 2005, ACM Trans. Graph..

[25]  Pascal Fua,et al.  Hierarchical implicit surface joint limits for human body tracking , 2005, Comput. Vis. Image Underst..

[26]  F. Sebastian Grassia,et al.  Practical Parameterization of Rotations Using the Exponential Map , 1998, J. Graphics, GPU, & Game Tools.

[27]  Bobby Bodenheimer,et al.  An evaluation of a cost metric for selecting transitions between motion segments , 2003, SCA '03.

[28]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[29]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[30]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[31]  James M. Rehg,et al.  A data-driven approach to quantifying natural human motion , 2005, SIGGRAPH '05.

[32]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[33]  James M. Rehg,et al.  A data-driven approach to quantifying natural human motion , 2005, ACM Trans. Graph..

[34]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[35]  Sung Yong Shin,et al.  On-line locomotion generation based on motion blending , 2002, SCA '02.

[36]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[37]  N. Troje Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. , 2002, Journal of vision.

[38]  Kari Torkkola,et al.  Feature Extraction by Non-Parametric Mutual Information Maximization , 2003, J. Mach. Learn. Res..

[39]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[40]  J. Verriest,et al.  Three-dimensional modelling of the motion range of axial rotation of the upper arm. , 1998, Journal of biomechanics.

[41]  Victor Ng-Thow-Hing,et al.  MODULAR COMPONENTS FOR DETAILED KINEMATIC MODELLING OF JOINTS , 2003 .

[42]  Wei Wang,et al.  Human motion estimation from a reduced marker set , 2006, I3D '06.

[43]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[44]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.

[45]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[46]  Norman I. Badler,et al.  Strength guided motion , 1990, SIGGRAPH.

[47]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[48]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Ronan Boulic,et al.  Parametrization and Range of Motion of the Ball-and-Socket Joint , 2000, DEFORM/AVATARS.

[50]  Takashi Omori,et al.  Detection of unusual human behavior in intelligent house , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[51]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[52]  Ronald A. Rensink,et al.  Obscuring length changes during animated motion , 2004, ACM Trans. Graph..

[53]  Pascal Fua,et al.  Style‐Based Motion Synthesis † , 2004, Comput. Graph. Forum.

[54]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[55]  Daniel Thalmann,et al.  Human shoulder modeling including scapulo-thoracic constraint and joint sinus cones , 2000, Comput. Graph..

[56]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Jessica K. Hodgins,et al.  Perception of Human Motion With Different Geometric Models , 1998, IEEE Trans. Vis. Comput. Graph..

[58]  Nancy S. Pollard,et al.  Perceptual metrics for character animation: sensitivity to errors in ballistic motion , 2003, ACM Trans. Graph..

[59]  Yasuhiko Sakamoto,et al.  Motion map: image-based retrieval and segmentation of motion data , 2004, SCA '04.

[60]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[61]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[62]  David A. Forsyth,et al.  Enriching a motion collection by transplanting limbs , 2004, SCA '04.

[63]  E. Todorov,et al.  Analysis of the synergies underlying complex hand manipulation , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[64]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[65]  Jingzhou Yang,et al.  Towards understanding the workspace of human limbs , 2004, Ergonomics.

[66]  David A. Forsyth,et al.  Knowing when to put your foot down , 2006, I3D '06.

[67]  Norman I. Badler,et al.  Inverse kinematics positioning using nonlinear programming for highly articulated figures , 1994, TOGS.

[68]  Dimitris N. Metaxas,et al.  Automating gait generation , 2001, SIGGRAPH.

[69]  Uri Lerner,et al.  Hybrid Bayesian networks for reasoning about complex systems , 2002 .

[70]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[71]  Jane Wilhelms,et al.  Fast and Easy Reach-Cone Joint Limits , 2001, J. Graphics, GPU, & Game Tools.

[72]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.