3D Human Motion Editing and Synthesis: A Survey

The ways to compute the kinematics and dynamic quantities of human bodies in motion have been studied in many biomedical papers. This paper presents a comprehensive survey of 3D human motion editing and synthesis techniques. Firstly, four types of methods for 3D human motion synthesis are introduced and compared. Secondly, motion capture data representation, motion editing, and motion synthesis are reviewed successively. Finally, future research directions are suggested.

[1]  Bobby Bodenheimer,et al.  The Process of Motion Capture: Dealing with the Data , 1997, Computer Animation and Simulation.

[2]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[3]  Yuan Baozong,et al.  Improving Motion Synthesis by Semantic Control , 2011 .

[4]  Dan Zhao,et al.  Optimization-based key frame extraction for motion capture animation , 2012, The Visual Computer.

[5]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[6]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[7]  Le Zheng,et al.  Interactive generation of falling motions , 2006, Comput. Animat. Virtual Worlds.

[8]  Katsu Yamane,et al.  Human motion database with a binary tree and node transition graphs , 2009, Robotics: Science and Systems.

[9]  Mankyu Sung,et al.  Continuous Motion Graph for Crowd Simulation , 2007, Edutainment.

[10]  Yu-Chi Lai,et al.  Group motion graphs , 2005, SCA '05.

[11]  Jianwei Zhang,et al.  Discover Novel Visual Categories From Dynamic Hierarchies Using Multimodal Attributes , 2013, IEEE Transactions on Industrial Informatics.

[12]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[13]  Zhuang Yue.  Group Animation Based on Multiple Autonomous Agents , 2004 .

[14]  Jovan Popovic,et al.  Style translation for human motion , 2005, ACM Trans. Graph..

[15]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[16]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[17]  Yu Jian.  Style synthesis and editing of motion data in non-linear subspace , 2008 .

[18]  J. Hodgins,et al.  Animating Human Athletes , 1998 .

[19]  Ronald A. Rensink,et al.  Obscuring length changes during animated motion , 2004, SIGGRAPH 2004.

[20]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[21]  George Baciu,et al.  Motion retargeting in the presence of topological variations , 2006, Comput. Animat. Virtual Worlds.

[22]  Sanjeev Khanna,et al.  Automatic construction of a minimum size motion graph , 2009, SCA '09.

[23]  Eric N. Mortensen,et al.  Controllable real-time locomotion using mobility maps , 2005, Graphics Interface.

[24]  David C. Hogg,et al.  Learning Variable-Length Markov Models of Behavior , 2001, Comput. Vis. Image Underst..

[25]  Nancy S. Pollard,et al.  Evaluating motion graphs for character animation , 2007, TOGS.

[26]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, SIGGRAPH '08.

[27]  Chao-Hung Lin,et al.  Human Motion Retrieval from Hand-Drawn Sketch , 2012, IEEE Transactions on Visualization and Computer Graphics.

[28]  Eugene Fiume,et al.  An efficient search algorithm for motion data using weighted PCA , 2005, SCA '05.

[29]  Maja J. Mataric,et al.  Automated derivation of behavior vocabularies for autonomous humanoid motion , 2003, AAMAS '03.

[30]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[31]  Adrian Hilton,et al.  Video-based character animation , 2005, SCA '05.

[32]  Wei Wang,et al.  A system for analyzing and indexing human-motion databases , 2005, SIGMOD '05.

[33]  Seungyong Lee,et al.  Motion retargeting and evaluation for VR-based training of free motions , 2003, The Visual Computer.

[34]  Wei Baogang.  3D Human Motion Synthesis based on Nonlinear Manifold Learning , 2010 .

[35]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[36]  Jessica K. Hodgins,et al.  Automatic Joint Parameter Estimation from Magnetic Motion Capture Data , 2023, Graphics Interface.

[37]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[38]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[39]  Mark Mizuguchi,et al.  Data driven motion transitions for interactive games , 2001, Eurographics.

[40]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[41]  Michael Gleicher,et al.  Motion path editing , 2001, I3D '01.

[42]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[43]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[44]  Hans-Peter Seidel,et al.  Free-viewpoint video of human actors , 2003, ACM Trans. Graph..

[45]  Atsushi Nakazawa,et al.  A puppet interface for retrieval of motion capture data , 2011, SCA '11.

[46]  Lucas Kovar,et al.  Fast and accurate goal-directed motion synthesis for crowds , 2005, SCA '05.

[47]  Victor B. Zordan,et al.  Dynamic response for motion capture animation , 2005, SIGGRAPH '05.

[48]  Yunhe Pan,et al.  Incomplete motion feature tracking algorithm in video sequences , 2002, Proceedings. International Conference on Image Processing.

[49]  Christoph Bregler,et al.  Animating by multi-level sampling , 2000, Proceedings Computer Animation 2000.

[50]  Okan Arikan.  Compression of motion capture databases , 2006, ACM Trans. Graph..

[51]  Alla Safonova,et al.  Achieving good connectivity in motion graphs , 2008, SCA '08.

[52]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[53]  Yueting Zhuang,et al.  An Efficient Keyframe Extraction from Motion Capture Data , 2006, Computer Graphics International.

[54]  Jiang Hao,et al.  Guarder: Virtual Drilling System for Crowd Evacuation Under Emergency Scheme , 2010 .

[55]  Gutemberg Guerra-Filho,et al.  The human motion database: A cognitive and parametric sampling of human motion , 2011, Face and Gesture 2011.

[56]  R. Bowden.  Learning Statistical Models of Human Motion , 2000 .

[57]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[58]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[59]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[60]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[61]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[62]  Wu Fei,et al.  Motion Retrieval Based on Large-Scale 3D Human Motion Database by Double-Reference Index , 2008 .

[63]  Roland Geraerts,et al.  Real‐time density‐based crowd simulation , 2012, Comput. Animat. Virtual Worlds.

[64]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[65]  Alla Safonova,et al.  Human Motion Synthesis with Optimization‐based Graphs , 2010, Comput. Graph. Forum.

[66]  Paul A. Viola,et al.  Learning silhouette features for control of human motion , 2004, SIGGRAPH '04.

[67]  Feng Liu,et al.  3D motion retrieval with motion index tree , 2003, Comput. Vis. Image Underst..

[68]  James M. Rehg,et al.  A data-driven approach to quantifying natural human motion , 2005, SIGGRAPH '05.

[69]  Pan Zhigeng,et al.  A Real-Time Algorithm for Character Reactive Animation Generation , 2009 .

[70]  Xu Jun-jian.  Path editing technique based on motion graphs , 2011 .

[71]  Li Chunpeng,et al.  Key-Postures Based Automated Construction of Motion Graph , 2010 .

[72]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[73]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[74]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[75]  Daniel Thalmann,et al.  Using an Intermediate Skeleton and Inverse Kinematics for Motion Retargeting , 2000, Comput. Graph. Forum.

[76]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[77]  Tido Röder,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH 2005.

[78]  Jessica K. Hodgins,et al.  Perception of Human Motion With Different Geometric Models , 1998, IEEE Trans. Vis. Comput. Graph..

[79]  Nancy S. Pollard,et al.  Perceptual metrics for character animation: sensitivity to errors in ballistic motion , 2003, ACM Trans. Graph..

[80]  Victor B. Zordan,et al.  Mapping optical motion capture data to skeletal motion using a physical model , 2003, SCA '03.

[81]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[82]  Chao Jin,et al.  Optimized keyframe extraction for 3D character animations , 2012, Comput. Animat. Virtual Worlds.

[83]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[84]  Ronald A. Rensink,et al.  Obscuring length changes during animated motion , 2004, ACM Trans. Graph..

[85]  Frédéric H. Pighin,et al.  Hybrid control for interactive character animation , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[86]  Dengming Zhu,et al.  A robust method for analyzing the physical correctness of motion capture data , 2006, VRST '06.

[87]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[88]  Michiel van de Panne,et al.  Motion synthesis by example , 1996 .

[89]  Jianwei Zhang,et al.  A Hierarchical Model Incorporating Segmented Regions and Pixel Descriptors for Video Background Subtraction , 2012, IEEE Transactions on Industrial Informatics.

[90]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[91]  Jinxiang Chai,et al.  Physically valid statistical models for human motion generation , 2011, TOGS.