Reconstructing whole-body motions with wrist trajectories

Reconstructing whole-body motions using only a low-dimensional input reduces the cost of and efforts for performance capture significantly, and yet remains a challenging problem. We introduce a novel technique that synthesizes whole-body motion using the two wrist trajectories. Given the wrist trajectories, we first determine the optimal ankle trajectories from a large number of candidate ankle paths obtained from example poses in the motion database. The optimal trajectory is efficiently achieved by solving for the shortest path problem in a directed acyclic graph. Next, we use both the wrist and ankle trajectories as the low-dimensional control signals to achieve the whole-body pose at each time step. We show that our method can reconstruct various whole-body motions that can be recognized by arm motions, such as walking, stepping, and in-place upper-body motions. Comparisons with ground truth motions and with other methods are provided.

[1]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[2]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[3]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[4]  Lucas Kovar,et al.  Splicing Upper‐Body Actions with Locomotion , 2006, Comput. Graph. Forum.

[5]  Jessica K. Hodgins,et al.  Action capture with accelerometers , 2008, SCA '08.

[6]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[7]  Jessica K. Hodgins,et al.  Accelerometer-based user interfaces for the control of a physically simulated character , 2008, SIGGRAPH 2008.

[8]  Jessica K. Hodgins,et al.  Human Motion Reconstruction using Wearable Accelerometers , 2010 .

[9]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[10]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[11]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[12]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, SIGGRAPH 2005.

[13]  Stephen M. Omohundro,et al.  Nonlinear Image Interpolation using Manifold Learning , 1994, NIPS.

[14]  Sung Yong Shin,et al.  A Coordinate-Invariant Approach to Multiresolution Motion Analysis , 2001, Graph. Model..

[15]  Paul A. Viola,et al.  Learning silhouette features for control of human motion , 2004, SIGGRAPH '04.

[16]  C. Karen Liu,et al.  Synthesis of Responsive Motion Using a Dynamic Model , 2010, Comput. Graph. Forum.

[17]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[18]  Alla Safonova,et al.  Achieving good connectivity in motion graphs , 2008, SCA '08.

[19]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, SIGGRAPH 2007.

[20]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[21]  Jehee Lee,et al.  Precomputing avatar behavior from human motion data , 2004, SCA '04.

[22]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[23]  Hans-Peter Seidel,et al.  Motion reconstruction using sparse accelerometer data , 2011, TOGS.

[24]  Taehyun Rhee,et al.  Realtime human motion control with a small number of inertial sensors , 2011, SI3D.

[25]  Sergey Levine,et al.  Continuous character control with low-dimensional embeddings , 2012, ACM Trans. Graph..

[26]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[27]  Arno Zinke,et al.  Fast local and global similarity searches in large motion capture databases , 2010, SCA '10.

[28]  Yaser Sheikh,et al.  Motion capture from body-mounted cameras , 2011, SIGGRAPH 2011.

[29]  Jinxiang Chai,et al.  Physically valid statistical models for human motion generation , 2011, TOGS.

[30]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[31]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, SIGGRAPH '05.

[32]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[33]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[34]  Jinxiang Chai,et al.  Motion graphs++ , 2012, ACM Trans. Graph..

[35]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[36]  Michael Gleicher,et al.  Automated extraction and parameterization of motions in large data sets , 2004, SIGGRAPH 2004.

[37]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[38]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[39]  Dinesh K. Pai,et al.  FootSee: an interactive animation system , 2003, SCA '03.

[40]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[41]  Yen-Lin Chen,et al.  Interactive generation of human animation with deformable motion models , 2009, TOGS.