Motion reconstruction using sparse accelerometer data

The development of methods and tools for the generation of visually appealing motion sequences using prerecorded motion capture data has become an important research area in computer animation. In particular, data-driven approaches have been used for reconstructing high-dimensional motion sequences from low-dimensional control signals. In this article, we contribute to this strand of research by introducing a novel framework for generating full-body animations controlled by only four 3D accelerometers that are attached to the extremities of a human actor. Our approach relies on a knowledge base that consists of a large number of motion clips obtained from marker-based motion capturing. Based on the sparse accelerometer input a cross-domain retrieval procedure is applied to build up a lazy neighborhood graph in an online fashion. This graph structure points to suitable motion fragments in the knowledge base, which are then used in the reconstruction step. Supported by a kd-tree index structure, our procedure scales to even large datasets consisting of millions of frames. Our combined approach allows for reconstructing visually plausible continuous motion streams, even in the presence of moderate tempo variations which may not be directly reflected by the given knowledge base.

[1]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[2]  Βασίλειος Αταλασίδης-Καραντίνης 3D motion tracking : παραγωγή διαφημιστικού βίντεο συνδυαστικής χρήσης τριδιάστατων γραφικών με ζωντανά πλάνα , 2012 .

[3]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[4]  Peter H. Veltink,et al.  Ambulatory human motion tracking by fusion of inertial and magnetic sensing with adaptive actuation , 2009, Medical & Biological Engineering & Computing.

[5]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, SIGGRAPH 2007.

[6]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[7]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[8]  Tido Röder,et al.  Documentation Mocap Database HDM05 , 2007 .

[9]  Jehee Lee,et al.  Motion synthesis and editing in low-dimensional spaces: Research Articles , 2006 .

[10]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[11]  Zoran Popović,et al.  Motion fields for interactive character locomotion , 2010, SIGGRAPH 2010.

[12]  Aaron Hertzmann,et al.  Active learning for real-time motion controllers , 2007, SIGGRAPH 2007.

[13]  Tido Röder,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH 2005.

[14]  Arno Zinke,et al.  Fast local and global similarity searches in large motion capture databases , 2010, SCA '10.

[15]  Jessica K. Hodgins,et al.  Action capture with accelerometers , 2008, SCA '08.

[16]  Jessica K. Hodgins,et al.  Human Motion Reconstruction using Wearable Accelerometers , 2010 .

[17]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[18]  Jessica K. Hodgins,et al.  Accelerometer-based user interfaces for the control of a physically simulated character , 2008, SIGGRAPH 2008.

[19]  Robert Carson,et al.  Motion Capture , 2009, Encyclopedia of Biometrics.

[20]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[21]  Hyun Joon Shin,et al.  Motion synthesis and editing in low‐dimensional spaces , 2006, Comput. Animat. Virtual Worlds.

[22]  Geoffrey E. Hinton,et al.  A Desktop Input Device and Interface for Interactive 3D Character Animation , 2002, Graphics Interface.

[23]  Roberto Maiocchi,et al.  3-D character animation using motion capture , 1996 .

[24]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[25]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[26]  Nicolas Courty,et al.  Motion Compression using Principal Geodesics Analysis , 2009, Comput. Graph. Forum.

[27]  Dimitrios Gunopulos,et al.  Indexing Large Human-Motion Databases , 2004, VLDB.

[28]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[29]  Byung-Uck Kim,et al.  Real-time data driven deformation using kernel canonical correlation analysis , 2008, ACM Trans. Graph..

[30]  Norman I. Badler,et al.  Real-Time Control of a Virtual Human Using Minimal Sensors , 1993, Presence: Teleoperators & Virtual Environments.