A Motion Graph Approach for Interactive 3D Animation Using Low-cost Sensors

Interactive 3D animation of human figures is very common in video games, animation studios and virtual environments. However, it is difficult to produce full body animation that looks realistic enough to be comparable to studio quality human motion data. The commercial motion capture systems are expensive and not suitable for capture in everyday environments. Real-time requirements tend to reduce quality of animation. We present a motion graph based framework to produce high quality motion sequences in real-time using a set of inertial sensor based controllers. The user’s action generates signals from the controllers that provide constraints to select appropriate sequence of motions from a structured database of human motions, namely motion graph. Our local search algorithm utilizes noise prone and rapidly varying input sensor signals for querying a large database in real-time. The ability to waive the controllers for producing high quality animation provides a simple 3D user interface that is intuitive to use. The proposed framework is low cost and easy to setup.

[1]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[2]  William G. Griswold,et al.  An Overview of AspectJ , 2001, ECOOP.

[3]  Yannis Smaragdakis,et al.  Mixin-Based Programming in C++ , 2000, GCSE.

[4]  Cristina Videira Lopes,et al.  Aspect-Oriented Programming: An Historical Perspective (What's in a Name?) , 2002 .

[5]  Wei Wang,et al.  Human motion estimation from a reduced marker set , 2006, I3D '06.

[6]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[7]  Mary Shaw,et al.  An Introduction to Software Architecture , 1993, Advances in Software Engineering and Knowledge Engineering.

[8]  Jody Condit Fagan Mashing up multiple web feeds using yahoo! pipes , 2007 .

[9]  Eric Robert Bachmann,et al.  Inertial and Magnetic Tracking of Limb Segment Orientation for Inserting Humans into Synthetic Environments , 2000 .

[10]  李幼升,et al.  Ph , 1989 .

[11]  Norman I. Badler,et al.  Real-Time Control of a Virtual Human Using Minimal Sensors , 1993, Presence: Teleoperators & Virtual Environments.

[12]  Francis K. H. Quek,et al.  Data-driven motion estimation with low-cost sensors , 2008 .

[13]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, ACM Trans. Graph..

[14]  Paul A. Beardsley,et al.  Computer Vision for Interactive Computer Graphics , 1998, IEEE Computer Graphics and Applications.

[15]  Wu-chun Feng,et al.  A Maintainable Software Architecture for Fast and Modular Bioinformatics Sequence Search , 2007, 2007 IEEE International Conference on Software Maintenance.

[16]  Kwan-Liu Ma,et al.  A Parallel Visualization Pipeline for Terascale Earthquake Simulations , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[17]  Christoph Bregler,et al.  Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[18]  Kurt Madsen,et al.  Five years of framework building: lessons learned , 2003, OOPSLA '03.

[19]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, ACM Trans. Graph..

[20]  Yannis Smaragdakis,et al.  Implementing Layered Designs with Mixin Layers , 1998, ECOOP.

[21]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[22]  Jan Bosch Generative and Component-Based Software Engineering , 2001, Lecture Notes in Computer Science.

[23]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[24]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[25]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, ACM Trans. Graph..

[26]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[27]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[28]  A. Hunt,et al.  Pipelines [Unix programming] , 2003 .

[29]  Pawel Gepner,et al.  Multi-Core Processors: New Way to Achieve High System Performance , 2006, PARELEC.

[30]  Bobby Bodenheimer,et al.  An evaluation of a cost metric for selecting transitions between motion segments , 2003, SCA '03.

[31]  Mark Mizuguchi,et al.  Data driven motion transitions for interactive games , 2001, Eurographics.

[32]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[33]  David R. Butenhof Programming with POSIX threads , 1993 .

[34]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[35]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[36]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[37]  Dinesh K. Pai,et al.  FootSee: an interactive animation system , 2003, SCA '03.

[38]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[39]  Klemens Böhm,et al.  Configurable Binding : How to Exploit Mixins and Design Patterns for Resource-Constrained Environments , 2004 .

[40]  Geoffrey E. Hinton,et al.  A Desktop Input Device and Interface for Interactive 3D Character Animation , 2002, Graphics Interface.

[41]  Yannis Smaragdakis,et al.  Mixin layers: an object-oriented implementation technique for refinements and collaboration-based designs , 2002, TSEM.

[42]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[43]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[44]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[45]  Jørgen Lindskov Knudsen ECOOP 2001 — Object-Oriented Programming , 2001, Lecture Notes in Computer Science.

[46]  Shang Guo,et al.  A high-level control mechanism for human locomotion based on parametric frame space interpolation , 1996 .

[47]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[48]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[49]  Michael Gleicher,et al.  Parametric motion graphs , 2007, SI3D.