Exploiting contacts for interactive control of animated human characters

One of the common research goals in disciplines such as computer graphics and robotics is to understand the subtleties of human motion and develop tools for recreating natural and meaningful motion. Physical simulation of virtual human characters is a promising approach since it provides a testbed for developing and testing control strategies required to execute various human behaviors. Designing generic control algorithms for simulating a wide range of human activities, which can robustly adapt to varying physical environments, has remained a primary challenge. This dissertation introduces methods for generic and robust control of virtual characters in an interactive physical environment. Our approach is to use the information of the physical contacts between the character and her environment in the control design. We leverage high-level knowledge of the kinematics goals and the interaction with the surroundings to develop active control strategies that robustly adapt to variations in the physical scene. For synthesizing intentional motion requiring long-term planning, we exploit properties of the physical model for creating efficient and robust controllers in an interactive framework. The control design leverages the reference motion capture data and the contact information with the environment for interactive long-term planning. Finally, we propose a compact soft contact model for handling contacts for rigid body virtual characters. This model aims at improving the robustness of existing control methods without adding any complexity to the control design and opens up possibilities for new control algorithms to synthesize agile human motion.

[1]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[2]  R. Miall,et al.  Visuomotor tracking with delayed visual feedback , 1985, Neuroscience.

[3]  Nancy S. Pollard,et al.  Fast simulation of skeleton-driven deformable body characters , 2011, TOGS.

[4]  Taku Komura,et al.  Stepping motion for a human-like character to maintain balance against large perturbations , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[5]  Victor B. Zordan,et al.  Anticipation from example , 2007, VRST '07.

[6]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[7]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[8]  C. Karen Liu Synthesis of interactive hand manipulation , 2008, SCA '08.

[9]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, SIGGRAPH 2007.

[10]  M. V. D. Panne,et al.  SIMBICON: simple biped locomotion control , 2007, SIGGRAPH 2007.

[11]  Michiel van de Panne,et al.  Synthesis of Controllers for Stylized Planar Bipedal Walking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[12]  J. Hodgins ANIMATING HUMAN MOTION , 1998 .

[13]  Daniel Thalmann,et al.  The Elastic Surface Layer Model for Animated Character Construction , 1993 .

[14]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[15]  Petros Faloutsos,et al.  Dynamic Free-Form Deformations for Animation Synthesis , 1997, IEEE Trans. Vis. Comput. Graph..

[16]  Zicheng Liu,et al.  Hierarchical spacetime control , 1994, SIGGRAPH.

[17]  Michael F. Cohen,et al.  Controlling dynamic simulation with kinematic constraints , 1987, SIGGRAPH.

[18]  Jovan Popovic,et al.  Interactive animation of dynamic manipulation , 2006, SCA '06.

[19]  Victor B. Zordan,et al.  Psychologically Inspired Anticipation and Dynamic Response for Impacts to the Head and Upper Body , 2008, IEEE Transactions on Visualization and Computer Graphics.

[20]  C. Karen Liu,et al.  Modal-space control for articulated characters , 2011, TOGS.

[21]  Andrew Witkin,et al.  Physically Based Modeling: Principles and Practice , 1997 .

[22]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[23]  David J. Fleet,et al.  Optimizing walking controllers , 2009, ACM Trans. Graph..

[24]  Zoran Popovic,et al.  Terrain-adaptive bipedal locomotion control , 2010, ACM Transactions on Graphics.

[25]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[26]  Sungeun Kim,et al.  Data-driven biped control , 2010, ACM Trans. Graph..

[27]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[28]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[29]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[30]  Petros Faloutsos,et al.  On the beat!: timing and tension for dynamic characters , 2007, SCA '07.

[31]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[32]  Eftychios Sifakis,et al.  Comprehensive biomechanical modeling and simulation of the upper body , 2009, TOGS.

[33]  C. T. Farley,et al.  Leg stiffness primarily depends on ankle stiffness during human hopping. , 1999, Journal of biomechanics.

[34]  Eugene Fiume,et al.  Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion , 2005, SCA '05.

[35]  Imin Kao,et al.  Modeling of contact mechanics with experimental results for soft fingers , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[36]  Demetri Terzopoulos,et al.  Heads up!: biomechanical modeling and neuromuscular control of the neck , 2006, SIGGRAPH 2006.

[37]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[38]  Katsu Yamane,et al.  Stable penalty-based model of frictional contacts , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[39]  David J. Fleet,et al.  Optimizing walking controllers for uncertain inputs and environments , 2010, SIGGRAPH 2010.

[40]  Michiel van de Panne,et al.  Guided Optimization for Balanced Locomotion , 1995 .

[41]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[42]  J. Edward Colgate,et al.  Passivity of a class of sampled-data systems: Application to haptic interfaces , 1997, J. Field Robotics.

[43]  M. Anitescu,et al.  Formulating Dynamic Multi-Rigid-Body Contact Problems with Friction as Solvable Linear Complementarity Problems , 1997 .

[44]  Junggon Kim,et al.  Direct Control of Simulated Nonhuman Characters , 2011 .

[45]  Jovan Popovic,et al.  Multiobjective control with frictional contacts , 2007, SCA '07.

[46]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[47]  Aaron Hertzmann,et al.  Robust physics-based locomotion using low-dimensional planning , 2010, SIGGRAPH 2010.

[48]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[49]  A. James Stewart,et al.  Beyond keyframing: an algorithmic approach to animation , 1992 .

[50]  D. B. Lockhart,et al.  Optimal sensorimotor transformations for balance , 2007, Nature Neuroscience.

[51]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[52]  Kazuhito Yokoi,et al.  Interactive Dynamic Simulator for Humanoid Robots with Deformable Soles , 2008 .

[53]  Cary B. Phillips,et al.  Multi-weight enveloping: least-squares approximation techniques for skin animation , 2002, SCA '02.

[54]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[55]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[56]  Aaron Hertzmann,et al.  Feature-based locomotion controllers , 2010, SIGGRAPH 2010.

[57]  Imin Kao,et al.  Computing and controlling compliance of a robotic hand , 1989, IEEE Trans. Robotics Autom..

[58]  Philippe Beaudoin,et al.  Synthesis of constrained walking skills , 2008, SIGGRAPH Asia '08.

[59]  Christian Duriez,et al.  Volume contact constraints at arbitrary resolution , 2010, ACM Trans. Graph..

[60]  Oussama Khatib,et al.  A whole-body control framework for humanoids operating in human environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[61]  Pixar Animation Studios,et al.  Physically Based Modeling , 2001 .

[62]  C. Karen Liu,et al.  Optimal feedback control for character animation using an abstract model , 2010, ACM Trans. Graph..

[63]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[64]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, SIGGRAPH 2005.

[65]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[66]  C. Karen Liu,et al.  Animating responsive characters with dynamic constraints in near-unactuated coordinates , 2008, SIGGRAPH 2008.

[67]  Oussama Khatib,et al.  Synthesis of Whole-Body Behaviors through Hierarchical Control of Behavioral Primitives , 2005, Int. J. Humanoid Robotics.

[68]  Dinesh K. Pai,et al.  Motion perturbation based on simple neuromotor control models , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[69]  Chen Shen,et al.  Interactive Deformation Using Modal Analysis with Constraints , 2003, Graphics Interface.

[70]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[71]  Elizabeth A. Croft,et al.  Haptic rendering of rigid body collisions , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[72]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[73]  Hans-Peter Seidel,et al.  Construction and animation of anatomically based human hand models , 2003, SCA '03.

[74]  Eugene Fiume,et al.  Limit cycle control and its application to the animation of balancing and walking , 1996, SIGGRAPH.

[75]  C. Glocker,et al.  Vibration of discrete and continuous systems , 1998 .

[76]  Marco da Silva,et al.  Interactive simulation of stylized human locomotion , 2008, ACM Trans. Graph..

[77]  A. A. Maciejewski,et al.  Obstacle Avoidance , 2005 .

[78]  Michael F. Cohen,et al.  Interactive spacetime control for animation , 1992, SIGGRAPH.

[79]  Marc H. Raibert,et al.  Legged Robots That Balance , 1986, IEEE Expert.

[80]  Jessica K. Hodgins,et al.  Simulating balance recovery responses to trips based on biomechanical principles , 2009, SCA '09.

[81]  J. T. Massey,et al.  Spatial trajectories and reaction times of aimed movements: effects of practice, uncertainty, and change in target location. , 1981, Journal of neurophysiology.

[82]  Victor B. Zordan,et al.  Momentum control for balance , 2009, SIGGRAPH 2009.

[83]  C. Karen Liu Dextrous manipulation from a grasping pose , 2009, SIGGRAPH 2009.

[84]  Markus H. Gross,et al.  Soft Articulated Characters with Fast Contact Handling , 2007, Comput. Graph. Forum.

[85]  Jovan Popovic,et al.  Adaptation of performed ballistic motion , 2005, TOGS.

[86]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[87]  Philippe Beaudoin,et al.  Generalized biped walking control , 2010, SIGGRAPH 2010.

[88]  Atsuo Takanishi,et al.  Experimental development of a foot mechanism with shock absorbing material for acquisition of landing surface position information and stabilization of dynamic biped walking , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[89]  Aaron Hertzmann,et al.  Prioritized optimization for task-space control , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[90]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[91]  Leonidas J. Guibas,et al.  Quasi-rigid objects in contact , 2004, SCA '04.

[92]  Z. Popovic,et al.  Interactive skeleton-driven dynamic deformations , 2002, ACM Trans. Graph..

[93]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[94]  C. Karen Liu,et al.  Optimization-based interactive motion synthesis , 2009, ACM Trans. Graph..

[95]  Jernej Barbic,et al.  Deformable object animation using reduced optimal control , 2009, ACM Trans. Graph..

[96]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[97]  Zoran Popović,et al.  Contact-aware nonlinear control of dynamic characters , 2009, SIGGRAPH 2009.