Discovery of complex behaviors through contact-invariant optimization

We present a motion synthesis framework capable of producing a wide variety of important human behaviors that have rarely been studied, including getting up from the ground, crawling, climbing, moving heavy objects, acrobatics (hand-stands in particular), and various cooperative actions involving two characters and their manipulation of the environment. Our framework is not specific to humans, but applies to characters of arbitrary morphology and limb configuration. The approach is fully automatic and does not require domain knowledge specific to each behavior. It also does not require pre-existing examples or motion capture data. At the core of our framework is the contact-invariant optimization (CIO) method we introduce here. It enables simultaneous optimization of contact and behavior. This is done by augmenting the search space with scalar variables that indicate whether a potential contact should be active in a given phase of the movement. These auxiliary variables affect not only the cost function but also the dynamics (by enabling and disabling contact forces), and are optimized together with the movement trajectory. Additional innovations include a continuation scheme allowing helper forces at the potential contacts rather than the torso, as well as a feature-based model of physics which is particularly well-suited to the CIO framework. We expect that CIO can also be used with a full physics model, but leave that extension for future work.

[1]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[2]  Michiel van de Panne,et al.  Guided Optimization for Balanced Locomotion , 1995 .

[3]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[4]  F. M. Kirillova,et al.  Optimal Feedback Control , 1995 .

[5]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[6]  F. Sebastian Grassia,et al.  Practical Parameterization of Rotations Using the Exponential Map , 1998, J. Graphics, GPU, & Game Tools.

[7]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[8]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[9]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Michiel van de Panne,et al.  A grasp-based motion planning algorithm for character animation , 2001, Comput. Animat. Virtual Worlds.

[11]  Shuuji Kajita,et al.  Real-time 3D walking pattern generation for a biped robot with telescopic legs , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[13]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[14]  Masayuki Inaba,et al.  Motion Planning for Humanoid Robots , 2003, ISRR.

[15]  Miomir Vukobratovic,et al.  Zero-Moment Point - Thirty Five Years of its Life , 2004, Int. J. Humanoid Robotics.

[16]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[17]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[18]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[19]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[20]  Philip Holmes,et al.  Running in Three Dimensions: Analysis of a Point-mass Sprung-leg Model , 2005, Int. J. Robotics Res..

[21]  Andy Ruina,et al.  Energetic Consequences of Walking Like an Inverted Pendulum: Step-to-Step Transitions , 2005, Exercise and sport sciences reviews.

[22]  C. Karen Liu,et al.  Composition of complex optimal multi-character motions , 2006, SCA '06.

[23]  Sergey V. Drakunov,et al.  Capture Point: A Step toward Humanoid Push Recovery , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[24]  Manoj Srinivasan,et al.  Computer optimization of a minimal biped model discovers walking and running , 2006, Nature.

[25]  Joel Chestnutt,et al.  Navigation planning for legged robots , 2007 .

[26]  KangKang Yin,et al.  SIMBICON: simple biped locomotion control , 2007, ACM Trans. Graph..

[27]  Timothy Bretl,et al.  Motion Planning for Legged Robots on Varied Terrain , 2008, Int. J. Robotics Res..

[28]  Philippe Beaudoin,et al.  Continuation methods for adapting simulated skills , 2008, ACM Trans. Graph..

[29]  Andrew Y. Ng,et al.  A control architecture for quadruped locomotion over rough terrain , 2008, 2008 IEEE International Conference on Robotics and Automation.

[30]  Zoran Popovic,et al.  Optimal gait and form for animal locomotion , 2009, ACM Trans. Graph..

[31]  C. Karen Liu,et al.  Dextrous manipulation from a grasping pose , 2009, ACM Trans. Graph..

[32]  Philippe Beaudoin,et al.  Robust task-based control policies for physics-based characters , 2009, ACM Trans. Graph..

[33]  David J. Fleet,et al.  Optimizing walking controllers , 2009, ACM Trans. Graph..

[34]  Philippe Beaudoin,et al.  Robust task-based control policies for physics-based characters , 2009, SIGGRAPH 2009.

[35]  Frédo Durand,et al.  Linear Bellman combination for control of character animation , 2009, ACM Trans. Graph..

[36]  Zoran Popovic,et al.  Contact-aware nonlinear control of dynamic characters , 2009, ACM Trans. Graph..

[37]  C. Karen Liu Dextrous manipulation from a grasping pose , 2009, SIGGRAPH 2009.

[38]  David J. Fleet,et al.  Estimating contact dynamics , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[39]  Zoran Popović,et al.  Terrain-adaptive bipedal locomotion control , 2010, SIGGRAPH 2010.

[40]  Martin de Lasa,et al.  Feature-based locomotion controllers , 2010, ACM Trans. Graph..

[41]  Sung-Hee Lee,et al.  Ground reaction force control at each foot: A momentum-based humanoid balance controller for non-level and non-stationary ground , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Martin de Lasa,et al.  Robust physics-based locomotion using low-dimensional planning , 2010, ACM Trans. Graph..

[43]  C. K. Liu,et al.  Optimal feedback control for character animation using an abstract model , 2010, ACM Trans. Graph..

[44]  Z. Popovic,et al.  Terrain-adaptive bipedal locomotion control , 2010, ACM Trans. Graph..

[45]  C. Karen Liu,et al.  Controlling physics-based characters using soft contacts , 2011, ACM Trans. Graph..

[46]  A. Karpathy,et al.  Locomotion skills for simulated quadrupeds , 2011, SIGGRAPH 2011.

[47]  Emanuel Todorov,et al.  A convex, smooth and invertible contact model for trajectory optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[48]  Abderrahmane Kheddar,et al.  Multi-contact stances planning for multiple agents , 2011, 2011 IEEE International Conference on Robotics and Automation.

[49]  Yuval Tassa,et al.  Infinite-Horizon Model Predictive Control for Periodic Tasks with Contacts , 2011, Robotics: Science and Systems.

[50]  Benjamin J. Stephens,et al.  Push Recovery Control for Force-Controlled Humanoid Robots , 2011 .

[51]  Zoran Popovic,et al.  Composite control of physically simulated characters , 2011, TOGS.

[52]  Ian R. Manchester,et al.  Stable dynamic walking over uneven terrain , 2011, Int. J. Robotics Res..