Multi-Character Physical and Behavioral Interactions Controller

We extend the quadratic program (QP)-based task-space character control approach—initially intended for individual character animation—to multiple characters interacting among each other or with mobile/articulated elements of the environment. The interactions between the characters can be either physical interactions, such as contacts that can be established or broken at will between them and for which the forces are subjected to Newton’s third law, or behavioral interactions, such as collision avoidance and cooperation that naturally emerge to achieve collaborative tasks from high-level specifications. We take a systematic approach integrating all the equations of motions of the characters, objects, and articulated environment parts in a single QP formulation in order to embrace and solve the most general instance of the problem, where independent individual character controllers would fail to account for the inherent coupling of their respective motions through those physical and behavioral interactions. Various types of motions/behaviors are controlled with only the one single formulation that we propose, and some examples of the original motions the framework allows are presented in the accompanying video.

[1]  Jovan Popovic,et al.  Simulation of Human Motion Data using Short‐Horizon Model‐Predictive Control , 2008, Comput. Graph. Forum.

[2]  A. Karpathy,et al.  Locomotion skills for simulated quadrupeds , 2011, ACM Trans. Graph..

[3]  C. Karen Liu,et al.  Interactive synthesis of human-object interaction , 2009, SCA '09.

[4]  Martin de Lasa,et al.  Feature-based locomotion controllers , 2010, ACM Trans. Graph..

[5]  Stefan Schaal,et al.  Inverse dynamics control of floating-base robots with external constraints: A unified view , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  C. Karen Liu,et al.  Synthesis of concurrent object manipulation tasks , 2012, ACM Trans. Graph..

[7]  Jean-Paul Laumond,et al.  Animation planning for virtual characters cooperation , 2006, TOGS.

[8]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  Taku Komura,et al.  Simulating Multiple Character Interactions with Collaborative and Adversarial Goals , 2012, IEEE Transactions on Visualization and Computer Graphics.

[10]  Marco da Silva,et al.  Interactive simulation of stylized human locomotion , 2008, ACM Trans. Graph..

[11]  Abderrahmane Kheddar,et al.  Humanoid Robot Locomotion and Manipulation Step Planning , 2012, Adv. Robotics.

[12]  KangKang Yin,et al.  SIMBICON: simple biped locomotion control , 2007, ACM Trans. Graph..

[13]  Abderrahmane Kheddar,et al.  Multi-contact stances planning for multiple agents , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Jovan Popovic,et al.  Multiobjective control with frictional contacts , 2007, SCA '07.

[15]  C. Karen Liu,et al.  Animating human dressing , 2015, ACM Trans. Graph..

[16]  Katsu Yamane,et al.  Synthesizing animations of human manipulation tasks , 2004, ACM Trans. Graph..

[17]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[18]  Sylvain Miossec,et al.  A Strictly Convex Hull for Computing Proximity Distances With Continuous Gradients , 2014, IEEE Transactions on Robotics.

[19]  P. Gill,et al.  Fortran package for constrained linear least-squares and convex quadratic programming. User's Guide for LSSOL (Version 1. 0) , 1986 .

[20]  Edmond S. L. Ho,et al.  Spatial relationship preserving character motion adaptation , 2010, ACM Trans. Graph..

[21]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[22]  C. Karen Liu,et al.  Optimization-based interactive motion synthesis , 2009, ACM Trans. Graph..

[23]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[24]  Zoran Popovic,et al.  Contact-invariant optimization for hand manipulation , 2012, SCA '12.

[25]  Roy Featherstone,et al.  Rigid Body Dynamics Algorithms , 2007 .

[26]  Mitsuharu Morisawa,et al.  Humanoid robot HRP-4 - Humanoid robotics platform with lightweight and slim body , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[28]  C. Karen Liu,et al.  Dextrous manipulation from a grasping pose , 2009, ACM Trans. Graph..

[29]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[30]  B. Faverjon,et al.  A local based approach for path planning of manipulators with a high number of degrees of freedom , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[31]  Jessica K. Hodgins,et al.  Animation of dynamic legged locomotion , 1991, SIGGRAPH.

[32]  Oussama Khatib,et al.  Synthesis of Whole-Body Behaviors through Hierarchical Control of Behavioral Primitives , 2005, Int. J. Humanoid Robotics.

[33]  Evan Herbst,et al.  Character animation in two-player adversarial games , 2010, TOGS.

[34]  Martin de Lasa,et al.  Robust physics-based locomotion using low-dimensional planning , 2010, ACM Trans. Graph..

[35]  C. Karen Liu,et al.  Composition of complex optimal multi-character motions , 2006, SCA '06.

[36]  Aaron Hertzmann,et al.  Robust physics-based locomotion using low-dimensional planning , 2010, SIGGRAPH 2010.

[37]  Tong-Yee Lee,et al.  Real-Time Physics-Based 3D Biped Character Animation Using an Inverted Pendulum Model , 2010, IEEE Transactions on Visualization and Computer Graphics.

[38]  Aaron Hertzmann,et al.  Trajectory Optimization for Full-Body Movements with Complex Contacts , 2013, IEEE Transactions on Visualization and Computer Graphics.

[39]  Eiichi Yoshida,et al.  Model preview control in multi-contact motion-application to a humanoid robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[41]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[42]  Daniel Thalmann,et al.  Accurate on-line avatar control with collision anticipation , 2007, VRST '07.

[43]  Eiichi Yoshida,et al.  A Local Collision Avoidance Method for Non-strictly Convex Polyhedra , 2008, Robotics: Science and Systems.

[44]  A. Liegeois,et al.  Automatic supervisory control of the configuration and behavior of multi-body mechanisms , 1977 .

[45]  Jean-Claude Latombe,et al.  Planning motions with intentions , 1994, SIGGRAPH.

[46]  Abderrahmane Kheddar,et al.  Static multi-contact inverse problem for multiple humanoid robots and manipulated objects , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[47]  Jovan Popovic,et al.  Interactive animation of dynamic manipulation , 2006, SCA '06.

[48]  Eugene Fiume,et al.  Feedback control for rotational movements in feature space , 2014, Comput. Graph. Forum.

[49]  Victor B. Zordan,et al.  Momentum control for balance , 2009, ACM Trans. Graph..