Animal Locomotion Controllers From Scratch

There exists a large body of research devoted to creating real time interactive locomotion controllers which are targeted at some specific class of character, most often humanoid bipeds. Relatively little work, however, has been done on approaches which are applicable to creatures with a wide range of different forms – partially due to the lack of easily obtainable motion‐capture data for animals and fictional creatures. We show how a locomotion controller can be created despite this dearth of data by synthesizing it from scratch. Our method only requires as input a description of the shape of the animal, the gaits which it can perform, and a model of the task or tasks for which the controller will be used. From this a sequence of motion clips are automatically synthesized and assembled into a motion graph which defines a physically realistic controller capable of performing the specified tasks. The method attempts to minimize the computational time required to generate this controller and we show its effectiveness at creating interactive controllers for a range of tasks for bipeds, tripeds, and quadrupeds.

[1]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[2]  Jessica K. Hodgins,et al.  Animation of dynamic legged locomotion , 1991, SIGGRAPH.

[3]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[4]  Geoffrey J. Gordon Stable Function Approximation in Dynamic Programming , 1995, ICML.

[5]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[6]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[7]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[8]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[9]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[10]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[12]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[13]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[14]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[15]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[16]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[17]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[18]  Jehee Lee,et al.  Precomputing avatar behavior from human motion data , 2004, SCA '04.

[19]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[20]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[21]  Manfred Lau,et al.  Behavior planning for character animation , 2005, SCA '05.

[22]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[23]  Hyun Joon Shin,et al.  Fat graphs: constructing an interactive character with continuous controls , 2006, SCA '06.

[24]  Z. Popovic,et al.  Near-optimal character animation with continuous control , 2007, ACM Trans. Graph..

[25]  Nancy S. Pollard,et al.  To appear in the ACM SIGGRAPH conference proceedings Responsive Characters from Motion Fragments , 2022 .

[26]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[27]  Kwang Won Sok,et al.  Simulating biped behaviors from human motion data , 2007, ACM Trans. Graph..

[28]  Michael Gleicher,et al.  Parametric motion graphs , 2007, SI3D.

[29]  Chris Hecker,et al.  Real-time motion retargeting to highly varied user-created morphologies , 2008, ACM Trans. Graph..

[30]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[31]  Matthias Zwicker,et al.  Real-time planning for parameterized human motion , 2008, SCA '08.

[32]  Philippe Beaudoin,et al.  Synthesis of constrained walking skills , 2008, SIGGRAPH Asia '08.

[33]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[34]  Zoran Popovic,et al.  Optimal gait and form for animal locomotion , 2009, ACM Trans. Graph..

[35]  Philippe Beaudoin,et al.  Robust task-based control policies for physics-based characters , 2009, ACM Trans. Graph..

[36]  Zoran Popovic,et al.  Compact character controllers , 2009, ACM Trans. Graph..

[37]  M. van de Panne,et al.  Generalized biped walking control , 2010, ACM Trans. Graph..

[38]  Zoran Popović,et al.  Terrain-adaptive bipedal locomotion control , 2010, SIGGRAPH 2010.

[39]  Alla Safonova,et al.  Human Motion Synthesis with Optimization‐based Graphs , 2010, Comput. Graph. Forum.

[40]  Martin de Lasa,et al.  Feature-based locomotion controllers , 2010, ACM Trans. Graph..

[41]  M. V. D. Panne,et al.  Sampling-based contact-rich motion control , 2010, ACM Trans. Graph..

[42]  Martin de Lasa,et al.  Robust physics-based locomotion using low-dimensional planning , 2010, ACM Trans. Graph..

[43]  Z. Popovic,et al.  Terrain-adaptive bipedal locomotion control , 2010, ACM Trans. Graph..

[44]  A. Karpathy,et al.  Locomotion skills for simulated quadrupeds , 2011, SIGGRAPH 2011.

[45]  Sergey Levine,et al.  Continuous character control with low-dimensional embeddings , 2012, ACM Trans. Graph..

[46]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[47]  Vladlen Koltun,et al.  Optimizing locomotion controllers using biologically-based actuators and objectives , 2012, ACM Trans. Graph..

[48]  Joaquim B. Cavalcante Neto,et al.  Using natural vibrations to guide control for locomotion , 2012, I3D '12.

[49]  Zoran Popovic,et al.  Motion fields for interactive character locomotion , 2010, CACM.