Interactive synthesis of human-object interaction

We present an interactive motion editing tool for creating dynamic scenes with human and object interaction. Our approach solves for an optimal control problem that leverages methods for physics-based rigid body control and kinematics-based human motion editing. Because the humans and the objects are coupled via physical contacts, our interface allows the animator to directly change the trajectories of humans or objects and simultaneously render the effect of the edits on the entire scene. Consequently, the animator can efficiently create complex interaction that requires precise synchronization, such as juggling. Our framework is generic to the choice of human motion editing method, as long as the differential information of the motion can be computed.

[1]  David A. Forsyth,et al.  Pushing people around , 2005, SCA '05.

[2]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[3]  Greg Turk,et al.  Keyframe control of complex particle systems using the adjoint method , 2006, SCA '06.

[4]  Steven M. Seitz,et al.  Interactive manipulation of rigid body simulations , 2000, SIGGRAPH.

[5]  David Baraff,et al.  Analytical methods for dynamic simulation of non-penetrating rigid bodies , 1989, SIGGRAPH.

[6]  Dani Lischinski,et al.  Target-driven smoke animation , 2004, ACM Trans. Graph..

[7]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[8]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[9]  Jean-Claude Latombe,et al.  Planning motions with intentions , 1994, SIGGRAPH.

[10]  Jernej Barbic,et al.  Real-time control of physically based simulations using gentle forces , 2008, ACM Trans. Graph..

[11]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, SIGGRAPH '05.

[12]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[13]  David Baraff,et al.  Coping with friction for non-penetrating rigid body simulation , 1991, SIGGRAPH.

[14]  R. L. Andersson Dynamic sensing in a ping-pong playing robot , 1989, IEEE Trans. Robotics Autom..

[15]  Adrien Treuille,et al.  Keyframe control of smoke simulations , 2003, ACM Trans. Graph..

[16]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[17]  Jovan Popovic,et al.  Interactive animation of dynamic manipulation , 2006, SCA '06.

[18]  Jehee Lee,et al.  Motion patches: building blocks for virtual environments annotated with motion data , 2006, ACM Trans. Graph..

[19]  Katsu Yamane,et al.  Synthesizing animations of human manipulation tasks , 2004, ACM Trans. Graph..

[20]  Oussama Khatib,et al.  Synthesis of Whole-Body Behaviors through Hierarchical Control of Behavioral Primitives , 2005, Int. J. Humanoid Robotics.

[21]  Daniel E. Koditschek,et al.  Further progress in robot juggling: solvable mirror laws , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[22]  Jehee Lee,et al.  Motion patches: buildings blocks for virtual environments annotated with motion data , 2005, SIGGRAPH 2005.

[23]  Dinesh K. Pai,et al.  Data-driven Interactive Balancing Behaviors , 2005 .

[24]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[25]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[26]  Doug L. James,et al.  Backward steps in rigid body simulation , 2008, SIGGRAPH 2008.

[27]  Stefan Schaal,et al.  Open loop stable control strategies for robot juggling , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[28]  Taku Komura,et al.  Interaction patches for multi-character animation , 2008, ACM Trans. Graph..

[29]  Victor B. Zordan,et al.  Dynamic response for motion capture animation , 2005, SIGGRAPH '05.

[30]  Jehee Lee,et al.  Synchronized multi-character motion editing , 2009, ACM Trans. Graph..

[31]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[32]  Doug L. James,et al.  Backward steps in rigid body simulation , 2008, ACM Trans. Graph..

[33]  Steven M. Seitz,et al.  Interactive design of rigid-body simulations for computer animation , 2001 .

[34]  David J. Reinkensmeyer,et al.  Task-Level Robot Learning: Ball Throwing , 1987 .