Synthesis of interactive hand manipulation

We present an interactive physics-based motion synthesis technique for creating hand manipulation across a wide variety of tasks, objects, user interventions, and stylistic preferences. Given an object being manipulated, a single pose specifying the desired initial contact, and the kinematic goals of the manipulation, our algorithm automatically generates hand-object manipulation that is responsive to unscripted external disturbances. Our algorithm simulates the dynamic coupling between a passive dynamic system and an active dynamic system by formulating a sequence of constrained optimizations. This formulation allows the user to synthesize a manipulation task by describing simple, keyframe-like kinematic goals in the domain of object configuration. The algorithm will automatically produce the hand motion that achieves the kinematic goals via coupled dynamic equations of motion.

[1]  Thea Iberall,et al.  Human Prehension and Dexterous Robot Hands , 1997, Int. J. Robotics Res..

[2]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[3]  R. Howe,et al.  Identification of the mechanical impedance at the human finger tip. , 1997, Journal of biomechanical engineering.

[4]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, SIGGRAPH 2005.

[5]  E. Bizzi,et al.  Human arm trajectory formation. , 1982, Brain : a journal of neurology.

[6]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[7]  C. Atkeson,et al.  Kinematic features of unrestrained vertical arm movements , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  C. D. Albert,et al.  Kinematics of machinery , 1931 .

[9]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[10]  Yoshihito Koga,et al.  On computing multi-arm manipulation trajectories , 1994 .

[11]  Jean-Claude Latombe,et al.  Planning motions with intentions , 1994, SIGGRAPH.

[12]  Sharon A. Stansfield,et al.  Robotic Grasping of Unknown Objects: A Knowledge-based Approach , 1991, Int. J. Robotics Res..

[13]  Hans-Peter Seidel,et al.  Construction and animation of anatomically based human hand models , 2003, SCA '03.

[14]  Daniel Thalmann,et al.  A Multi-sensor Approach for Grasping and 3D Interaction , 1995, Computer Graphics.

[15]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, ACM Trans. Graph..

[16]  Andrew P. Witkin,et al.  Dynamic simulation of non-penetrating flexible bodies , 1992, SIGGRAPH.

[17]  Victor B. Zordan,et al.  Physically based grasping control from example , 2005, SCA '05.

[18]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Eugene Fiume,et al.  Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion , 2005, SCA '05.

[20]  Jean-Claude Latombe,et al.  Interactive manipulation planning for animated characters , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[21]  Katsu Yamane,et al.  Synthesizing animations of human manipulation tasks , 2004, ACM Trans. Graph..

[22]  Huan Liu,et al.  Knowledge-based control of grasping in robot hands using heuristics from human motor skills , 1993, IEEE Trans. Robotics Autom..

[23]  Karan Singh,et al.  Eurographics/siggraph Symposium on Computer Animation (2003) Handrix: Animating the Human Hand , 2003 .

[24]  Thea Iberall,et al.  Dextrous robot hands , 1990 .

[25]  Masayuki Nakajima,et al.  Database guided computer animation of human grasping using forward and inverse kinematics , 1999, Comput. Graph..

[26]  Hideki Hashimoto,et al.  Dextrous hand grasping force optimization , 1996, IEEE Trans. Robotics Autom..

[27]  Katsu Yamane,et al.  Synthesizing animations of human manipulation tasks , 2004, SIGGRAPH 2004.

[28]  Franz Reuleaux,et al.  The Kinematics of Machinery , 2016, Nature.

[29]  Nadia Magnenat-Thalmann,et al.  Neural network-based violinist's hand animation , 2000, Proceedings Computer Graphics International 2000.

[30]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..