Robust realtime physics-based motion control for human grasping

This paper presents a robust physics-based motion control system for realtime synthesis of human grasping. Given an object to be grasped, our system automatically computes physics-based motion control that advances the simulation to achieve realistic manipulation with the object. Our solution leverages prerecorded motion data and physics-based simulation for human grasping. We first introduce a data-driven synthesis algorithm that utilizes large sets of prerecorded motion data to generate realistic motions for human grasping. Next, we present an online physics-based motion control algorithm to transform the synthesized kinematic motion into a physically realistic one. In addition, we develop a performance interface for human grasping that allows the user to act out the desired grasping motion in front of a single Kinect camera. We demonstrate the power of our approach by generating physics-based motion control for grasping objects with different properties such as shapes, weights, spatial orientations, and frictions. We show our physics-based motion control for human grasping is robust to external perturbations and changes in physical quantities.

[1]  Christopher M. Bishop,et al.  Neural Network for Pattern Recognition , 1995 .

[2]  Heni Ben Amor,et al.  Grasp synthesis from low‐dimensional probabilistic grasp models , 2008, Comput. Animat. Virtual Worlds.

[3]  Ying Li,et al.  Data-Driven Grasp Synthesis Using Shape Matching and Task-Based Pruning , 2007, IEEE Transactions on Visualization and Computer Graphics.

[4]  Peter K. Allen,et al.  Examples of 3D grasp quality computations , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[5]  Daniel Thalmann,et al.  A Hand Control and Automatic Grasping System for Synthetic Actors , 1994, Comput. Graph. Forum.

[6]  Zoran Popovic,et al.  Contact-invariant optimization for hand manipulation , 2012, SCA '12.

[7]  Fumihito Kyota,et al.  Fast Grasp Synthesis for Various Shaped Objects , 2012, Comput. Graph. Forum.

[8]  Henrik I. Christensen,et al.  Automatic grasp planning using shape primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[10]  Raúl Suárez Feijóo,et al.  Grasp quality measures , 2006 .

[11]  Michael Girard,et al.  Computer animation of knowledge-based human grasping , 1991, SIGGRAPH.

[12]  Yen-Lin Chen,et al.  Interactive generation of human animation with deformable motion models , 2009, TOGS.

[13]  Jinxiang Chai,et al.  Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data , 2012, SCA '12.

[14]  Karan Singh,et al.  Eurographics/siggraph Symposium on Computer Animation (2003) Handrix: Animating the Human Hand , 2003 .

[15]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[16]  Qionghai Dai,et al.  Video-based hand manipulation capture through composite motion control , 2013, ACM Trans. Graph..

[17]  Victor B. Zordan,et al.  Physically based grasping control from example , 2005, SCA '05.

[18]  C. Karen Liu.  Dextrous manipulation from a grasping pose , 2009, SIGGRAPH 2009.

[19]  Nancy S. Pollard,et al.  Closure and Quality Equivalence for Efficient Synthesis of Grasps from Examples , 2004, Int. J. Robotics Res..

[20]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, ACM Trans. Graph..

[21]  C. Karen Liu,et al.  Synthesis of detailed hand manipulations using contact sampling , 2012, ACM Trans. Graph..

[22]  Jessica K. Hodgins,et al.  Data-driven finger motion synthesis for gesturing characters , 2012, ACM Trans. Graph..

[23]  Jakob Andreas Bærentzen,et al.  Signed Distance Computation Using the Angle Weighted Pseudonormal , 2005, IEEE Trans. Vis. Comput. Graph..

[24]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, SIGGRAPH 2005.

[25]  C. Karen Liu,et al.  Dextrous manipulation from a grasping pose , 2009, ACM Trans. Graph..

[26]  J. Baerentzen,et al.  Signed distance computation using the angle weighted pseudonormal , 2005, IEEE Transactions on Visualization and Computer Graphics.

[27]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[28]  Sung-Hee Lee,et al.  Ground reaction force control at each foot: A momentum-based humanoid balance controller for non-level and non-stationary ground , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Nancy S. Pollard,et al.  Animation of Humanlike Characters: Dynamic Motion Filtering with a Physically Plausible Contact Model , 2001 .

[30]  C. Karen Liu,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2008) Synthesis of Interactive Hand Manipulation , 2022 .

[31]  Antonis A. Argyros,et al.  Efficient model-based 3D tracking of hand articulations using Kinect , 2011, BMVC.