Physical Human Interactive Guidance: Identifying Grasping Principles From Human-Planned Grasps

We present a novel and simple experimental method called physical human interactive guidance to study human-planned grasping. Instead of studying how the human uses his/her own biological hand or how a human teleoperates a robot hand in a grasping task, the method involves a human interacting physically with a robot arm and hand, carefully moving and guiding the robot into the grasping pose, while the robot's configuration is recorded. Analysis of the grasps from this simple method has produced two interesting results. First, the grasps produced by this method perform better than grasps generated through a state-of-the-art automated grasp planner. Second, this method when combined with a detailed statistical analysis using a variety of grasp measures (physics-based heuristics considered critical for a good grasp) offered insights into how the human grasping method is similar or different from automated grasping synthesis techniques. Specifically, data from the physical human interactive guidance method showed that the human-planned grasping method provides grasps that are similar to grasps from a state-of-the-art automated grasp planner, but differed in one key aspect. The robot wrists were aligned with the object's principal axes in the human-planned grasps (termed low skewness in this paper), while the automated grasps used arbitrary wrist orientation. Preliminary tests show that grasps with low skewness were significantly more robust than grasps with high skewness (77-93%). We conclude with a detailed discussion of how the physical human interactive guidance method relates to existing methods to extract the human principles for physical interaction.

[1]  S. Shankar Sastry,et al.  Task-oriented optimal grasping by multifingered robot hands , 1987, IEEE J. Robotics Autom..

[2]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[3]  Jean Ponce,et al.  On computing three-finger force-closure grasps of polygonal objects , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[4]  David G. Kirkpatrick,et al.  Quantitative Steinitz's theorems with applications to multifingered grasping , 1990, STOC '90.

[5]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[6]  John F. Canny,et al.  Easily computable optimum grasps in 2-D and 3-D , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[7]  Karun B. Shimoga,et al.  Robot Grasp Synthesis Algorithms: A Survey , 1996, Int. J. Robotics Res..

[8]  Dinesh K. Pai,et al.  Model-based telerobotics with vision , 1997, Proceedings of International Conference on Robotics and Automation.

[9]  Yangsheng Xu,et al.  Reduced-dimension representations of human performance data for human-to-robot skill transfer , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[10]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[11]  D. Hoffman,et al.  Muscle and movement representations in the primary motor cortex. , 1999, Science.

[12]  Peter K. Allen,et al.  Examples of 3D grasp quality computations , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[13]  William Townsend,et al.  The BarrettHand grasper – programmably flexible part handling and assembly , 2000 .

[14]  S. Vogt,et al.  Vision of the hand and environmental context in human prehension , 2000, Experimental Brain Research.

[15]  Gary M. Bone,et al.  Multi-metric comparison of optimal 2D grasp planning algorithms , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[16]  Sahan Gamage,et al.  New least squares solutions for estimating the average centre of rotation and the axis of rotation. , 2002, Journal of biomechanics.

[17]  Scott H. Johnson-Frey What's So Special about Human Tool Use? , 2003, Neuron.

[18]  Makiko Kouchi,et al.  Modeling of human hand link structure from optical motion capture data , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[19]  R. Cohen,et al.  Where grasps are made reveals how grasps are planned: generation and recall of motor plans , 2004, Experimental Brain Research.

[20]  Michael I. Jordan,et al.  Perceptual distortion contributes to the curvature of human reaching movements , 1994, Experimental Brain Research.

[21]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[22]  Antonio Morales,et al.  An active learning approach for assessing robot grasp reliability , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[23]  R. Johansson,et al.  Factors influencing the force control during precision grip , 2004, Experimental Brain Research.

[24]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[25]  Robert B. Fisher,et al.  Visual quality measures for Characterizing Planar robot grasps , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[26]  S. Lederman,et al.  Human Hand Function , 2006 .

[27]  George D. Stetten,et al.  Optical merger of direct vision with virtual images for scaled teleoperation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[28]  Yoky Matsuoka,et al.  A kinematic thumb model for the ACT hand , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[29]  Tadej Bajd,et al.  Assessment of human hand kinematics , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[30]  Marco Santello,et al.  Choice of Contact Points during Multidigit Grasping: Effect of Predictability of Object Center of Mass Location , 2007, The Journal of Neuroscience.

[31]  Lillian Y. Chang,et al.  Constrained least-squares optimization for robust estimation of center of rotation. , 2007, Journal of biomechanics.

[32]  T. Flash,et al.  Task-Dependent Selection of Grasp Kinematics and Stiffness in Human Object Manipulation , 2007, Cortex.

[33]  Matei T. Ciocarlie,et al.  On-Line Interactive Dexterous Grasping , 2008, EuroHaptics.

[34]  Mark L Latash,et al.  Multifinger Prehension: An Overview , 2008, Journal of motor behavior.

[35]  Lawson L. S. Wong,et al.  Learning Grasp Strategies with Partial Shape Information , 2008, AAAI.

[36]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[37]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[38]  Joshua R. Smith,et al.  Electric Field Servoing for robotic manipulation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Matei T. Ciocarlie,et al.  The Columbia grasp database , 2009, 2009 IEEE International Conference on Robotics and Automation.

[40]  Roberta L Klatzky,et al.  Selection Criteria for Preparatory Object Rotation in Manual Lifting Actions , 2009, Journal of motor behavior.

[41]  Ling Xu,et al.  Human-guided grasp measures improve grasp robustness on physical robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[42]  Medhat A. Moussa,et al.  An Integrated System for User-Adaptive Robotic Grasping , 2010, IEEE Transactions on Robotics.

[43]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[44]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.