Physical Human Interactive Guidance: Identifying Grasping Principles From Human-Planned Grasps

We present a novel and simple experimental method called physical human interactive guidance to study human-planned grasping. Instead of studying how the human uses his/her own biological hand or how a human teleoperates a robot hand in a grasping task, the method involves a human interacting physically with a robot arm and hand, carefully moving and guiding the robot into the grasping pose, while the robot's configuration is recorded. Analysis of the grasps from this simple method has produced two interesting results. First, the grasps produced by this method perform better than grasps generated through a state-of-the-art automated grasp planner. Second, this method when combined with a detailed statistical analysis using a variety of grasp measures (physics-based heuristics considered critical for a good grasp) offered insights into how the human grasping method is similar or different from automated grasping synthesis techniques. Specifically, data from the physical human interactive guidance method showed that the human-planned grasping method provides grasps that are similar to grasps from a state-of-the-art automated grasp planner, but differed in one key aspect. The robot wrists were aligned with the object's principal axes in the human-planned grasps (termed low skewness in this paper), while the automated grasps used arbitrary wrist orientation. Preliminary tests show that grasps with low skewness were significantly more robust than grasps with high skewness (77-93%). We conclude with a detailed discussion of how the physical human interactive guidance method relates to existing methods to extract the human principles for physical interaction.

[1]  Matei T. Ciocarlie,et al.  On-Line Interactive Dexterous Grasping , 2008, EuroHaptics.

[2]  John F. Canny,et al.  Easily computable optimum grasps in 2-D and 3-D , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[4]  Sahan Gamage,et al.  New least squares solutions for estimating the average centre of rotation and the axis of rotation. , 2002, Journal of biomechanics.

[5]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[6]  Makiko Kouchi,et al.  Modeling of human hand link structure from optical motion capture data , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  Mark R. Cutkosky,et al.  Calibration and Mapping of a Human Hand for Dexterous Telemanipulation , 2000, Dynamic Systems and Control: Volume 2.

[8]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[9]  Marco Santello,et al.  Choice of Contact Points during Multidigit Grasping: Effect of Predictability of Object Center of Mass Location , 2007, The Journal of Neuroscience.

[10]  Gary M. Bone,et al.  Multi-metric comparison of optimal 2D grasp planning algorithms , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[11]  Dinesh K. Pai,et al.  Model-based telerobotics with vision , 1997, Proceedings of International Conference on Robotics and Automation.

[12]  Scott H. Johnson-Frey What's So Special about Human Tool Use? , 2003, Neuron.

[13]  David G. Kirkpatrick,et al.  Quantitative Steinitz's theorems with applications to multifingered grasping , 1990, STOC '90.

[14]  Christopher H. Lee,et al.  Learning Reduced-Dimension Models of Human Actions , 2000 .

[15]  S. Vogt,et al.  Vision of the hand and environmental context in human prehension , 2000, Experimental Brain Research.

[16]  George D. Stetten,et al.  Optical merger of direct vision with virtual images for scaled teleoperation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[17]  Ling Xu,et al.  Human-guided grasp measures improve grasp robustness on physical robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[18]  Mark L Latash,et al.  Multifinger Prehension: An Overview , 2008, Journal of motor behavior.

[19]  Karun B. Shimoga,et al.  Robot Grasp Synthesis Algorithms: A Survey , 1996, Int. J. Robotics Res..

[20]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[21]  Jean Ponce,et al.  On computing three-finger force-closure grasps of polygonal objects , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[22]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[23]  Yangsheng Xu,et al.  Reduced-dimension representations of human performance data for human-to-robot skill transfer , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[24]  Medhat A. Moussa,et al.  An Integrated System for User-Adaptive Robotic Grasping , 2010, IEEE Transactions on Robotics.

[25]  T. Flash,et al.  Task-Dependent Selection of Grasp Kinematics and Stiffness in Human Object Manipulation , 2007, Cortex.

[26]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[27]  Joshua R. Smith,et al.  Electric Field Servoing for robotic manipulation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Antonio Morales,et al.  An active learning approach for assessing robot grasp reliability , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[29]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[30]  Roberta L Klatzky,et al.  Selection Criteria for Preparatory Object Rotation in Manual Lifting Actions , 2009, Journal of motor behavior.

[31]  Lawson L. S. Wong,et al.  Learning Grasp Strategies with Partial Shape Information , 2008, AAAI.

[32]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[33]  Paul Ciprian Patic,et al.  THE BARRETTHAND GRASPER - PROGRAMMABLY FLEXIBLE PART HANDLING AND ASSEMBLY , 2006 .

[34]  R. Cohen,et al.  Where grasps are made reveals how grasps are planned: generation and recall of motor plans , 2004, Experimental Brain Research.

[35]  R. Johansson,et al.  Factors influencing the force control during precision grip , 2004, Experimental Brain Research.

[36]  Michael I. Jordan,et al.  Perceptual distortion contributes to the curvature of human reaching movements , 1994, Experimental Brain Research.

[37]  Robert B. Fisher,et al.  Visual quality measures for Characterizing Planar robot grasps , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[38]  Tadej Bajd,et al.  Assessment of human hand kinematics , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[39]  D. Hoffman,et al.  Muscle and movement representations in the primary motor cortex. , 1999, Science.

[40]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[41]  Yoky Matsuoka,et al.  A kinematic thumb model for the ACT hand , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[42]  A. Landi Human Hand Function , 2007 .

[43]  Peter K. Allen,et al.  Examples of 3D grasp quality computations , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[44]  H. Stern,et al.  Virtual Reality Telerobotic System , 2004 .

[45]  Lillian Y. Chang,et al.  Constrained least-squares optimization for robust estimation of center of rotation. , 2007, Journal of biomechanics.

[46]  Matei T. Ciocarlie,et al.  The Columbia grasp database , 2009, 2009 IEEE International Conference on Robotics and Automation.