On the choice of grasp type and location when handing over an object

During a handover, passers prefer precision grasps and grasp purposive parts of objects, leaving “handles” free for receivers. The human hand is capable of performing countless grasps and gestures that are the basis for social activities. However, which grasps contribute the most to the manipulation skills needed during collaborative tasks, and thus which grasps should be included in a robot companion, is still an open issue. Here, we investigated grasp choice and hand placement on objects during a handover when subsequent tasks are performed by the receiver and when in-hand and bimanual manipulation are not allowed. Our findings suggest that, in this scenario, human passers favor precision grasps during such handovers. Passers also tend to grasp the purposive part of objects and leave “handles” unobstructed to the receivers. Intuitively, this choice allows receivers to comfortably perform subsequent tasks with the objects. In practice, many factors contribute to a choice of grasp, e.g., object and task constraints. However, not all of these factors have had enough emphasis in the implementation of grasping by robots, particularly the constraints introduced by a task, which are critical to the success of a handover. Successful robotic grasping is important if robots are to help humans with tasks. We believe that the results of this work can benefit the wider robotics community, with applications ranging from industrial cooperative manipulation to household collaborative manipulation.

[1]  U. Castiello,et al.  Both your intention and mine are reflected in the kinematics of my reach-to-grasp movement , 2008, Cognition.

[2]  Sergey Levine,et al.  Learning Hand-Eye Coordination for Robotic Grasping with Large-Scale Data Collection , 2016, ISER.

[3]  N. Kamakura,et al.  Patterns of static prehension in normal hands. , 1980, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[4]  Marco Santello,et al.  Choice of Contact Points during Multidigit Grasping: Effect of Predictability of Object Center of Mass Location , 2007, The Journal of Neuroscience.

[5]  Peter Corke,et al.  Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approach , 2018, Robotics: Science and Systems.

[6]  W. Davis The Ecological Approach to Visual Perception , 2012 .

[7]  J. Sancho-Bru,et al.  An introductory study of common grasps used by adults during performance of activities of daily living. , 2014, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[8]  M. Santello,et al.  Effects of end-goal on hand shaping. , 2006, Journal of neurophysiology.

[9]  A. Chemero An Outline of a Theory of Affordances , 2003, How Shall Affordances be Refined? Four Perspectives.

[10]  Siddhartha S. Srinivasa,et al.  Learning the communication of intent prior to physical collaboration , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[11]  Karon E. MacLean,et al.  Meet Me where I’m Gazing: How Shared Attention Gaze Affects Human-Robot Handover Timing , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[12]  Danica Kragic,et al.  Learning Human Priors for Task-Constrained Grasping , 2015, ICVS.

[13]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[14]  Thea Iberall,et al.  Human Prehension and Dexterous Robot Hands , 1997, Int. J. Robotics Res..

[15]  Siddhartha S. Srinivasa,et al.  Predictability or adaptivity? Designing robot handoffs modeled from trained dogs and people , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Thea Iberall,et al.  The nature of human prehension: Three dextrous hands in one , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[17]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[18]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[19]  J. Landsmeer Power Grip and Precision Handling , 1962, Annals of the rheumatic diseases.

[20]  Wael Bachta,et al.  Analysis of Hand Contact Areas and Interaction Capabilities During Manipulation and Exploration , 2014, IEEE Transactions on Haptics.

[21]  Anthony G. Pipe,et al.  Joint action understanding improves robot-to-human object handover , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Trevor Darrell,et al.  Learning to Detect Visual Grasp Affordance , 2016, IEEE Transactions on Automation Science and Engineering.

[23]  Elizabeth A. Croft,et al.  Grip forces and load forces in handovers: Implications for designing human-robot handover controllers , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Siddhartha S. Srinivasa,et al.  Human preferences for robot-human hand-over configurations , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[26]  Larry H. Matthies,et al.  Task-oriented grasping with semantic and geometric scene understanding , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Eraldo Paulesu,et al.  Evidence for a dyadic motor plan in joint action , 2018, Scientific Reports.

[28]  J. Napier The prehensile movements of the human hand. , 1956, The Journal of bone and joint surgery. British volume.

[29]  Elizabeth A. Croft,et al.  A human-inspired object handover controller , 2013, Int. J. Robotics Res..

[30]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[31]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[32]  Aaron M. Dollar,et al.  Analysis of Human Grasping Behavior: Correlating Tasks, Objects and Grasps , 2014, IEEE Transactions on Haptics.

[33]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[34]  K. J. Cole,et al.  Sensory-motor coordination during grasping and manipulative actions , 1992, Current Biology.

[35]  U. Castiello,et al.  How Objects Are Grasped: The Interplay between Affordances and End-Goals , 2011, PloS one.

[36]  Siddhartha S. Srinivasa,et al.  Using spatial and temporal contrast for fluent robot-human hand-overs , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[37]  Rachid Alami,et al.  Exploratory Study of a Robot Approaching a Person in the Context of Handing Over an Object , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[38]  Danica Kragic,et al.  Affordance detection for task-specific grasping using deep learning , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[39]  Aaron M. Dollar,et al.  Analysis of Human Grasping Behavior: Object Characteristics and Grasp Type , 2014, IEEE Transactions on Haptics.

[40]  Andrea H. Mason,et al.  Grip forces when passing an object to a partner , 2005, Experimental Brain Research.

[41]  Hussein A. Abdullah,et al.  A Slip Detection and Correction Strategy for Precision Robot Grasping , 2016, IEEE/ASME Transactions on Mechatronics.

[42]  F. Osiurak,et al.  Grasping the affordances, understanding the reasoning: toward a dialectical theory of human tool use. , 2010, Psychological review.

[43]  Manuel Lopes,et al.  Learning Object Affordances: From Sensory--Motor Coordination to Imitation , 2008, IEEE Transactions on Robotics.

[44]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[45]  Abhinav Gupta,et al.  Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[46]  Ed Symes,et al.  Visual object affordances: object orientation. , 2007, Acta psychologica.

[47]  Siddhartha S. Srinivasa,et al.  Toward seamless human-robot handovers , 2013, Journal of Human-Robot Interaction.

[48]  Michael Goldfarb,et al.  A Multigrasp Hand Prosthesis for Providing Precision and Conformal Grasps , 2015, IEEE/ASME Transactions on Mechatronics.

[49]  Luca Turella,et al.  An object for an action, the same object for other actions: effects on hand shaping , 2008, Experimental Brain Research.

[50]  Aaron M. Dollar,et al.  A Hand-Centric Classification of Human and Robot Dexterous Manipulation , 2013, IEEE Transactions on Haptics.

[51]  Rachid Alami,et al.  Physiological and subjective evaluation of a human-robot object hand-over task. , 2011, Applied ergonomics.

[52]  Elizabeth A. Croft,et al.  Exploration of geometry and forces occurring within human-to-robot handovers , 2018, 2018 IEEE Haptics Symposium (HAPTICS).

[53]  D. Araújo,et al.  Affordances can invite behavior: Reconsidering the relationship between affordances and agency , 2012 .

[54]  Nikolaos G. Tsagarakis,et al.  Detecting object affordances with Convolutional Neural Networks , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[55]  R. Johansson,et al.  Tactile sensory coding in the glabrous skin of the human hand , 1983, Trends in Neurosciences.

[56]  R. Johansson,et al.  Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. , 1984, Human neurobiology.

[57]  Danica Kragic,et al.  Multivariate discretization for Bayesian Network structure learning in robot grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[58]  Sandra Hirche,et al.  Investigating Human-Human Approach and Hand-Over , 2009, Human Centered Robot Systems, Cognition, Interaction, Technology.