Touch-Based Grasp Primitives for Soft Hands: Applications to Human-to-Robot Handover Tasks and Beyond

Recently, the avenue of adaptable, soft robotic hands has opened simplified opportunities to grasp different items; however, the potential of soft end effectors (SEEs) is still largely unexplored, especially in human-robot interaction. In this paper, we propose, for the first time, a simple touch-based approach to endow a SEE with autonomous grasp sensory-motor primitives, in response to an item passed to the robot by a human (human-to-robot handover). We capitalize on human inspiration and minimalistic sensing, while hand adaptability is exploited to generalize grasp response to different objects. We consider the Pisa/IIT SoftHand (SH), an under-actuated soft anthropomorphic robotic hand, which is mounted on a robotic arm and equipped with Inertial Measurement Units (IMUs) on the fingertips. These sensors detect the accelerations arisen from contact with external items. In response to a contact, the hand pose and closure are planned for grasping, by executing arm motions with hand closure commands. We generate these motions from human wrist poses acquired from a human maneuvering the SH to grasp an object from a table. We obtained 86% of successful grasps, considering many objects passed to the SH in different manners. We also tested our techniques in preliminary experiments, where the robot moved to autonomously grasp objects from a surface. Results are positive and open interesting perspectives for soft robotic manipulation.

[1]  Florian Schmidt,et al.  Making planned paths look more human-like in humanoid robot manipulation planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Gaurav S. Sukhatme,et al.  Generalizing Regrasping with Supervised Policy Learning , 2016, ISER.

[3]  Oliver Brock,et al.  Exploitation of Environmental Constraints in Human and Robotic Grasping , 2013, ISRR.

[4]  Rachid Alami,et al.  Toward a better understanding of the communication cues involved in a human-robot object transfer , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[5]  Kenneth Y. Goldberg,et al.  Cloud-based robot grasping with the google object recognition engine , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[7]  Alois Knoll,et al.  Human-robot interaction in handing-over tasks , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[8]  Rachid Alami,et al.  Planning handovers involving humans and robots in constrained environment , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Matteo Bianchi,et al.  Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands. , 2016, Physics of life reviews.

[10]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[11]  Ralf Mikut,et al.  Human-like reflexes for robotic manipulation using leaky integrate-and-fire neurons , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Heni Ben Amor,et al.  Handover planning for every occasion , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[13]  Robin R. Murphy,et al.  Introduction to AI Robotics , 2000 .

[14]  Danica Kragic,et al.  Probabilistic consolidation of grasp experience , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[15]  N. Carlson.  Physiology of behavior , 1977 .

[16]  Siddhartha S. Srinivasa,et al.  Shared Autonomy via Hindsight Optimization , 2015, Robotics: Science and Systems.

[17]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[18]  Jean-Claude Latombe,et al.  A Single-Query Bi-Directional Probabilistic Roadmap Planner with Lazy Collision Checking , 2001, ISRR.

[19]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Antonio Bicchi,et al.  Low-cost, fast and accurate reconstruction of robotic and human postures via IMU measurements , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Rachid Alami,et al.  Sharing effort in planning human-robot handover tasks , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[22]  Antonio Bicchi,et al.  Enhancing Adaptive Grasping Through a Simple Sensor-Based Reflex Mechanism , 2017, IEEE Robotics and Automation Letters.

[23]  Kerstin Dautenhahn,et al.  New Frontiers in Human-Robot Interaction , 2011 .

[24]  Aude Billard,et al.  A human-inspired controller for fluid human-robot handovers , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[25]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[26]  Mathieu Aubry,et al.  Dex-Net 1.0: A cloud-based network of 3D objects for robust grasp planning using a Multi-Armed Bandit model with correlated rewards , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Simona Casini,et al.  Design of an under-actuated wrist based on adaptive synergies , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[29]  Haruhisa Kawasaki,et al.  GRASPING OF UNKNOWN OBJECT IMITATING HUMAN GRASPING REFLEX , 2002 .

[30]  Pattie Maes,et al.  Postural primitives: Interactive Behavior for a Humanoid Robot Arm , 1996 .

[31]  Giorgio Grioli,et al.  The Quest for Natural Machine Motion: An Open Platform to Fast-Prototyping Articulated Soft Robots , 2017, IEEE Robotics & Automation Magazine.

[32]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[33]  Manuel G. Catalano,et al.  Grasping with Soft Hands , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[34]  Dmitry Berenson,et al.  Predicting human reaching motion in collaborative tasks using Inverse Optimal Control and iterative re-planning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Aude Billard,et al.  A survey of Tactile Human-Robot Interactions , 2010, Robotics Auton. Syst..

[36]  Charles C. Kemp,et al.  Human-Robot Interaction for Cooperative Manipulation: Handing Objects to One Another , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[37]  Javier Felip,et al.  Robust sensor-based grasp primitive for a three-finger robot hand , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[39]  Séverin Lemaignan,et al.  Artificial cognition for social human-robot interaction: An implementation , 2017, Artif. Intell..

[40]  S. Yigit,et al.  Applying reflexes to enhance safe human-robot- co-operation with a humanlike robot arm , 2003 .

[41]  Gordon Cheng,et al.  A general tactile approach for grasping unknown objects with a humanoid robot , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.