Robust proprioceptive grasping with a soft robot hand

This work presents a soft hand capable of robustly grasping and identifying objects based on internal state measurements along with a combined system which autonomously performs grasps. A highly compliant soft hand allows for intrinsic robustness to grasping uncertainties; the addition of internal sensing allows the configuration of the hand and object to be detected. The finger module includes resistive force sensors on the fingertips for contact detection and resistive bend sensors for measuring the curvature profile of the finger. The curvature sensors can be used to estimate the contact geometry and thus to distinguish between a set of grasped objects. With one data point from each finger, the object grasped by the hand can be identified. A clustering algorithm to find the correspondence for each grasped object is presented for both enveloping grasps and pinch grasps. A closed loop system uses a camera to detect approximate object locations. Compliance in the soft hand handles that uncertainty in addition to geometric uncertainty in the shape of the object.

[1]  G. Whitesides,et al.  Pneumatic Networks for Soft Robotics that Actuate Rapidly , 2014 .

[2]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[3]  G. Whitesides,et al.  Soft Machines That are Resistant to Puncture and That Self Seal , 2013, Advanced materials.

[4]  Siddhartha S. Srinivasa,et al.  A data-driven statistical framework for post-grasp manipulation , 2014, Int. J. Robotics Res..

[5]  Advait Jain,et al.  Manipulation in Clutter with Whole-Arm Tactile Sensing , 2013, ArXiv.

[6]  Sangbae Kim,et al.  Enabling Force Sensing During Ground Locomotion: A Bio-Inspired, Multi-Axis, Composite Force Sensor Using Discrete Pressure Mapping , 2014, IEEE Sensors Journal.

[7]  Daniela Rus,et al.  Autonomous Soft Robotic Fish Capable of Escape Maneuvers Using Fluidic Elastomer Actuators. , 2014, Soft robotics.

[8]  Cagdas D. Onal,et al.  Design and control of a soft and continuously deformable 2D robotic manipulation system , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Vincent Duchaine,et al.  Soft Tactile Skin Using an Embedded Ionic Liquid and Tomographic Imaging , 2015 .

[10]  Francesco Zanichelli,et al.  Haptic object recognition with a dextrous hand based on volumetric shape representations , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[11]  George M. Whitesides,et al.  Towards a soft pneumatic glove for hand rehabilitation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Leslie Pack Kaelbling,et al.  Grasping POMDPs , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Daniel M. Vogt,et al.  Design and Characterization of a Soft Multi-Axis Force Sensor Using Embedded Microfluidic Channels , 2013, IEEE Sensors Journal.

[14]  S. Srinivasa,et al.  Push-grasping with dexterous hands: Mechanics and a method , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  H. Worn,et al.  The working principle of resistive tactile sensor cells , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[16]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[17]  Heinrich M. Jaeger,et al.  Universal robotic gripper based on the jamming of granular material , 2010, Proceedings of the National Academy of Sciences.

[18]  Daniela Rus,et al.  A Recipe for Soft Fluidic Elastomer Robots , 2015, Soft robotics.

[19]  Oliver Brock,et al.  A compliant hand based on a novel pneumatic actuator , 2013, 2013 IEEE International Conference on Robotics and Automation.

[20]  Heinz Wörn,et al.  Haptic object recognition for multi-fingered robot hands , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[21]  C. Balkenius,et al.  Experiments with Proprioception in a Self-Organizing System for Haptic Perception , 2007 .

[22]  Rebecca K. Kramer,et al.  Hyperelastic pressure sensing with a liquid-embedded elastomer , 2010 .

[23]  Siddhartha S. Srinivasa,et al.  Efficient touch based localization through submodularity , 2012, 2013 IEEE International Conference on Robotics and Automation.

[24]  Koh Hosoda,et al.  Repetitive grasping with anthropomorphic skin-covered hand enables robust haptic recognition , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  S. Kusuda,et al.  Fluid-resistive bending sensor having perfect compatibility with flexible pneumatic balloon actuator , 2007, 2007 IEEE 20th International Conference on Micro Electro Mechanical Systems (MEMS).

[26]  Kenneth S. Roberts,et al.  Haptic object recognition using a multi-fingered dextrous hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[27]  Nikolaus Correll,et al.  A soft pneumatic actuator that can sense grasp and touch , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[29]  Lee A. Danisch,et al.  Spatially continuous six degree of freedom position and orientation sensor , 1999 .

[30]  Aaron M. Dollar,et al.  Unplanned, model-free, single grasp object classification with underactuated hands and force sensors , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Advait Jain,et al.  Reaching in clutter with whole-arm tactile sensing , 2013, Int. J. Robotics Res..

[32]  Oliver Brock,et al.  A Novel Type of Compliant, Underactuated Robotic Hand for Dexterous Grasping , 2014, Robotics: Science and Systems.

[33]  Heinrich M. Jaeger,et al.  A Positive Pressure Universal Gripper Based on the Jamming of Granular Material , 2012, IEEE Transactions on Robotics.

[34]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[35]  Mehmet Remzi Dogar,et al.  Haptic identification of objects using a modular soft robotic gripper , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[37]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[38]  Robert D. Howe,et al.  The Highly Adaptive SDM Hand: Design and Performance Evaluation , 2010, Int. J. Robotics Res..

[39]  Stephen A. Morin,et al.  Soft Robotics: Review of Fluid‐Driven Intrinsically Soft Devices; Manufacturing, Sensing, Control, and Applications in Human‐Robot Interaction   , 2017 .

[40]  R. Adam Bilodeau,et al.  Monolithic fabrication of sensors and actuators in a soft robotic gripper , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[41]  Daniela Rus,et al.  Autonomous Object Manipulation Using a Soft Planar Grasping Manipulator , 2015, Soft robotics.

[42]  Matteo Cianchetti,et al.  Soft robotics: Technologies and systems pushing the boundaries of robot abilities , 2016, Science Robotics.

[43]  Filip Ilievski,et al.  Soft robotics for chemists. , 2011, Angewandte Chemie.

[44]  Siddhartha S. Srinivasa,et al.  Pose estimation for contact manipulation with manifold particle filters , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  A.M. Dollar,et al.  A robust compliant grasper via shape deposition manufacturing , 2006, IEEE/ASME Transactions on Mechatronics.

[46]  George M. Whitesides,et al.  A Hybrid Combining Hard and Soft Robots , 2014 .

[47]  Henrik I. Christensen,et al.  Custom soft robotic gripper sensor skins for haptic object visualization , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[48]  E. Biddiss,et al.  Electroactive polymeric sensors in hand prostheses: bending response of an ionic polymer metal composite. , 2006, Medical engineering & physics.