Design and performance characterization of a soft robot hand with fingertip haptic feedback for teleoperation

ABSTRACT A soft robot hand with fingertip haptic feedback for teleoperation is proposed to perform complex tasks and ensure safe and friendly human-machine interaction. This robot hand can perform finger flexion/extension and abduction/adduction motions. A data glove is used to collect the hand joint angle data of the operator. Flexion sensors are embedded in the soft robot hand to monitor the bending angles of the actuators. Pressure sensors on the fingertips of the robot hand collect contact force data, and haptic feedback actuators located on the fingertips of the operator display the contact force to the operator. Characterization tests and teleoperation performance tests involving human participants are performed to prove the feasibility of the soft robot hand. The soft robot hand prototype satisfies the output force requirements and can meet 96.86% of the design requirements of the joint angles. The soft robot hand can be teleoperated to perform nine commonly used motions in daily operational tasks. The success rates of fingertip force discrimination, grasp, and pinch ability experiment are 100%, 95.00%, and 98.33%, respectively. The results of the experiment suggest that the soft robot hand with fingertip haptic feedback can perform complex tasks in teleoperation. GRAPHICAL ABSTRACT

[1]  A.M. Dollar,et al.  A robust compliant grasper via shape deposition manufacturing , 2006, IEEE/ASME Transactions on Mechatronics.

[2]  Mark A Minor,et al.  Improving Mechanical Properties of Molded Silicone Rubber for Soft Robotics Through Fabric Compositing. , 2018, Soft robotics.

[3]  T B Sheridan,et al.  Teleoperator Performance with Varying Force and Visual Feedback , 1994, Human factors.

[4]  Robert J. Wood,et al.  Soft robotic glove for combined assistance and at-home rehabilitation , 2015, Robotics Auton. Syst..

[5]  G. Bex,et al.  An analytical expression for the D.I.P.-P.I.P. flexion interdependence in human fingers. , 2015, Acta of bioengineering and biomechanics.

[6]  Aaron M. Dollar,et al.  Benchmarking grasping and manipulation: Properties of the Objects of Daily Living , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Yoky Matsuoka,et al.  Musical piano performance by the ACT Hand , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Haruhisa Kawasaki,et al.  Review of Gifu Hand and Its Application , 2011 .

[9]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[10]  Claudio Pacchierotti,et al.  Design and development of a 3RRS wearable fingertip cutaneous device , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[11]  Claudio Pacchierotti,et al.  Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems , 2015, Int. J. Robotics Res..

[12]  Antonio Frisoli,et al.  Design of a novel finger haptic interface for contact and orientation display , 2010, 2010 IEEE Haptics Symposium.

[13]  Patrick van der Smagt,et al.  EMG-based teleoperation and manipulation with the DLR LWR-III , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Matei T. Ciocarlie,et al.  The Velo gripper: A versatile single-actuator design for enveloping, parallel and fingertip grasps , 2014, Int. J. Robotics Res..

[15]  Daniele Mazzei,et al.  Wearable Wireless Tactile Display for Virtual Interactions with Soft Bodies , 2014, Front. Bioeng. Biotechnol..

[16]  YapHong Kai,et al.  High-Force Soft Printable Pneumatics for Soft Robotic Applications , 2016 .

[17]  Hideyuki Tsukagoshi,et al.  Lightweight underactuated pneumatic fingers capable of grasping various objects , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Aaron M. Dollar,et al.  An Adaptive Three-Fingered Prismatic Gripper With Passive Rotational Joints , 2016, IEEE Robotics and Automation Letters.

[19]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[20]  Pinhas Ben-Tzvi,et al.  Multi-segment continuum robot shape estimation using passive cable displacement , 2013, 2013 IEEE International Symposium on Robotic and Sensors Environments (ROSE).

[21]  Robert D. Howe,et al.  The Highly Adaptive SDM Hand: Design and Performance Evaluation , 2010, Int. J. Robotics Res..

[22]  Thomas J. Wallin,et al.  3D printing antagonistic systems of artificial muscle using projection stereolithography , 2015, Bioinspiration & biomimetics.

[23]  Kimitoshi Yamazaki,et al.  Survey of robotic manipulation studies intending practical applications in real environments -object recognition, soft robot hand, and challenge program and benchmarking- , 2017, Adv. Robotics.

[24]  Roland Siegwart,et al.  The hand of the DLR Hand Arm System: Designed for interaction , 2012, Int. J. Robotics Res..

[25]  Jian S. Dai,et al.  An Optimization Approach to Teleoperation of the Thumb of a Humanoid Robot Hand: Kinematic Mapping and Calibration , 2014 .

[26]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[27]  Myung-Chul Jung,et al.  Ergonomic Evaluation of Biomechanical Hand Function , 2014, Safety and health at work.

[28]  Anna Kochan,et al.  Shadow delivers first hand , 2005, Ind. Robot.

[29]  Aaron M. Dollar,et al.  An investigation of grasp type and frequency in daily household and machine shop tasks , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[31]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[32]  Torgeir Welo,et al.  Surface Friction of Rapidly Prototyped Wheels from 3D-Printed Thermoplastic Elastomers: An Experimental Study , 2017 .

[33]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[34]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[35]  Mehmet Remzi Dogar,et al.  Haptic identification of objects using a modular soft robotic gripper , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Cosimo Della Santina,et al.  SoftHand Pro-D: Matching dynamic content of natural user commands with hand embodiment for enhanced prosthesis control , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[37]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[38]  Surya Girinatha Nurzaman,et al.  SVAS3: Strain Vector Aided Sensorization of Soft Structures , 2014, Sensors.

[39]  Claudio Pacchierotti,et al.  Two Finger Grasping Simulation with Cutaneous and Kinesthetic Force Feedback , 2012, EuroHaptics.

[40]  Oliver Brock,et al.  A compliant hand based on a novel pneumatic actuator , 2013, 2013 IEEE International Conference on Robotics and Automation.