Sensory substitution of force and torque using 6-DoF tangential and normal skin deformation feedback

When a person interacts with an environment using a tool, he/she receives tactile information in the form of fingerpad skin deformation. Different interaction forces and torques on the tool cause different skin deformation patterns on the fingerpads. We designed a 6-degree-of-freedom tactile device that creates similar skin deformation patterns on the fingerpads. The device communicates force and torque information by translating and rotating skin deformation tactors relative to the fingerpads. An experiment was conducted to determine participants' ability to use skin deformation tactile cues to perform a peg-in-hole insertion task. Results show that participants can use the tactile cues to reduce interaction force and torque, and they use the tactile force cues to reduce interaction force more than they use the tactile torque cues to reduce interaction torque. Rendering force and torque cues simultaneously causes device saturation and degrades user performance. These results suggest that additional training may help participants use the skin deformation torque cues, and motivate a tactile device design that decouples force and torque skin deformation rendering to minimize device saturation. Fingerpad skin deformation is a promising form of tactile feedback to convey force and torque information in teleoperation systems such as robot-assisted surgery, where force feedback may be undesirable due to stability and safety concerns.

[1]  Allison M. Okamura,et al.  Sensory substitution via cutaneous skin stretch feedback , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[4]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[5]  William R. Provancher,et al.  Back-to-back skin stretch feedback for communicating five degree-of-freedom direction cues , 2013, 2013 World Haptics Conference (WHC).

[6]  Claudio Pacchierotti,et al.  Sensory Subtraction in Robot-Assisted Surgery: Fingertip Skin Deformation Feedback to Ensure Safety and Improve Transparency in Bimanual Haptic Interaction , 2014, IEEE Transactions on Biomedical Engineering.

[7]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[8]  Christopher R. Wagner,et al.  Mechanisms of performance enhancement with force feedback , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[9]  William R. Provancher,et al.  Discrimination thresholds for communicating rotational inertia and torque using differential skin stretch feedback in virtual environments , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[10]  L. Sentis,et al.  The CHAI Libraries , 2003 .

[11]  Marcia Kilchenman O'Malley,et al.  Tactile feedback of object slip improves performance in a grasp and hold task , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[12]  Nikolaos G. Tsagarakis,et al.  A High Performance Tactile Feedback Display and Its Integration in Teleoperation , 2012, IEEE Transactions on Haptics.

[13]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Robert D. Howe,et al.  Multi-channel vibrotactile display for teleoperated assembly , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[15]  Christopher R. Wagner,et al.  The Benefit of Force Feedback in Surgery: Examination of Blunt Dissection , 2007, PRESENCE: Teleoperators and Virtual Environments.

[16]  Blake Hannaford,et al.  Performance evaluation of a six-axis generalized force-reflecting teleoperator , 1991, IEEE Trans. Syst. Man Cybern..

[17]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[18]  J. J. Gil,et al.  Kinematics and Dynamics of a 6-RUS Hunt-Type Parallel Manipulator by Using Natural Coordinates , 2004 .

[19]  Allison M. Okamura,et al.  Sensory substitution using 3-degree-of-freedom tangential and normal skin deformation feedback , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[20]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.