Evaluation of Skin Deformation Tactile Feedback for Teleoperated Surgical Tasks

During interaction with objects using a tool, we experience force and tactile feedback. One form of tactile feedback is local fingerpad skin deformation. In this paper, we provide haptic feedback to users of a teleoperation system through a skin deformation tactile feedback device. The device is able to provide tangential and normal skin deformation in a coupled manner, and is designed so that users can grasp it with a precision grip using multiple fingerpads. By applying skin deformation feedback on multiple fingerpads, the device is able to provide multi-degree-of-freedom interaction force direction and magnitude information to the user. To evaluate the effectiveness of this approach for the performance of teleoperated manipulation tasks, we performed a study in which 20 participants used a teleoperation system to perform one of two manipulation tasks (peg transfer and tube connection) using force feedback, skin deformation feedback, and the combination of both feedback. Results showed that participants are able to use all feedback to improve task performance compared to the case without haptic feedback, although the degree of improvement depended on the nature of the task. The feedback also improved situation awareness, felt consistent with prior experience, and did not affect concentration on the task, as reported by participants.

[1]  Allison M. Okamura,et al.  Tactor-Induced Skin Stretch as a Sensory Substitution Method in Teleoperated Palpation , 2015, IEEE Transactions on Human-Machine Systems.

[2]  Claudio Pacchierotti,et al.  Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery , 2016, IEEE Transactions on Biomedical Engineering.

[3]  Hideki Hashimoto,et al.  Effect of Scaling on the Performance and Stability of Teleoperation Systems Interacting with Soft Environments , 2011, Adv. Robotics.

[4]  Thomas Hulin,et al.  Evaluation of a vibrotactile feedback device for spatial guidance , 2011, 2011 IEEE World Haptics Conference.

[5]  Satoshi Tadokoro,et al.  Vibrotactile Stimuli Applied to Finger Pads as Biases for Perceived Inertial and Viscous Loads , 2011, IEEE Transactions on Haptics.

[6]  Dale A. Lawrence.  Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[7]  Blake Hannaford,et al.  Performance evaluation of a six-axis generalized force-reflecting teleoperator , 1991, IEEE Trans. Syst. Man Cybern..

[8]  Allison M. Okamura,et al.  Comparison of kinesthetic and skin deformation feedback for mass rendering , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  J.S. Yuan,et al.  Closed-loop manipulator control using quaternion feedback , 1988, IEEE J. Robotics Autom..

[10]  Claudio Pacchierotti,et al.  Displaying Sensed Tactile Cues with a Fingertip Haptic Device , 2015, IEEE Transactions on Haptics.

[11]  Christopher R. Wagner,et al.  Mechanisms of performance enhancement with force feedback , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[12]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Allison M. Okamura,et al.  Sensory Substitution and Augmentation Using 3-Degree-of-Freedom Skin Deformation Feedback , 2015, IEEE Transactions on Haptics.

[14]  Frans C. T. van der Helm,et al.  The Impact of Haptic Feedback Quality on the Performance of Teleoperated Assembly Tasks , 2013, IEEE Transactions on Haptics.

[15]  A. Okamura.  Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[16]  Marcia Kilchenman O'Malley,et al.  Tactile feedback of object slip improves performance in a grasp and hold task , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[17]  Christopher R. Wagner,et al.  Force Feedback Benefit Depends on Experience in Multiple Degree of Freedom Robotic Surgery Task , 2007, IEEE Transactions on Robotics.

[18]  Robert D. Howe,et al.  Multi-channel vibrotactile display for teleoperated assembly , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  Allison M. Okamura,et al.  Sensory substitution of force and torque using 6-DoF tangential and normal skin deformation feedback , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Decision Systems.,et al.  Stable teleoperation with scaled feedback , 1993 .

[21]  Y. Matsuoka,et al.  Vibrotactile Sensory Substitution for Object Manipulation: Amplitude Versus Pulse Train Frequency Modulation , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Katherine J. Kuchenbecker,et al.  Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance , 2012, IEEE Transactions on Haptics.

[23]  Allison M. Okamura,et al.  Three-Dimensional Skin Deformation as Force Substitution: Wearable Device Design and Performance During Haptic Exploration of Virtual Environments , 2017, IEEE Transactions on Haptics.

[24]  Michael J. Massimino,et al.  Improved force perception through sensory substitution , 1995 .

[25]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[26]  D. Yuh,et al.  Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. , 2005, The Journal of thoracic and cardiovascular surgery.

[27]  A. Castellanos,et al.  Force Feedback Plays a Significant Role in Minimally Invasive Surgery: Results and Analysis , 2005, Annals of surgery.

[28]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[29]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[30]  Claudio Pacchierotti,et al.  Sensory Subtraction in Robot-Assisted Surgery: Fingertip Skin Deformation Feedback to Ensure Safety and Improve Transparency in Bimanual Haptic Interaction , 2014, IEEE Transactions on Biomedical Engineering.