Data-driven comparison of four cutaneous displays for pinching palpation in robotic surgery

Current teleoperated surgical robots do not provide surgeons with haptic feedback, due in part to the safety risks associated with grounded kinesthetic forces. Ungrounded cutaneous feedback provides an elegant and inherently stable way to refer haptic feedback to the surgeon in such situations. Choosing the most appropriate display, however, is challenging given the substantial number of unique cutaneous displays presented in the literature. In this work, we demonstrate how measuring the space of tactile sensations that a device can create can be employed to objectively compare different cutaneous displays for a specific task. We built four cutaneous displays and compared their ability to render sensations measured while pinching four disparate materials with a biomimetic tactile sensor. As predicted, quantitative tactile rendering errors varied significantly across devices and materials. The results of this comparison can be used to design better cutaneous displays for pinching palpation in robotic surgery. Furthermore, the proposed approach could provide a useful tool for evaluating novel cutaneous devices for various other tactile tasks, providing an objective framework to supplement and guide future human subject studies.

[1]  Matteo Bianchi,et al.  Design and Characterization of a Fabric-Based Softness Display , 2015, IEEE Transactions on Haptics.

[2]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[3]  Gerald E. Loeb,et al.  Haptic feature extraction from a biomimetic tactile sensor: Force, contact location and curvature , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[4]  Claudio Pacchierotti,et al.  Sensory Subtraction in Robot-Assisted Surgery: Fingertip Skin Deformation Feedback to Ensure Safety and Improve Transparency in Bimanual Haptic Interaction , 2014, IEEE Transactions on Biomedical Engineering.

[5]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[6]  Robert J Cerfolio,et al.  A prospective study to determine the incidence of non-imaged malignant pulmonary nodules in patients who undergo metastasectomy by thoracotomy with lung palpation. , 2011, The Annals of thoracic surgery.

[7]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.

[8]  Kazuhiko Terashima,et al.  LinkTouch: A wearable haptic device with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad , 2014, HAPTICS.

[9]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  William R. Provancher,et al.  Design of a Fingertip-Mounted Tactile Display with Tangential Skin Displacement Feedback , 2010, IEEE Transactions on Haptics.

[11]  M. E. Hagen,et al.  Visual clues act as a substitute for haptic feedback in robotic surgery , 2008, Surgical Endoscopy.

[12]  David I. Lee,et al.  In vivo validation of a system for haptic feedback of tool vibrations in robotic surgery , 2013, Surgical Endoscopy.

[13]  Hong Z. Tan,et al.  Compliance display using a tilting-plate tactile feedback device , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[14]  Claudio Pacchierotti,et al.  A Data-Driven Approach to Remote Tactile Interaction: From a BioTac Sensor to any Fingertip Cutaneous Device , 2014, EuroHaptics.

[15]  Claudio Pacchierotti,et al.  Displaying Sensed Tactile Cues with a Fingertip Haptic Device , 2015, IEEE Transactions on Haptics.

[16]  Shuming Nie,et al.  Intraoperative Near-Infrared Imaging Can Distinguish Cancer from Normal Tissue but Not Inflammation , 2014, PloS one.

[17]  J. A. Fishel,et al.  Sensing tactile microvibrations with the BioTac — Comparison with human sensitivity , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[18]  Claudio Pacchierotti,et al.  Two Finger Grasping Simulation with Cutaneous and Kinesthetic Force Feedback , 2012, EuroHaptics.

[19]  Claudio Pacchierotti,et al.  Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems , 2015, Int. J. Robotics Res..

[20]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[21]  Gerald E. Loeb,et al.  Using the BioTac as a tumor localization tool , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[22]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring. Review of early clinical results. , 2002, Surgical endoscopy.

[23]  John Kenneth Salisbury,et al.  Stability of Haptic Rendering: Discretization, Quantization, Time Delay, and Coulomb Effects , 2006, IEEE Transactions on Robotics.

[24]  Claudio Pacchierotti,et al.  Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery , 2016, IEEE Transactions on Biomedical Engineering.

[25]  Katherine J. Kuchenbecker,et al.  Evaluating the BioTac's Ability to Detect and Characterize Lumps in Simulated Tissue , 2014, EuroHaptics.

[26]  Akio Yamamoto,et al.  Development of a 2-DOF softness feeling display for tactile tele-presentation of deformable surfaces , 2010, 2010 IEEE International Conference on Robotics and Automation.

[27]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.