Recent Advances in Robot-Assisted Surgery: Soft Tissue Contact Identification

Robot-Assisted Minimally Invasive Surgery (RAMIS) is becoming standard-of-care in western medicine. RAMIS offers better patient outcome compared to traditional open surgery, however, the surgeons’ ability to identify the tissues with the sense of touch is missing from most robotic systems. Regarding haptic feedback, the most promising diagnostic technique is probably palpation; a physical contact examination method through which information can be gathered about the underlying structures by gently pressing with the fingers. In open surgery, palpation is widely used to identify blood vessels, tendons or even tumors; and the knowledge on the exact location of such elements is often crucial with respect to the outcome of the intervention. This paper presents a review of the actual research directions in the field of palpation in RAMIS.

[1]  Yoshihiro Tanaka,et al.  Development of a real-time tactile sensing system for brain tumor diagnosis , 2010, International Journal of Computer Assisted Radiology and Surgery.

[2]  Øyvind Stavdahl,et al.  Palpation instrument for augmented minimally invasive surgery , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[3]  Guanghua Xu,et al.  A tactile sensing and feedback system for tumor localization , 2016, 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[4]  Timothy N Judkins,et al.  Augmented reality and haptic interfaces for robot‐assisted surgery , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[5]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  David V. Gealy,et al.  Autonomous Multilateral Surgical Tumor Resection with Interchangeable Instrument Mounts and Fluid Injection Device , 2015 .

[7]  Christos E. Constantinou,et al.  Stiffness mapping prostate biopsy samples using a tactile sensor , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Kaspar Althoefer,et al.  Optical fiber sensor for soft tissue investigation during minimally invasive surgery , 2008, 2008 IEEE International Conference on Robotics and Automation.

[9]  Lingtao Yu,et al.  Design and Realization of Forceps With 3-D Force Sensing Capability for Robot-Assisted Surgical System , 2018, IEEE Sensors Journal.

[10]  Timothy M. Kowalewski,et al.  Evaluation of Torque Measurement Surrogates as Applied to Grip Torque and Jaw Angle Estimation of Robotic Surgical Tools , 2018, IEEE Robotics and Automation Letters.

[11]  Cong Gao,et al.  Learning to See Forces: Surgical Force Prediction with RGB-Point Cloud Temporal Convolutional Networks , 2018, OR 2.0/CARE/CLIP/ISIC@MICCAI.

[12]  Pietro Valdastri,et al.  Towards a soft robotic skin for autonomous tissue palpation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Imre J. Rudas,et al.  Origins of surgical robotics: From space to the operating room , 2016 .

[14]  Bruno Siciliano,et al.  A novel force sensing integrated into the trocar for minimally invasive robotic surgery , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Levente Kovács,et al.  Models for force control in telesurgical robot systems , 2015 .

[16]  P. Dasgupta,et al.  Ex vivo study of prostate cancer localization using rolling mechanical imaging towards minimally invasive surgery. , 2017, Medical engineering & physics.

[17]  Matteo Bianchi,et al.  Characterization of an air jet haptic lump display , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Gregory Hager,et al.  Ultrasound elastography as a tool for imaging guidance during prostatectomy: Initial experience , 2012, Medical science monitor : international medical journal of experimental and clinical research.

[19]  Allison M. Okamura,et al.  Autonomous robotic palpation: Machine learning techniques to identify hard inclusions in soft tissues , 2013, 2013 IEEE International Conference on Robotics and Automation.

[20]  Lu Li,et al.  A Real-time Augmented Reality Surgical System for Overlaying Stiffness Information , 2018, Robotics: Science and Systems.

[21]  Jin U. Kang,et al.  Force sensing micro-forceps with integrated fiber Bragg grating for vitreoretinal surgery , 2012, Other Conferences.

[22]  Allison M. Okamura,et al.  A single-use haptic palpation probe for locating subcutaneous blood vessels in robot-assisted minimally invasive surgery , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[23]  Hiroshi Oyama,et al.  Interaction model between elastic objects for haptic feedback considering collisions of soft tissue , 2005, Comput. Methods Programs Biomed..

[24]  L.D. Seneviratne,et al.  State-of-the-Art in Force and Tactile Sensing for Minimally Invasive Surgery , 2008, IEEE Sensors Journal.

[25]  Thorsten A. Kern,et al.  Engineering Haptic Devices: A Beginner's Guide for Engineers , 2009 .

[26]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[27]  Timothy M. Kowalewski,et al.  Tissue Identification Through Back End Sensing on da Vinci EndoWrist Surgical Tool , 2015 .

[28]  A. L. Trejos,et al.  Feasibility of locating tumours in lung via kinaesthetic feedback , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[29]  Chen Yang,et al.  Development of an inexpensive tri-axial force sensor for minimally invasive surgery , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Peter Kazanzides,et al.  Force-Controlled Exploration for Updating Virtual Fixture Geometry in Model-Mediated Telemanipulation , 2017 .

[31]  Kenneth Y. Goldberg,et al.  Tumor localization using automated palpation with Gaussian Process Adaptive Sampling , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[32]  Kaspar Althoefer,et al.  Evaluation of stiffness feedback for hard nodule identification on a phantom silicone model , 2017, PloS one.

[33]  J. K. Salisbury,et al.  Kinesthetic coupling between operator and remote manipulator , 1980 .

[34]  Yoshihiro Tanaka,et al.  Softness measurement by forceps-type tactile sensor using acoustic reflection , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[35]  K. Hill,et al.  Fiber Bragg grating technology fundamentals and overview , 1997 .

[36]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[37]  Hee Chan Kim,et al.  A grip force model for the da Vinci end-effector to predict a compensation force , 2014, Medical & Biological Engineering & Computing.

[38]  Thorsten A. Kern.  Biological Basics of Haptic Perception , 2009 .

[39]  Kaspar Althoefer,et al.  Endoscopic add-on stiffness probe for real-time soft surface characterisation in MIS , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Alicia Casals,et al.  Towards Retrieving Force Feedback in Robotic-Assisted Surgery: A Supervised Neuro-Recurrent-Vision Approach , 2017, IEEE Transactions on Haptics.

[41]  Rajni V. Patel,et al.  Sensorization of a surgical robotic instrument for force sensing , 2016, SPIE BiOS.

[43]  Nantachai Sornkarn,et al.  Can a Soft Robotic Probe Use Stiffness Control Like a Human Finger to Improve Efficacy of Haptic Perception? , 2017, IEEE Transactions on Haptics.

[44]  Heechul Kim,et al.  Development of FBG sensor system for force-feedback in minimally invasive robotic surgery , 2011, 2011 Fifth International Conference on Sensing Technology.

[45]  Nigel H. Lovell,et al.  A review of tactile sensing technologies with applications in biomedical engineering , 2012 .

[46]  Hyouk Ryeol Choi,et al.  Sensorized Surgical Forceps for Robotic-Assisted Minimally Invasive Surgery , 2018, IEEE Transactions on Industrial Electronics.

[47]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[48]  Allison M Okamura,et al.  Evaluation of Skin Deformation Tactile Feedback for Teleoperated Surgical Tasks , 2019, IEEE Transactions on Haptics.

[49]  Pietro Valdastri,et al.  Wireless Tissue Palpation for Intraoperative Detection of Lumps in the Soft Tissue , 2014, IEEE Transactions on Biomedical Engineering.

[50]  Imre J. Rudas,et al.  Surface deformation and reaction force estimation of liver tissue based on a novel nonlinear mass–spring–damper viscoelastic model , 2015, Medical & Biological Engineering & Computing.

[51]  Emmanuel Wilson,et al.  External force estimation and implementation in robotically assisted minimally invasive surgery , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[52]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[53]  J. Kövecses,et al.  Internet-based Bilateral Teleoperation Using a Revised Time-Domain Passivity Controller , 2018 .

[54]  J. Dai,et al.  An indentation depth—force sensing wheeled probe for abnormality identification during minimally invasive surgery , 2010, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[55]  Carla M. Pugh,et al.  Modeling Touch and Palpation Using Autoregressive Models , 2018, IEEE Transactions on Biomedical Engineering.

[56]  Ken Masamune,et al.  Magnetic resonance imaging-compatible tactile sensing device based on a piezoelectric array , 2012, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[57]  Bijan Shirinzadeh,et al.  An actuated force feedback‐enabled laparoscopic instrument for robotic‐assisted surgery , 2014, The international journal of medical robotics + computer assisted surgery : MRCAS.

[58]  Mahdi Tavakoli,et al.  Application of a Redundant Haptic Interface in Enhancing Soft-Tissue Stiffness Discrimination , 2019, IEEE Robotics and Automation Letters.

[59]  Mark R. Cutkosky,et al.  Slip Sensing for Intelligent, Improved Grasping and Retraction in Robot-Assisted Surgery , 2018, IEEE Robotics and Automation Letters.

[60]  Claudio Pacchierotti,et al.  Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery , 2016, IEEE Transactions on Biomedical Engineering.

[61]  M. Schijven,et al.  The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review , 2009, Surgical Endoscopy.

[62]  Kaspar Althoefer,et al.  Using visual cues to enhance haptic feedback for palpation on virtual model of soft tissue , 2015, Medical & Biological Engineering & Computing.

[63]  Saeid Nahavandi,et al.  Effects of realistic force feedback in a robotic assisted minimally invasive surgery system , 2014, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[64]  Hyoukryeol Choi,et al.  Development of a grasping force-feedback user interface for surgical robot system , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).