Intra-operative Tumor Localization in Robot-assisted Minimally Invasive Surgery: A Review

Robot-assisted minimally invasive surgery has many advantages compared to conventional open surgery and also certain drawbacks: it causes less operative trauma and faster recovery times but does not allow for direct tumour palpation as is the case in open surgery. This article reviews state-of-the-art intra-operative tumour localisation methods used in robot-assisted minimally invasive surgery and in particular methods that employ force-based sensing, tactile-based sensing, and medical imaging techniques. The limitations and challenges of these methods are discussed and future research directions are proposed.

[1]  Allison M. Okamura,et al.  Force-Feedback Surgical Teleoperator: Controller Design and Palpation Experiments , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[2]  Kouhei Ohnishi.  Real world haptics and telehaptics for medical applications , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[3]  A. Okamura.  Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[4]  Kaspar Althoefer,et al.  Miniaturized force-indentation depth sensor for tissue abnormality identification during laparoscopic surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Antonio Bicchi,et al.  A sensor-based minimally invasive surgery tool for detecting tissutal elastic properties(003) 5323219 , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Saqib Masroor,et al.  Complex repair of a Barlow's valve using the Da Vinci robotic surgical system. , 2010, The Journal of heart valve disease.

[7]  Anatole Lécuyer,et al.  SAILOR: a 3-D medical simulator of loco-regional anaesthesia based on desktop virtual reality and pseudo-haptic feedback , 2008, VRST '08.

[8]  Jung Kim,et al.  New approach for abnormal tissue localization with robotic palpation and mechanical property characterization , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Alexander Horsch,et al.  Bildverarbeitung für die Medizin 2000 , 2000 .

[10]  Alin Albu-Schäffer,et al.  The DLR MiroSurge - A robotic system for surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  Kaspar Althoefer,et al.  Rolling Mechanical Imaging for Tissue Abnormality Localization During Minimally Invasive Surgery , 2010, IEEE Transactions on Biomedical Engineering.

[12]  M. Moallem,et al.  Methods and mechanisms for contact feedback in a robot-assisted minimally invasive environment , 2006, Surgical Endoscopy And Other Interventional Techniques.

[13]  P. Dasgupta,et al.  Air-cushion force sensitive probe for soft tissue investigation during minimally invasive surgery , 2009, 2008 IEEE Sensors.

[14]  Torsten Kuhlen,et al.  Haptic Pulse Simulation for Virtual Palpation , 2008, Bildverarbeitung für die Medizin.

[15]  Grigore C. Burdea,et al.  Dynamic force feedback in a virtual knee palpation , 1994, Artif. Intell. Medicine.

[16]  Bob Kiaii,et al.  Long-term angiographic follow-up of robotic-assisted coronary artery revascularization. , 2012, The Annals of thoracic surgery.

[17]  Eigil Samset,et al.  Summarizing and Visualizing Uncertainty in Non-rigid Registration , 2010, MICCAI.

[18]  Dale A. Lawrence.  Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[19]  Inderbir S Gill,et al.  Cost-effectiveness of open versus laparoscopic versus robotic-assisted laparoscopic cystectomy and urinary diversion , 2011, Current opinion in urology.

[20]  Kai Xu,et al.  An Investigation of the Intrinsic Force Sensing Capabilities of Continuum Robots , 2008, IEEE Transactions on Robotics.

[21]  Zhigang Deng,et al.  Intraoperative registration of preoperative 4D cardiac anatomy with real-time MR images , 2012, 2012 IEEE 12th International Conference on Bioinformatics & Bioengineering (BIBE).

[22]  Karol Miller,et al.  Patient-specific non-linear finite element modelling for predicting soft organ deformation in real-time: application to non-rigid neuroimage registration. , 2010, Progress in biophysics and molecular biology.

[23]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[24]  Joseph M. Romano,et al.  High frequency acceleration feedback significantly increases the realism of haptically rendered textured surfaces , 2010, 2010 IEEE Haptics Symposium.

[25]  Susumu Tachi,et al.  Surface Acoustic Wave Tactile Display , 2001, IEEE Computer Graphics and Applications.

[26]  L. Gavrilov,et al.  Application of focused ultrasound for the stimulation of neural structures. , 1996, Ultrasound in medicine & biology.

[27]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[28]  Kaspar Althoefer,et al.  Finite-Element Modeling of Soft Tissue Rolling Indentation , 2011, IEEE Transactions on Biomedical Engineering.

[29]  Ken Masamune,et al.  Advances in Haptics, Tactile Sensing, and Manipulation for Robot-Assisted Minimally Invasive Surgery, Noninvasive Surgery, and Diagnosis , 2012, J. Robotics.

[30]  Jonathan Ophir,et al.  Elastography: Imaging the elastic properties of soft tissues with ultrasound , 2002, Journal of Medical Ultrasonics.

[31]  XiPeng Xiao.  The New Technical Approach , 2008 .

[32]  Kaspar Althoefer,et al.  A Dual-Function Wheeled Probe for Tissue Viscoelastic Property Identification during Minimally Invasive Surgery , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[33]  Allison M. Okamura,et al.  Modeling of Tool-Tissue Interactions for Computer-Based Surgical Simulation: A Literature Review , 2008, PRESENCE: Teleoperators and Virtual Environments.

[34]  Kaspar Althoefer,et al.  An investigation of the use of linear polarizers to measure force and torque in optical 6-DOF force/torque sensors for dexterous manipulators , 2012, 2012 IEEE International Conference on Robotics and Automation.

[35]  Marc O Schurr,et al.  Artificial tactile sensing in minimally invasive surgery – a new technical approach , 2006, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[36]  Haruhisa Kawasaki,et al.  Five-fingered haptic interface robot: HIRO III , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[37]  T. Johansen,et al.  A remote palpation instrument for laparoscopic surgery: Design and performance , 2009, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[38]  Haruhisa Kawasaki,et al.  Control of multi-fingered haptic interface opposite to human hand , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[39]  R. C. Macridis.  A review , 1963 .

[40]  Allison M. Okamura,et al.  Effects of haptic and graphical force feedback on teleoperated palpation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[41]  Thorsten Alexander Kern,et al.  ISO's Work on Guidance for Haptic and Tactile Interactions , 2008, EuroHaptics.

[42]  Robert L. Williams,et al.  A Stiffness Discrimination Experiment Including Analysis of Palpation Forces and Velocities , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[43]  J. Dai,et al.  An indentation depth—force sensing wheeled probe for abnormality identification during minimally invasive surgery , 2010, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[44]  Kaspar Althoefer,et al.  Tissue identification using inverse Finite Element analysis of rolling indentation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[45]  L.D. Seneviratne,et al.  State-of-the-Art in Force and Tactile Sensing for Minimally Invasive Surgery , 2008, IEEE Sensors Journal.

[46]  Armen P. Sarvazyan,et al.  Mechanical Imaging of the Breast , 2008, IEEE Transactions on Medical Imaging.

[47]  Rajnikant V. Patel,et al.  Robot-assisted Tactile Sensing for Minimally Invasive Tumor Localization , 2009, Int. J. Robotics Res..

[48]  Haruhisa Kawasaki,et al.  Medical palpation of deformable tissue using physics-based model for haptic interface robot (HIRO) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[49]  A. L. Trejos,et al.  Feasibility of locating tumours in lung via kinaesthetic feedback , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[50]  Cagatay Basdogan,et al.  A robotic indenter for minimally invasive measurement and characterization of soft tissue response , 2007, Medical Image Anal..

[51]  Kouhei Ohnishi,et al.  Implementation of Bilateral Control System Based on Acceleration Control Using FPGA for Multi-DOF Haptic Endoscopic Surgery Robot , 2009, IEEE Transactions on Industrial Electronics.

[52]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[53]  Dong-Soo Kwon,et al.  Real-time area-based haptic rendering and the augmented tactile display device for a palpation simulator , 2007, Adv. Robotics.

[54]  Wen-bin Ji,et al.  One-stage Robotic-assisted Laparoscopic Cholecystectomy and Common Bile Duct Exploration With Primary Closure in 5 Patients , 2011, Surgical laparoscopy, endoscopy & percutaneous techniques.

[55]  K. Hamamoto.  Investigation on Virtual Palpation System using Ultrasonic Elasticity Imaging , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[56]  Chih-Hung King,et al.  Pneumatic balloon actuators for tactile feedback in robotic surgery , 2008, Ind. Robot.

[57]  P. Schipper,et al.  Comparison of pulmonary nodule detection rates between preoperative CT imaging and intraoperative lung palpation. , 2011, American journal of surgery.

[58]  Haruhisa Kawasaki,et al.  Five-Fingered Haptic Interface Robot: HIRO III , 2009, IEEE Transactions on Haptics.

[59]  Nigel W. John,et al.  The Role of Haptics in Medical Training Simulators: A Survey of the State of the Art , 2011, IEEE Transactions on Haptics.

[60]  M. Makuuchi,et al.  Intra-operative freehand real-time elastography for small focal liver lesions: "visual palpation" for non-palpable tumors. , 2010, Surgery.

[61]  T. Wilson,et al.  Open versus robotic-assisted radical prostatectomy: which is better? , 2011, Current opinion in urology.

[63]  B. Hannaford,et al.  In-vivo and in-situ compressive properties of porcine abdominal soft tissues. , 2003, Studies in health technology and informatics.

[64]  Mahdi Tavakoli,et al.  Haptics for Teleoperated Surgical Robotic Systems , 2008, New Frontiers in Robotics.

[65]  Kaspar Althoefer,et al.  Air-float Palpation Probe for Tissue Abnormality Identification During Minimally Invasive Surgery , 2013, IEEE Transactions on Biomedical Engineering.

[66]  Timothy N Judkins,et al.  Augmented reality and haptic interfaces for robot‐assisted surgery , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[67]  M. T. Perri,et al.  Initial Evaluation of a Tactile/Kinesthetic Force Feedback System for Minimally Invasive Tumor Localization , 2010, IEEE/ASME Transactions on Mechatronics.

[68]  M. T. Perri,et al.  New tactile sensing system for minimally invasive surgical tumour localization , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[69]  Grigore C. Burdea,et al.  Virtual reality training simulation for palpation of subsurface tumors , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[70]  S. Raza,et al.  Using Real‐time Tissue Elastography for Breast Lesion Evaluation , 2010, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[71]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[72]  Yanju Liu,et al.  Single cell magnetorheological fluid based tactile display , 2005, Displays.

[73]  Laurent Étienne,et al.  Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures , 2004, CHI.

[74]  Seiichiro Katsura,et al.  Medical Mechatronics – An Application to Haptic Forceps , 2004 .

[75]  R. Ehman,et al.  Magnetic resonance elastography: A review , 2010, Clinical anatomy.

[76]  Hendrik Van Brussel,et al.  Reliable and Enhanced Stiffness Perception in Soft-tissue Telemanipulation , 2005, Int. J. Robotics Res..

[77]  J. R. Hewit,et al.  Tactile sensing technology for minimal access surgery––a review , 2003 .

[78]  H Boese,et al.  Palpation imaging using a haptic system for virtual reality applications in medicine. , 2004, Studies in health technology and informatics.

[79]  R. Howe,et al.  Breast Tissue Stiffness in Compression is Correlated to Histological Diagnosis , 1999 .

[80]  Armen P. Sarvazyan,et al.  Prostate mechanical imaging: 3-D image composition and feature calculations , 2006, IEEE Transactions on Medical Imaging.

[81]  Alan Liu,et al.  A Survey of Surgical Simulation: Applications, Technology, and Education , 2003, Presence: Teleoperators & Virtual Environments.

[82]  William Wells,et al.  Multimodal image registration for preoperative planning and image-guided neurosurgical procedures. , 2011, Neurosurgery clinics of North America.

[83]  N. A. Mansour,et al.  Design of a novel multi-modal tactile display device for biomedical applications , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[84]  Kaspar Althoefer,et al.  Rolling Indentation Probe for Tissue Abnormality Identification During Minimally Invasive Surgery , 2011, IEEE Transactions on Robotics.

[85]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[86]  M. T. Perri,et al.  Experimental evaluation of robot-assisted tactile sensing for minimally invasive surgery , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[87]  R. Kemp,et al.  Intraoperative application of real-time tissue elastography for the diagnosis and staging of pancreatic tumours , 2011, 2011 Pan American Health Care Exchanges.

[88]  Pietro Valdastri,et al.  Wireless tissue palpation: Proof of concept for a single degree of freedom , 2013, 2013 IEEE International Conference on Robotics and Automation.

[89]  T. Miyagawa,et al.  Real-time elastography for the diagnosis of prostate cancer: evaluation of elastographic moving images. , 2009, Japanese journal of clinical oncology.

[90]  Maxime Sermesant,et al.  Application of soft tissue modelling to image-guided surgery. , 2005, Medical engineering & physics.

[91]  William J. Peine,et al.  Tactile Imaging System for Localizing Lung Nodules during Video Assisted Thoracoscopic Surgery , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[92]  Ana Luisa Trejos,et al.  Force sensing and its application in minimally invasive surgery and therapy: A survey , 2010 .

[93]  Javad Dargahi,et al.  Graphical display of tactile sensing data with application in minimally invasive surgery , 2007, Canadian Journal of Electrical and Computer Engineering.

[94]  Javad Dargahi,et al.  A novel method in measuring the stiffness of sensed objects with applications for biomedical robotic systems , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[95]  Kaspar Althoefer,et al.  Tissue stiffness simulation and abnormality localization using pseudo-haptic feedback , 2012, 2012 IEEE International Conference on Robotics and Automation.

[96]  Douglas C. Schmidt,et al.  The Design and Performance of , 2003 .

[97]  Anatole Lécuyer,et al.  A study of the modification of the speed and size of the cursor for simulating pseudo-haptic bumps and holes , 2008, TAP.

[98]  Kaspar Althoefer,et al.  Inverse finite-element modeling for tissue parameter identification using a rolling indentation probe , 2013, Medical & Biological Engineering & Computing.

[99]  Kouhei Ohnishi,et al.  Medical mechatronics - An application to haptic forceps , 2005, Annu. Rev. Control..

[100]  Kenjiro Takemura,et al.  Tactile bump display using electro-rheological fluid , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.