Design and Integration of Electrical Bio-impedance Sensing in Surgical Robotic Tools for Tissue Identification and Display

The integration of intra-operative sensors into surgical robots is a hot research topic since this can significantly facilitate complex surgical procedures by enhancing surgical awareness with real-time tissue information. However, currently available intra-operative sensing technologies are mainly based on image processing and force feedback, which normally require heavy computation or complicated hardware modifications of existing surgical tools. This paper presents the design and integration of electrical bio-impedance sensing into a commercial surgical robot tool, leading to the creation of a novel smart instrument that allows the identification of tissues by simply touching them. In addition, an advanced user interface is designed to provide guidance during the use of the system and to allow augmented-reality visualization of the tissue identification results. The proposed system imposes minor hardware modifications to an existing surgical tool, but adds the capability to provide a wealth of data about the tissue being manipulated. This has great potential to allow the surgeon (or an autonomous robotic system) to better understand the surgical environment. To evaluate the system, a series of ex-vivo experiments were conducted. The experimental results demonstrate that the proposed sensing system can successfully identify different tissue types with 100% classification accuracy. In addition, the user interface was shown to effectively and intuitively guide the user to measure the electrical impedance of the target tissue, presenting the identification results as augmented-reality markers for simple and immediate recognition.

[1]  Håvard Kalvøy,et al.  Detection of intraneural needle-placement with multiple frequency bioimpedance monitoring: a novel method , 2015, Journal of Clinical Monitoring and Computing.

[2]  H. G. van der Poel,et al.  Multispectral-Fluorescence Imaging as a Tool to Separate Healthy from Disease-Related Lymphatic Anatomy During Robot-Assisted Laparoscopy , 2018, The Journal of Nuclear Medicine.

[3]  Lena Maier-Hein,et al.  Uncertainty-Aware Organ Classification for Surgical Data Science Applications in Laparoscopy , 2017, IEEE Transactions on Biomedical Engineering.

[4]  Boris Rubinsky,et al.  Electrical impedance characterization of normal and cancerous human hepatic tissue , 2010, Physiological measurement.

[5]  M. Elia,et al.  Bioelectrical impedance analysis--part I: review of principles and methods. , 2004, Clinical nutrition.

[6]  Zhuoqi Cheng,et al.  A New Venous Entry Detection Method Based on Electrical Bio-impedance Sensing , 2018, Annals of Biomedical Engineering.

[7]  Sverre Grimnes,et al.  Bioimpedance and Bioelectricity Basics , 2000 .

[8]  Darwin G. Caldwell,et al.  A venipuncture detection system for robot-assisted intravenous catheterization , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[9]  D. Caldwell,et al.  A hand-held robotic device for peripheral intravenous catheterization , 2017, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[10]  Rüdiger Dillmann,et al.  Bridging the gap between formal and experience-based knowledge for context-aware laparoscopy , 2016, International Journal of Computer Assisted Radiology and Surgery.

[11]  D. Oleynikov,et al.  Review of surgical robotics user interface: what is the best way to control robotic surgery? , 2012, Surgical Endoscopy.

[12]  R. Autorino,et al.  Robot-assisted Versus Standard Laparoscopy for Simple Prostatectomy: Multicenter Comparative Outcomes. , 2016, Urology.

[13]  Sverre Grimnes,et al.  Impedance-based tissue discrimination for needle guidance , 2009, Physiological measurement.

[14]  Leonardo S. Mattos,et al.  Virtual Assistive System for Robotic Single IncisionLaparoscopic Surgery , 2014 .

[15]  N. Chauveau,et al.  In vitro tissue characterization and modelling using electrical impedance measurements in the 100 Hz-10 MHz frequency range. , 1995, Physiological measurement.

[16]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[17]  Gerd Hirzinger,et al.  Optimal Hand-Eye Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Dominiek Reynaerts,et al.  Design and evaluation of a new bioelectrical impedance sensor for micro-surgery: application to retinal vein cannulation , 2018, International Journal of Computer Assisted Radiology and Surgery.

[19]  S. Duke Herrell,et al.  Toward image-guided robotic surgery: determining intrinsic accuracy of the da Vinci robot , 2006, International Journal of Computer Assisted Radiology and Surgery.

[20]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Rafael Muñoz-Salinas,et al.  Speeded up detection of squared fiducial markers , 2018, Image Vis. Comput..

[22]  M.A. van Veelen,et al.  Ergonomics in minimally invasive surgery , 2004, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[23]  Somayeh B. Shafiei,et al.  Understanding Cognitive Performance During Robot-Assisted Surgery. , 2015, Urology.