Evaluation of a novel navigation platform for laparoscopic liver surgery with organ deformation compensation using injected fiducials

In laparoscopic liver resection, surgeons conventionally rely on anatomical landmarks detected through a laparoscope, preoperative volumetric images and laparoscopic ultrasound to compensate for the challenges of minimally invasive access. Image guidance using optical tracking and registration procedures is a promising tool, although often undermined by its inaccuracy. This study evaluates a novel surgical navigation solution that can compensate for liver deformations using an accurate and effective registration method. The proposed solution relies on a robotic C-arm to perform registration to preoperative CT/MRI image data and allows for intraoperative updates during resection using fluoroscopic images. Navigation is offered both as a 3D liver model with real-time instrument visualization, as well as an augmented reality overlay on the laparoscope camera view. Testing was conducted through a pre-clinical trial which included four porcine models. Accuracy of the navigation system was measured through two evaluation methods: liver surface fiducials reprojection and a comparison between planned and navigated resection margins. Target Registration Error with the fiducials evaluation shows that the accuracy in the vicinity of the lesion was 3.78±1.89 mm. Resection margin evaluations resulted in an overall median accuracy of 4.44 mm with a maximum error of 9.75 mm over the four subjects. The presented solution is accurate enough to be potentially clinically beneficial for surgical guidance in laparoscopic liver surgery.

[2]  Adrien Bartoli,et al.  Preoperative liver registration for augmented monocular laparoscopy using backward–forward biomechanical simulation , 2018, International Journal of Computer Assisted Radiology and Surgery.

[3]  B. Edwin,et al.  Margin status after laparoscopic resection of colorectal liver metastases: does a narrow resection margin have an influence on survival and local recurrence? , 2014, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[4]  Luc Soler,et al.  Automatic localization of endoscope in intraoperative CT image: A simple approach to augmented reality guidance in laparoscopic surgery , 2016, Medical Image Anal..

[5]  Wei Cai,et al.  Augmented reality navigation for liver resection with a stereoscopic laparoscope , 2020, Comput. Methods Programs Biomed..

[6]  Luc Soler,et al.  The status of augmented reality in laparoscopic surgery as of 2016 , 2017, Medical Image Anal..

[7]  O. J. Elle,et al.  The effect of intraoperative imaging on surgical navigation for laparoscopic liver resection surgery , 2019, Scientific Reports.

[8]  D. Shen,et al.  SLIR: Synthesis, localization, inpainting, and registration for image-guided thermal ablation of liver tumors , 2020, Medical Image Anal..

[9]  D. Gansawat,et al.  Integration of Image Processing from the Insight Toolkit (ITK) and the Visualization Toolkit (VTK) in Java Language for Medical Imaging Applications , 2009 .

[10]  Sébastien Ourselin,et al.  Accuracy validation of an image guided laparoscopy system for liver resection , 2015, Medical Imaging.

[11]  Luc Soler,et al.  Real-time 3D image reconstruction guidance in liver resection surgery. , 2014, Hepatobiliary surgery and nutrition.

[12]  Luc Soler,et al.  Trans-thoracic minimally invasive liver resection guided by augmented reality. , 2015, Journal of the American College of Surgeons.

[13]  Luc Soler,et al.  Patient specific anatomy: the new area of anatomy based on computer science illustrated on liver. , 2015, Journal of visualized surgery.

[14]  Douglas G. Altman,et al.  Statistics with confidence: Confidence intervals and statistical guidelines . , 1990 .

[15]  G. Fichtinger,et al.  Utility of 3D Reconstruction of 2D Liver Computed Tomography/Magnetic Resonance Images as a Surgical Planning Tool for Residents in Liver Resection Surgery. , 2017, Journal of surgical education.

[16]  Ali Serdar Gözen,et al.  Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. , 2009, European urology.

[17]  E. de Santibañes,et al.  Parenchymal-sparing liver surgery in patients with colorectal carcinoma liver metastases. , 2016, World journal of gastrointestinal surgery.

[18]  O. J. Elle,et al.  Portal and Hepatic Vein Segmentation with Leak Restriction: A Pilot Study , 2017 .

[19]  S. Weber,et al.  Efficiency, Accuracy and Clinical Applicability of a New Image-Guided Surgery System in 3D Laparoscopic Liver Surgery , 2019, Journal of Gastrointestinal Surgery.

[20]  B. Siewert,et al.  Safety profile and technical success of imaging-guided percutaneous fiducial seed placement with and without core biopsy in the abdomen and pelvis. , 2012, AJR. American journal of roentgenology.

[21]  G. Wakabayashi,et al.  The Southampton Consensus Guidelines for Laparoscopic Liver Surgery: From Indication to Implementation , 2017, Annals of surgery.

[22]  Lilian Calvet,et al.  Combining Visual Cues with Interactions for 3D–2D Registration in Liver Laparoscopy , 2020, Annals of Biomedical Engineering.

[23]  O. J. Elle,et al.  Use of mixed reality for improved spatial understanding of liver anatomy , 2019, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[24]  Morten Wang Fagerland,et al.  Quality of life from a randomized trial of laparoscopic or open liver resection for colorectal liver metastases , 2019, The British journal of surgery.

[25]  Nazim Haouchine,et al.  Patient-Specific Biomechanical Modeling for Guidance During Minimally-Invasive Hepatic Surgery , 2015, Annals of Biomedical Engineering.

[26]  Ara Darzi,et al.  Patient-Specific Simulation of Pneumoperitoneum for Laparoscopic Surgical Planning , 2019, Journal of Medical Systems.

[27]  J. Marescaux,et al.  Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy , 2015, Langenbeck's Archives of Surgery.

[28]  O. J. Elle,et al.  Influence of sampling accuracy on augmented reality for laparoscopic image-guided surgery , 2020, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[29]  Alexandre Hostettler,et al.  New intraoperative imaging technologies: Innovating the surgeon’s eye toward surgical precision , 2018, Journal of surgical oncology.

[30]  Y. Shibamoto,et al.  Percutaneous fiducial marker placement prior to stereotactic body radiotherapy for malignant liver tumors: an initial experience , 2016, Journal of radiation research.

[31]  Luc Soler,et al.  An Augmented Reality Framework for Soft Tissue Surgery , 2014, MICCAI.

[32]  Luc Soler,et al.  Biomechanically Driven Registration of Pre- to Intra-Operative 3D Images for Laparoscopic Surgery , 2013, MICCAI.

[33]  J. Marescaux,et al.  Virtual and Augmented Reality in Oncologic Liver Surgery. , 2019, Surgical oncology clinics of North America.

[34]  G. Wakabayashi,et al.  Parenchymal Sparing Anatomical Liver Resections With Full Laparoscopic Approach: Description of Technique and Short-term Results. , 2019, Annals of surgery.

[35]  Jae Hyun Kim,et al.  Safety and Efficacy of Ultrasound-Guided Fiducial Marker Implantation for CyberKnife Radiation Therapy , 2012, Korean Journal of Radiology.

[36]  Onur Mutlu,et al.  Accelerating B-spline Interpolation on GPUs: Application to Medical Image Registration , 2020, Comput. Methods Programs Biomed..

[37]  Albert Koong,et al.  Safety and efficacy of percutaneous fiducial marker implantation for image-guided radiation therapy. , 2009, Journal of vascular and interventional radiology : JVIR.

[38]  Faouzi Alaya Cheikh,et al.  A novel method for planning liver resections using deformable Bézier surfaces and distance maps , 2017, Comput. Methods Programs Biomed..

[39]  Sébastien Ourselin,et al.  In vivo estimation of target registration errors during augmented reality laparoscopic surgery , 2018, International Journal of Computer Assisted Radiology and Surgery.

[40]  B. Edwin,et al.  Laparoscopic Parenchyma-sparing Liver Resection for Colorectal Metastases , 2017, Radiology and oncology.

[41]  J. L. Moyano-Cuevas,et al.  Anatomical changes due to pneumoperitoneum analyzed by MRI: an experimental study in pigs , 2011, Surgical and Radiologic Anatomy.

[42]  Zeev Gross,et al.  Cell-Penetrating Protein/Corrole Nanoparticles , 2019, Scientific Reports.

[43]  Alexandre Hostettler,et al.  An in vivo porcine dataset and evaluation methodology to measure soft-body laparoscopic liver registration accuracy with an extended algorithm that handles collisions , 2019, International Journal of Computer Assisted Radiology and Surgery.

[44]  Luc Soler,et al.  An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases , 2009, Medical Image Anal..

[45]  A. Kramar,et al.  Novel technique for hepatic fiducial marker placement for stereotactic body radiation therapy. , 2014, International journal of radiation oncology, biology, physics.

[46]  Z. Hamady,et al.  One-Millimeter Cancer-Free Margin Is Curative for Colorectal Liver Metastases: A Propensity Score Case-Match Approach , 2014, Annals of surgery.

[47]  James C. Bezdek,et al.  Objective Function Clustering , 1981 .

[48]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[49]  Luc Soler,et al.  Augmented Reality Guidance for the Resection of Missing Colorectal Liver Metastases: An Initial Experience , 2016, World Journal of Surgery.