An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases

We present in this paper an augmented reality guidance system for liver thermal ablation in interventional radiology. To show the relevance of our methodology, the system is incrementally evaluated on an abdominal phantom and then on patients in the operating room. The system registers in a common coordinate system a preoperative image of the patient and the position of the needle that the practitioner manipulates. The breathing motion uncertainty is taken into account with a respiratory gating technique: the preoperative image and the guidance step are synchronized on expiratory phases. In order to fulfil the real-time constraints, we have developed and validated algorithms that automatically process and extract feature points. Since the guidance interface is also a major component of the system effectiveness, we validate the overall targeting accuracy on an abdominal phantom. This experiment showed that a practitioner can reach a predefined target with an accuracy of 2mm with an insertion time below one minute. Finally, we propose a passive evaluation protocol of the overall system in the operating room during five interventions on patients. These experiments show that the system can provide a guidance information during expiratory phases with an error below 5mm.

[1]  R K Ten Haken,et al.  The reproducibility of organ position using active breathing control (ABC) during liver radiotherapy. , 2001, International journal of radiation oncology, biology, physics.

[2]  Michael B Sharpe,et al.  Significant reductions in heart and lung doses using deep inspiration breath hold with active breathing control and intensity-modulated radiation therapy for patients treated with locoregional breast irradiation. , 2003, International journal of radiation oncology, biology, physics.

[3]  Luc Soler,et al.  An augmented reality system to guide radio-frequency tumour ablation: Research Articles , 2005 .

[4]  Ken Masamune,et al.  System for robotically assisted prostate biopsy and therapy with intraoperative CT guidance. , 2002, Academic radiology.

[5]  J. McGahan,et al.  Radiofrequency ablation of the liver: current status. , 2001, AJR. American journal of roentgenology.

[6]  Christophe Aubé,et al.  Iconography : Radiofrequency thermal ablation of liver carcinoma , 2008 .

[7]  Stéphane Nicolau Un système de réalité augmentée pour guider les opérations du foie en radiologie interventionnelle , 2004 .

[8]  Olivier D. Faugeras,et al.  HYPER: A New Approach for the Recognition and Positioning of Two-Dimensional Objects , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Nassir Navab,et al.  Needle placement under X-ray fluoroscopy using perspective invariants , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[10]  Hideaki Tsuda,et al.  An Increase in Body Temperature During Radiofrequency Ablation of Liver Tumors , 2002, Anesthesia and analgesia.

[11]  Jérôme Tonetti,et al.  Percutaneous Computer Assisted Iliosacral Screwing: Clinical Validation , 2000, MICCAI.

[12]  Alexandre Hostettler,et al.  A Real-Time Predictive Simulation of Abdominal Organ Positions Induced by Free Breathing , 2008, ISBMS.

[13]  Marie-Odile Berger,et al.  Intra- and intre-observer variability in the angiographic delineation of brain arterio-venous malformations , 2003, CARS.

[14]  Luc Soler,et al.  An augmented reality system to guide radio‐frequency tumour ablation , 2005, Comput. Animat. Virtual Worlds.

[15]  Nassir Navab,et al.  A New Robotic System for Visually Controlled Percutaneous Inerventions under CT Fluoroscopy , 2000, MICCAI.

[16]  K. Lam,et al.  Improvement of CT-based treatment-planning models of abdominal targets using static exhale imaging. , 1998, International journal of radiation oncology, biology, physics.

[17]  Dan Stoianovici,et al.  Robotic Assisted Radio-Frequency Ablation of Liver Tumors - Randomized Patient Study , 2005, MICCAI.

[18]  Heinrich Niemann,et al.  Augmented reality system for MR-guided interventions: phantom studies and first animal test , 2004, Medical Imaging: Image-Guided Procedures.

[19]  Henry Fuchs,et al.  Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms , 2002, Medical Image Anal..

[20]  E. Yorke,et al.  Respiratory gating for liver tumors: Use in dose escalation , 2003 .

[21]  Luc Soler,et al.  An Accuracy Certified Augmented Reality System for Therapy Guidance , 2004, ECCV.

[22]  Frank Sauer,et al.  Augmented reality visualization of ultrasound images: system description, calibration, and features , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[23]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[24]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[25]  Jacques Gangloff,et al.  CTBot: A stereotactic-guided robotic assistant for percutaneous procedures of the abdomen , 2005, SPIE Medical Imaging.

[26]  Patrick Pessaux,et al.  Radiofrequency thermal ablation of liver carcinoma. Prospective study of 82 lesions. , 2006, Gastroenterologie clinique et biologique.

[27]  Lena Maier-Hein,et al.  Precision Targeting of Liver Lesions with a Needle-Based Soft Tissue Navigation System , 2007, MICCAI.

[28]  N. Ayache,et al.  Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery , 2001 .

[29]  George D. Stetten,et al.  Towards a clinically useful sonic flashlight , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[30]  Ken Masamune,et al.  Image overlay guidance for needle insertion in CT scanner , 2005, IEEE Transactions on Biomedical Engineering.

[31]  Philippe L. Pereira,et al.  Actual role of radiofrequency ablation of liver metastases , 2007, European Radiology.

[32]  Russell H. Taylor,et al.  Robotically assisted intraoperative ultrasound with application to ablative therapy of liver cancer , 2003, SPIE Medical Imaging.

[33]  Guang-Zhong Yang,et al.  Freehand Cocalibration of Optical and Electromagnetic Trackers for Navigated Bronchoscopy , 2004, MIAR.

[34]  Ramin Shahidi,et al.  Validation of medical image processing in image-guided therapy , 2002, IEEE Transactions on Medical Imaging.

[35]  Hui Zhang,et al.  Two-Stage Registration for Real-Time Deformable Compensation Using an Electromagnetic Tracking Device , 2005, MICCAI.

[36]  J. Wong,et al.  The use of active breathing control (ABC) to reduce margin for breathing motion. , 1999, International journal of radiation oncology, biology, physics.

[37]  Colin Studholme,et al.  Visual assessment of the accuracy of retrospective registration of MR and CT images of the brain , 1998, IEEE Transactions on Medical Imaging.

[38]  Nassir Navab,et al.  Interventions under Video-Augmented X-Ray Guidance: Application to Needle Placement , 2000, MICCAI.

[39]  K. Cleary,et al.  Assessment of hepatic motion secondary to respiration for computer assisted interventions. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[40]  Tomas Lozano-Perez,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1996 .

[41]  Pierre Soille,et al.  Morphological Image Analysis , 1999 .

[42]  J. Kaspersen,et al.  Laparoscopic navigation pointer for three-dimensional image–guided surgery , 2004, Surgical Endoscopy And Other Interventional Techniques.

[43]  Ken Masamune,et al.  Needle Insertion in CT Scanner with Image Overlay - Cadaver Studies , 2004, MICCAI.

[44]  S A Curley Radiofrequency Ablation of Malignant Liver Tumors , 2001, The oncologist.

[45]  Nassir Navab,et al.  Robot control by fluoroscopic guidance for minimally invasive spine procedures , 2004, CARS.