Augmented Reality Image Overlay Projection for Image Guided Open Liver Ablation of Metastatic Liver Cancer

This work presents an evaluation of a novel augmented reality approach for the visualisation of real time guidance of an ablation tool to a tumor in open liver surgery. The approach uses a portable image overlay device, directly integrated into a liver surgical navigation system, to display guidance graphics along with underlying anatomical structures directly on the liver surface. The guidance application generates trajectories from the current ablation needle tip to the centre of the tumor. Needle alignment guidance and depth information are displayed directly on the liver surface, providing intuitive real-time feedback for guiding the ablation tool tip to the targeted tumor. Validation of the guidance visual feedback on porcine liver tissue showed that the system was useful in trajectory planning and tumor targeting. The augmented reality guidance was easily visible, removed the need for sight diversion and was implemented without imposing any timely or procedural overhead when compared to a navigated procedure itself.

[1]  D. Bentrem,et al.  Surgical therapy for metastatic disease to the liver. , 2005, Annual review of medicine.

[2]  Heinz-Otto Peitgen,et al.  Illustrative visualization of 3D planning models for augmented reality in liver surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[3]  S. Faraone,et al.  Stimulants and Attention-Deficit/Hyperactivity Disorder—Reply , 2004 .

[4]  Hein Putter,et al.  Factors Influencing the Local Failure Rate of Radiofrequency Ablation of Colorectal Liver Metastases , 2006, Annals of Surgical Oncology.

[5]  Frank Sauer,et al.  Augmented reality visualization of ultrasound images: system description, calibration, and features , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[6]  R. Higuchi,et al.  Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery , 2010, Journal of hepato-biliary-pancreatic sciences.

[7]  Logan W. Clements,et al.  Concepts and Preliminary Data Toward the Realization of Image-guided Liver Surgery , 2007, Journal of Gastrointestinal Surgery.

[8]  J. Marescaux,et al.  Augmented-reality-assisted laparoscopic adrenalectomy. , 2004, JAMA.

[9]  Michael A Choti,et al.  Expanding criteria for resectability of colorectal liver metastases. , 2008, The oncologist.

[10]  Heinz-Otto Peitgen,et al.  Assessment of Intraoperative Liver Deformation During Hepatic Resection: Prospective Clinical Study , 2010, World Journal of Surgery.

[11]  Stefan Weber,et al.  A Portable Image Overlay Projection Device for Computer-Aided Open Liver Surgery , 2011, IEEE Transactions on Biomedical Engineering.

[12]  Heinz-Otto Peitgen,et al.  Clinical relevance of model based computer-assisted diagnosis and therapy , 2008, SPIE Medical Imaging.

[13]  Stefan Weber,et al.  Passive Single Marker Tracking for Organ Motion and Deformation Detection in Open Liver Surgery , 2011, IPCAI.

[14]  A M DiGioia,et al.  Augmented reality and its future in orthopaedics. , 1998, Clinical orthopaedics and related research.

[15]  Stefan Wesarg,et al.  Supporting minimal invasive interventions with augmented reality , 2004, CARS.

[16]  Russell H. Taylor,et al.  Information Processing in Computer-Assisted Interventions - Second International Conference, IPCAI 2011, Berlin, Germany, June 22, 2011. Proceedings , 2011, IPCAI.

[17]  Robert L. Galloway,et al.  Compensating for intraoperative soft-tissue deformations using incomplete surface data and finite elements , 2005, IEEE Transactions on Medical Imaging.

[18]  Jean Meunier,et al.  Projector-based augmented reality in surgery without calibration , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[19]  Tim Lüth,et al.  Tracking of the liver for navigation in open surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[20]  Takeo Kanade,et al.  Augmented reality imaging technology for orthopaedic surgery , 2000 .

[21]  C. Baur,et al.  A navigation system for open liver surgery: design, workflow and first clinical applications , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[22]  B. Schwald,et al.  Implementation and Evaluation of an Augmented Reality System Supporting Minimal Invasive Interventions , 2004 .

[23]  Hua Yang,et al.  Optimizing a Head-Tracked Stereo Display System to Guide Hepatic Tumor Ablation , 2008, MMVR.

[24]  O. Ratib,et al.  Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion , 2011, Journal of hepato-biliary-pancreatic sciences.