Augmented reality and cone beam CT guidance for transoral robotic surgery

In transoral robotic surgery preoperative image data do not reflect large deformations of the operative workspace from perioperative setup. To address this challenge, in this study we explore image guidance with cone beam computed tomographic angiography to guide the dissection of critical vascular landmarks and resection of base-of-tongue neoplasms with adequate margins for transoral robotic surgery. We identify critical vascular landmarks from perioperative c-arm imaging to augment the stereoscopic view of a da Vinci si robot in addition to incorporating visual feedback from relative tool positions. Experiments resecting base-of-tongue mock tumors were conducted on a series of ex vivo and in vivo animal models comparing the proposed workflow for video augmentation to standard non-augmented practice and alternative, fluoroscopy-based image guidance. Accurate identification of registered augmented critical anatomy during controlled arterial dissection and en bloc mock tumor resection was possible with the augmented reality system. The proposed image-guided robotic system also achieved improved resection ratios of mock tumor margins (1.00) when compared to control scenarios (0.0) and alternative methods of image guidance (0.58). The experimental results show the feasibility of the proposed workflow and advantages of cone beam computed tomography image guidance through video augmentation of the primary stereo endoscopy as compared to control and alternative navigation methods.

[1]  Naoki Suzuki,et al.  Development of a surgical robot system for endovascular surgery with augmented reality function , 2007, MMVR.

[2]  A Uneri,et al.  Deformable image registration for cone-beam CT guided transoral robotic base-of-tongue surgery , 2013, Physics in medicine and biology.

[3]  Guoyan Zheng,et al.  Augmented reality endoscopic system (ARES): preliminary results. , 2008, Rhinology.

[4]  A. Deguet,et al.  The cisst libraries for computer assisted intervention systems , 2008, The MIDAS Journal.

[5]  Austin Reiter,et al.  Feature Classification for Tracking Articulated Surgical Tools , 2012, MICCAI.

[6]  Lejing Wang,et al.  Precise X-ray and video overlay for augmented reality fluoroscopy , 2012, International Journal of Computer Assisted Radiology and Surgery.

[7]  Osman Ratib,et al.  Augmented reality to the rescue of the minimally invasive surgeon. The usefulness of the interposition of stereoscopic images in the Da Vinci™ robotic console , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[8]  G. Weinstein,et al.  Transoral robotic surgery: A multicenter study to assess feasibility, safety, and surgical margins , 2012, The Laryngoscope.

[9]  Trushar Patel,et al.  A Pilot Study of Laparoscopic Doppler Ultrasound Probe to Map Arterial Vascular Flow within the Neurovascular Bundle during Robot-Assisted Radical Prostatectomy , 2013, Prostate cancer.

[10]  Osman Ratib,et al.  Stereoscopic augmented reality for da Vincii™ robotic biliary surgery. , 2013, International journal of surgery case reports.

[11]  Jonathan M Sorger,et al.  Intraoperative image‐guided transoral robotic surgery: pre‐clinical studies , 2015, The international journal of medical robotics + computer assisted surgery : MRCAS.

[12]  P Bijlenga,et al.  Augmented reality-assisted skull base surgery. , 2014, Neuro-Chirurgie.

[13]  Autoren A. Rieger,et al.  [Augmented reality: merge of reality and virtuality in medicine]. , 2011, Deutsche medizinische Wochenschrift.

[14]  Russell H. Taylor,et al.  High-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery , 2011, Medical Imaging.

[15]  J. Buatti,et al.  The national cancer data base report on squamous cell carcinoma of the base of tongue , 2004, Head & neck.

[16]  David J. Hawkes,et al.  Stereo Augmented Reality in the Surgical Microscope , 2000, Presence: Teleoperators & Virtual Environments.

[17]  F. Costa,et al.  A Prospective Multicenter Registry on the Accuracy of Pedicle Screw Placement in the Thoracic, Lumbar, and Sacral Levels With the Use of the O-arm Imaging System and StealthStation Navigation , 2012, Spine.

[18]  Peter Kazanzides,et al.  Lessons Learned from the Development of Component-Based Medical Robot Systems , 2014 .

[19]  Daniel Mirota,et al.  Evaluation of a System for High-Accuracy 3D Image-Based Registration of Endoscopic Video to C-Arm Cone-Beam CT for Image-Guided Skull Base Surgery , 2013, IEEE Transactions on Medical Imaging.

[20]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[21]  Jonathan M Sorger,et al.  Toward intraoperative image-guided transoral robotic surgery , 2013, Journal of Robotic Surgery.

[22]  William E. Lorensen,et al.  The NA-MIC Kit: ITK, VTK, pipelines, grids and 3D slicer as an open platform for the medical image computing community , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[23]  Stefan Jacobs,et al.  Augmented reality for intraoperative guidance in endoscopic coronary artery bypass grafting. , 2005, Surgical technology international.

[24]  Mauro Ferrari,et al.  Mixed reality for robotic treatment of a splenic artery aneurysm , 2009, Surgical Endoscopy.

[25]  Russell H. Taylor,et al.  Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration. , 2009, Urology.

[26]  G. Weinstein,et al.  Transoral robotic surgery alone for oropharyngeal cancer: an analysis of local control. , 2012, Archives of otolaryngology--head & neck surgery.

[27]  A. Darzi,et al.  Augmented reality partial nephrectomy: examining the current status and future perspectives. , 2014, Urology.

[28]  Jerry L. Prince,et al.  Model-Based Tomographic Reconstruction of Objects Containing Known Components , 2012, IEEE Transactions on Medical Imaging.

[29]  Robert L Galloway,et al.  Toward image guided robotic surgery: system validation. , 2009, The Journal of urology.

[30]  Marco Caversaccio,et al.  Impact of a self-developed planning and self-constructed navigation system on skull base surgery: 10 years experience , 2007, Acta oto-laryngologica.

[31]  Masaru Ishii,et al.  A clinical pilot study of a modular video-CT augmentation system for image-guided skull base surgery , 2012, Medical Imaging.