A system for video-based navigation for endoscopic endonasal skull base surgery.

Surgeries of the skull base require accuracy to safely navigate the critical anatomy. This is particularly the case for endoscopic endonasal skull base surgery (ESBS) where the surgeons work within millimeters of neurovascular structures at the skull base. Today's navigation systems provide approximately 2 mm accuracy. Accuracy is limited by the indirect relationship of the navigation system, the image and the patient. We propose a method to directly track the position of the endoscope using video data acquired from the endoscope camera. Our method first tracks image feature points in the video and reconstructs the image feature points to produce 3D points, and then registers the reconstructed point cloud to a surface segmented from preoperative computed tomography (CT) data. After the initial registration, the system tracks image features and maintains the 2D-3D correspondence of image features and 3D locations. These data are then used to update the current camera pose. We present a method for validation of our system, which achieves submillimeter (0.70 mm mean) target registration error (TRE) results.

[1]  A. Vedaldi.  An implementation of SIFT detector and descriptor , 2008 .

[2]  Jeffrey H. Siewerdsen,et al.  Fusion of intraoperative cone-beam CT and endoscopic video for image-guided procedures , 2010, Medical Imaging.

[3]  Sébastien Ourselin,et al.  Biopsy Site Re-localisation Based on the Computation of Epipolar Lines from Two Previous Endoscopic Images , 2009, MICCAI.

[4]  Fredric B. Meyer,et al.  Endoscopic Transnasal Pituitary Surgery: Report on 180 Cases , 2001, American journal of rhinology.

[5]  Andrew J. Davison,et al.  Live dense reconstruction with a single moving camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Daniel Mirota,et al.  TREK: an integrated system architecture for intraoperative cone-beam CT-guided surgery , 2011, International Journal of Computer Assisted Radiology and Surgery.

[7]  Darius Burschka,et al.  Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgery , 2005, Medical Image Anal..

[8]  Daniel Mirota,et al.  Intelligent frame selection for anatomic reconstruction from endoscopic video , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[9]  H. C. Longuet-Higgins,et al.  An algorithm for associating the features of two images , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  Daniel Mirota,et al.  A Generalized Kernel Consensus-Based Robust Estimator , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[12]  Russell H. Taylor,et al.  High-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery , 2011, Medical Imaging.

[13]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[14]  Daisuke Deguchi,et al.  Development and comparison of new hybrid motion tracking for bronchoscopic navigation , 2012, Medical Image Anal..

[15]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Gregory Hager,et al.  Direct endoscopic video registration for sinus surgery , 2009, Medical Imaging.

[17]  Hong Yi,et al.  A survey of the marching cubes algorithm , 2006, Comput. Graph..

[18]  Michael I. Miga,et al.  Medical Imaging 2009: Visualization, Image-Guided Procedures, and Modeling , 2009 .

[19]  Jay B. West,et al.  Implementation, calibration and accuracy testing of an image-enhanced endoscopy system , 2002, IEEE Transactions on Medical Imaging.

[20]  Nanning Zheng,et al.  AN Extension of the ICP Algorithm Considering Scale Factor , 2007, 2007 IEEE International Conference on Image Processing.

[21]  Geoffrey McLennan,et al.  CT-video registration accuracy for virtual guidance of bronchoscopy , 2004, SPIE Medical Imaging.

[22]  Armin Kanitsar,et al.  Intra-operative virtual endoscopy for image guided endonasal transsphenoidal pituitary surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[23]  Jeffrey H. Siewerdsen,et al.  High-performance intraoperative cone-beam CT on a mobile C-arm: an integrated system for guidance of head and neck surgery , 2009, Medical Imaging.

[24]  Daniel Mirota,et al.  Toward Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery. , 2009, Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention.

[25]  Christopher J. Taylor,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2009 , 2009, Lecture Notes in Computer Science.

[26]  Jun Sugiyama,et al.  Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images , 2002, Medical Image Anal..

[27]  Rae-Hong Park,et al.  Robust Adaptive Segmentation of Range Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[29]  Wolfgang Konen,et al.  Robust registration procedures for endoscopic imaging , 2007, Medical Image Anal..

[30]  Fabrice Chassat,et al.  Experimental Protocol for Accuracy Evaluation of 6-d Localizers for Computer-Integrated Surgery: Application to Four Optical Localizers , 1998, MICCAI.

[31]  A Linney,et al.  Image‐enhanced surgical navigation for endoscopic sinus surgery: evaluating calibration, registration and tracking , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[32]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[33]  Guang-Zhong Yang,et al.  A Probabilistic Framework for Tracking Deformable Soft Tissue in Minimally Invasive Surgery , 2007, MICCAI.

[34]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[35]  William E. Lorensen,et al.  The NA-MIC Kit: ITK, VTK, pipelines, grids and 3D slicer as an open platform for the medical image computing community , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[36]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Jay B. West,et al.  The distribution of target registration error in rigid-body point-based registration , 2001, IEEE Transactions on Medical Imaging.

[38]  Christian Winne,et al.  Overlay visualization in endoscopic ENT surgery , 2011, International Journal of Computer Assisted Radiology and Surgery.

[39]  Daniel Mirota,et al.  Robust motion estimation and structure recovery from endoscopic image sequences with an Adaptive Scale Kernel Consensus estimator , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Francesca Odone,et al.  SVD-matching using SIFT features , 2006, Graph. Model..

[41]  J BeslPaul,et al.  A Method for Registration of 3-D Shapes , 1992 .

[42]  Edwin Earl Catmull,et al.  A subdivision algorithm for computer display of curved surfaces. , 1974 .