An Integrated Visualization System for Surgical Planning and Guidance Using Image Fusion and Interventional Imaging

We present a software package which uniquely integrates several facets of image-guided medicine into a single portable, extendable environment. It provides capabilities for automatic registration, semi-automatic segmentation, 3D surface model generation, 3D visualization, and quantitative analysis of various medical scans. We describe its system architecture, wide range of applications, and novel integration with an interventional Magnetic Resonance (MR) scanner to augment intra-operative imaging with pre-operative data. Analysis previously reserved for pre-operative data can now be applied to exploring the anatomical changes as the surgery progresses. Surgical instruments are tracked and used to drive the location of reformatted slices. Real-time scans are visualized as slices in the same 3D view along with the pre-operative slices and surface models. The system has been applied in over 20 neurosurgical cases at Brigham and Women’s Hospital, and continues to be routinely used for 1-3 cases per week.

[1]  L. Lunsford,et al.  Intraoperative imaging with a therapeutic computed tomographic scanner. , 1984, Neurosurgery.

[2]  Jocelyne Troccaz,et al.  CVRMed-MRCAS'97 , 1997, Lecture Notes in Computer Science.

[3]  L. D. Lunsford,et al.  Intraoperative imaging with a therapeutic computed tomographic scanner. , 1984, Neurosurgery.

[4]  R Kikinis,et al.  MR-based three-dimensional modeling of the normal pelvic floor in women: quantification of muscle mass. , 2000, AJR. American journal of roentgenology.

[5]  William E. Lorensen,et al.  Decimation of triangle meshes , 1992, SIGGRAPH.

[6]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[7]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[9]  R. Kikinis,et al.  Superconducting open-configuration MR imaging system for image-guided therapy. , 1995, Radiology.

[10]  Jason Trobaugh,et al.  The correction of stereotactic inaccuracy caused by brain shift using an intraoperative ultrasound device , 1997, CVRMed.

[11]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[12]  F. Jolesz,et al.  1996 RSNA Eugene P. Pendergrass New Horizons Lecture. Image-guided procedures and the operating room of the future. , 1997, Radiology.