Remote Computing Environment Compensating for Brain Shift

Objective: Anatomical and functional image data become invalid during an operation due to brain shift. Compensation is achieved by using intraoperative imaging to update anatomical information. To accelerate the registration and visualization of pre- and intraoperative image data, the presented work focuses on remote computing capabilities. The underlying framework efficiently combines local desktop computers and remote high-end graphics workstations exploiting expensive hardware. Methods: By performing all computations on the remote computer, the MR volumes are rigidly aligned via voxel-based registration. Using graphics hardware for acceleration, all interpolation operations are performed with 3D texture-mapping hardware. A new approach then transforms functional markers from preoperative measurements to the intraoperative situation using an automatic tracking algorithm to identify corresponding sulci. Communicating Java viewers are suggested for analyzing the results interactively on a local computer, with all calculations being performed exclusively on the remote computer. Results: The suggested approach was successfully applied in S cases using MR data containing functional markers of MEG and fMRI measurements identifying eloquent brain areas. Remote large-scale graphics hardware was thereby efficiently made available for fast registration and interactive direct volume rendering in neurosurgery. Conclusion: Overall, the presented framework demonstrates efficient access of expensive high- end hardware remotely controlled by thin clients, and further emphasizes the need to compensate for brain shift in functional neuronavigation.

[1]  C. Nimsky,et al.  Quantification of, Visualization of, and Compensation for Brain Shift Using Intraoperative Magnetic Resonance Imaging , 2000, Neurosurgery.

[2]  T. Peters,et al.  Intraoperative ultrasound for guidance and tissue shift correction in image-guided neurosurgery. , 2000, Medical physics.

[3]  Sébastien Ourselin,et al.  Robust Registration of Multi-modal Images: Towards Real-Time Clinical Applications , 2002, MICCAI.

[4]  T. Itakura,et al.  Updating of Neuronavigation Based on Images Intraoperatively Acquired with a Mobile Computerized Tomographic Scanner: Technical Note , 2003, Minimally invasive neurosurgery : MIN.

[5]  Frithjof Kruggel,et al.  Computational cost of nonrigid registration algorithms based on fluid dynamics [MRI time series application] , 2002, IEEE Transactions on Medical Imaging.

[6]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[7]  David J. Hawkes,et al.  Validation of nonrigid image registration using finite-element methods: application to breast MR images , 2003, IEEE Transactions on Medical Imaging.

[8]  Terry M. Peters,et al.  Ultrasound/MRI Overlay with Image Warping for Neurosurgery , 2000, MICCAI.

[9]  Michael W. McDermott,et al.  Brief clinical report: Correlation of functional magnetic source imaging with intraoperative cortical stimulation in neurosurgical patients , 1995 .

[10]  Daniel Rueckert,et al.  Assessment of Intraoperative Brain Deformation Using Interventional MR Imaging , 1999, MICCAI.

[11]  J. Maldjian,et al.  Intraoperative functional MRI using a real-time neurosurgical navigation system. , 1997, Journal of computer assisted tomography.

[12]  James S. Duncan,et al.  Model-driven brain shift compensation , 2002, Medical Image Anal..

[13]  Haiying Liu,et al.  Investigation of intraoperative brain deformation using a 1.5-T interventional MR system: preliminary results , 1998, IEEE Transactions on Medical Imaging.

[14]  C. Strauss,et al.  Magnetic source imaging combined with image-guided frameless stereotaxy: a new method in surgery around the motor strip. , 1997, Neurosurgery.

[15]  Thomas Ertl,et al.  Integrated registration and visualization of medical image data , 1998, Proceedings. Computer Graphics International (Cat. No.98EX149).

[16]  K. Paulsen,et al.  Intraoperatively updated neuroimaging using brain modeling and sparse data. , 1999, Neurosurgery.

[17]  Keith D. Paulsen,et al.  Model-Updated Image-Guided Neurosurgery: Preliminary Analysis Using Intraoperative MR , 2000, MICCAI.

[18]  Josie Wernecke,et al.  The inventor mentor - programming object-oriented 3D graphics with Open Inventor, release 2 , 1993 .

[19]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[20]  Christopher Nimsky,et al.  Remote Analysis for Brain Shift Compensation , 2001, MICCAI.

[21]  C. Nimsky,et al.  Intraoperative compensation for brain shift. , 2001, Surgical neurology.

[22]  Thomas Ertl,et al.  A Framework for Interactive Hardware Accelerated Remote 3D-Visualization , 2000, VisSym.

[23]  W. Hall,et al.  Safety, efficacy, and functionality of high-field strength interventional magnetic resonance imaging for neurosurgery. , 2000, Neurosurgery.

[24]  N. Hata,et al.  Serial Intraoperative Magnetic Resonance Imaging of Brain Shift , 2001, Neurosurgery.

[25]  Karl Rohr,et al.  Coupling of fluid and elastic models for biomechanical simulations of brain deformations using FEM , 2002, Medical Image Anal..

[26]  Colin Studholme,et al.  Automated 3D Registration of Truncated MR and CT Images of the Head , 1995, BMVC.

[27]  Frithjof Kruggel,et al.  Computational Cost of Non-Rigid Registration Algorithms Based on Fluid Dynamics , 2002, IEEE Trans. Medical Imaging.

[28]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[29]  V. Tronnier,et al.  Intraoperative MRI to control the extent of brain tumor surgery , 1998, Der Radiologe.

[30]  Colin Studholme,et al.  Steps Toward a Stereo-Camera-Guided Biomechanical Model for Brain Shift Compensation , 2001, IPMI.

[31]  C. Nimsky,et al.  Intraoperative Magnetic Resonance Imaging Combined with Neuronavigation: A New Concept , 2001, Neurosurgery.

[32]  David J. Hawkes,et al.  Bayesian Estimation of Intra-operative Deformation for Image-Guided Surgery Using 3-D Ultrasound , 2000, MICCAI.

[33]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[34]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[35]  Haiying Liu,et al.  A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations , 2001, MICCAI.

[36]  R. Bernays,et al.  Intraoperative diagnostic and interventional magnetic resonance imaging in neurosurgery. , 1997, Neurosurgery.

[37]  Peter Hastreiter Registrierung und Visualisierung medizinischer Bilddaten unterschiedlicher Modalitäten , 1999 .

[38]  Dinggang Shen,et al.  A Framework for Predictive Modeling of Intra-operative Deformations: A Simulation-Based Study , 2000, MICCAI.

[39]  S. Arridge,et al.  Nonlinear registration using a fluid model with variable viscosity , 1998, NeuroImage.

[40]  Ron Kikinis,et al.  Registration of 3-d intraoperative MR images of the brain using a finite-element biomechanical model , 2000, IEEE Transactions on Medical Imaging.

[41]  Steve Vinoski,et al.  Advanced CORBA® Programming with C++ , 1999 .

[42]  L. Lunsford,et al.  Intraoperative imaging with a therapeutic computed tomographic scanner. , 1984, Neurosurgery.

[43]  D. Louw,et al.  A mobile high-field magnetic resonance system for neurosurgery. , 1999, Journal of neurosurgery.

[44]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[45]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[46]  V. Tronnier,et al.  Intraoperative magnetic resonance imaging to update interactive navigation in neurosurgery: method and preliminary experience. , 1997, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[47]  Thomas Ertl,et al.  Intuitive and Interactive Manipulation of 3D Data Sets by Integrating Texture Mapping Based Volume Rendering into the OpenInventor Class Hierarchy , 1996, Bildverarbeitung für die Medizin.

[48]  Haiying Liu,et al.  Measurement and analysis of brain deformation during neurosurgery , 2003, IEEE Transactions on Medical Imaging.

[49]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[50]  Mary Campione,et al.  The Java tutorial , 1996 .

[51]  Karl Rohr,et al.  Biomechanically based simulation of brain deformations for intraoperative image correction: coupling of elastic and fluid models , 2000, Medical Imaging: Image Processing.

[52]  Christopher Nimsky,et al.  Non-rigid Registration with Use of Hardware-Based 3D Bézier Functions , 2002, MICCAI.

[53]  R. Kikinis,et al.  Development and implementation of intraoperative magnetic resonance imaging and its neurosurgical applications. , 1997, Neurosurgery.

[54]  C. Nimsky,et al.  Integration of functional magnetic resonance imaging supported by magnetoencephalography in functional neuronavigation , 1999, Neurosurgery.

[55]  R. Llinás,et al.  The interactive use of magnetoencephalography in stereotactic image-guided neurosurgery. , 1996, Neurosurgery.

[56]  Christopher Nimsky,et al.  Correlation of Sensorimotor Activation with Functional Magnetic Resonance Imaging and Magnetoencephalography in Presurgical Functional Imaging: A Spatial Analysis , 2001, NeuroImage.

[57]  N. Barbaro,et al.  Correlation of functional magnetic source imaging with intraoperative cortical stimulation in neurosurgical patients. , 1995, Journal of image guided surgery.

[58]  Thomas Ertl,et al.  Combining local and remote visualization techniques for interactive volume rendering in medical applications , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[59]  J. Maldjian,et al.  Functional image-guided surgery of intracranial tumors located in or near the sensorimotor cortex. , 1998, Journal of neurosurgery.

[60]  Thomas Ertl,et al.  Semi-Automatic Registration Of 3D-Multi-Modality Brain Images Based On An Information Theoretic Appr , 1996 .

[61]  P Hastreiter,et al.  Registration techniques for the analysis of the brain shift in neurosurgery , 2000, Comput. Graph..

[62]  Torsten Rohlfing,et al.  Nonrigid image registration in shared-memory multiprocessor environments with application to brains, breasts, and bees , 2003, IEEE Transactions on Information Technology in Biomedicine.

[63]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[64]  Ron Kikinis,et al.  Registration of 3D Intraoperative MR Images of the Brain Using a Finite Element Biomechanical Model , 2001, IEEE Trans. Medical Imaging.

[65]  N. Hata,et al.  Three-Dimensional Optical Flow Method for Measurement of Volumetric Brain Deformation from Intraoperative MR Images , 2000, Journal of computer assisted tomography.

[66]  E. Samset,et al.  Neuronavigation in intraoperative MRI. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[67]  Paul Suetens,et al.  A Viscous Fluid Model for Multimodal Non-rigid Image Registration Using Mutual Information , 2002, MICCAI.

[68]  Ron Kikinis,et al.  Serial registration of intraoperative MR images of the brain , 2002, Medical Image Anal..

[69]  P. J. Hoopes,et al.  In vivo modeling of interstitial pressure in the brain under surgical load using finite elements. , 2000, Journal of biomechanical engineering.