Virtual Reality Neurosurgery: A Simulator Blueprint

OBJECTIVEThis article details preliminary studies undertaken to integrate the most relevant advancements across multiple disciplines in an effort to construct a highly realistic neurosurgical simulator based on a distributed computer architecture. Techniques based on modified computational modeling paradigms incorporating finite element analysis are presented, as are current and projected efforts directed toward the implementation of a novel bidirectional haptic device. METHODSPatient-specific data derived from noninvasive magnetic resonance imaging sequences are used to construct a computational model of the surgical region of interest. Magnetic resonance images of the brain may be coregistered with those obtained from magnetic resonance angiography, magnetic resonance venography, and diffusion tensor imaging to formulate models of varying anatomic complexity. RESULTSThe majority of the computational burden is encountered in the presimulation reduction of the computational model and allows realization of the required threshold rates for the accurate and realistic representation of real-time visual animations. CONCLUSIONIntracranial neurosurgical procedures offer an ideal testing site for the development of a totally immersive virtual reality surgical simulator when compared with the simulations required in other surgical subspecialties. The material properties of the brain as well as the typically small volumes of tissue exposed in the surgical field, coupled with techniques and strategies to minimize computational demands, provide unique opportunities for the development of such a simulator. Incorporation of real-time haptic and visual feedback is approached here and likely will be accomplished soon.

[1]  Louis B. Rosenberg,et al.  A volumetric approach to virtual simulation of functional endoscopic sinus surgery. , 1997, Studies in health technology and informatics.

[2]  C Schaller,et al.  Image guided microsurgery with a semifreehand neuronavigational device. , 1997, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[3]  Katia P. Sycara,et al.  The RETSINA MAS Infrastructure , 2003, Autonomous Agents and Multi-Agent Systems.

[4]  R. Goodman,et al.  Effects of coregistration of MR to CT images on MR stereotactic accuracy. , 1995, Journal of neurosurgery.

[5]  Alexander I. Rudnicky Language Modeling with Limited Domain Data , 1995 .

[6]  C. Matula,et al.  Image-guided neurosurgery comparing a pointer device system with a navigating microscope: a retrospective analysis of 208 cases. , 1998, Minimally invasive neurosurgery : MIN.

[7]  H Yoshida,et al.  A surgical simulation system of skin sutures using a three-dimensional finite element method. , 2001, Clinical biomechanics.

[8]  A Millman,et al.  Virtual reality surgical simulation in endoscopic urologic surgery. , 1996, Studies in health technology and informatics.

[9]  Jean-Philippe Thiran,et al.  Interactive DICOM image transmission and telediagnosis over the European ATM network , 1998, IEEE Transactions on Information Technology in Biomedicine.

[10]  S Weghorst,et al.  The representation of blood flow in endourologic surgical simulations. , 2001, Studies in health technology and informatics.

[11]  S K Mun,et al.  Experience implementing a DICOM 3.0 multivendor teleradiology network. , 1998, Telemedicine journal : the official journal of the American Telemedicine Association.

[12]  Arthur C. Curtis,et al.  Technology Evaluation: Comparative Evaluation of Three Continuous Speech Recognition Software Packages in the Generation of Medical Reports , 2000, J. Am. Medical Informatics Assoc..

[13]  V. Lowe,et al.  Triple-technique (MR imaging, single-photon emission CT, and CT) coregistration for image-guided surgical evaluation of patients with intractable epilepsy. , 1999, AJNR. American journal of neuroradiology.

[14]  K. Miller,et al.  Constitutive model of brain tissue suitable for finite element analysis of surgical procedures. , 1999, Journal of biomechanics.

[15]  M. C. Lee,et al.  Finite element analysis of cerebral contusion. , 1994, Journal of biomechanics.

[16]  J R Adler,et al.  Clinical experience with image-guided robotic radiosurgery (the Cyberknife) in the treatment of brain and spinal cord tumors. , 1998, Neurologia medico-chirurgica.

[17]  M Motoyoshi,et al.  Finite element model of facial soft tissue. Effects of thickness and stiffness on changes following simulation of orthognathic surgery. , 1993, The Journal of Nihon University School of Dentistry.

[18]  M. Bro-Nielsen Fast finite elements for surgery simulation. , 1997, Studies in health technology and informatics.

[19]  A C Dumay,et al.  Endoscopic surgery simulation in a virtual environment. , 1995, Computers in biology and medicine.

[20]  T. Brinker,et al.  An Experimental Approach to Image Guided Skull Base Surgery Employing a Microscope-Based Neuronavigation System , 1998, Acta Neurochirurgica.

[21]  D. Lemoine,et al.  The RETAIN project: dicom teleradiology over an ATM-based network , 2000, European Radiology.

[22]  G. Pearlson,et al.  Diffusion Tensor Imaging and Axonal Tracking in the Human Brainstem , 2001, NeuroImage.

[23]  Gareth J. Barker,et al.  Estimating distributed anatomical connectivity using fast marching methods and diffusion tensor imaging , 2002, IEEE Transactions on Medical Imaging.

[24]  B. Ramamurthi Management of tuberculomas of the craniovertebral junction , 2000, British journal of neurosurgery.

[25]  K. Paulsen,et al.  A computational model for tracking subsurface tissue deformation during stereotactic neurosurgery , 1999, IEEE Transactions on Biomedical Engineering.

[26]  Surgical simulators reproduce experience of laparoscopic surgery. , 1995, Minimally invasive surgical nursing.

[27]  J C Brust Nobels, neurologists, and Moore’s law , 2001, Current neurology and neuroscience reports.

[28]  Volkmar Glauche,et al.  Distortion-free Diffusion Tensor Imaging of Cranial Nerves and of Inferior Temporal and Orbitofrontal White Matter , 2002, NeuroImage.

[29]  M. Kraut,et al.  Comparison of weakness progression in inclusion body myositis during treatment with methotrexate or placebo , 2002, Annals of neurology.

[30]  P. Black,et al.  Use of Cortical Surface Vessel Registration for Image-guided Neurosurgery. , 1997, Neurosurgery.

[31]  Sharon L. Oviatt,et al.  Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions , 2000, Hum. Comput. Interact..

[32]  Henry Fuchs,et al.  A sorting classification of parallel rendering , 1994, IEEE Computer Graphics and Applications.

[33]  D Pless,et al.  Multislice CT and Computational Fluid Dynamics: a new technique to visualize, analyze and simulate hemodynamics in aortic aneurysms and stentgrafts. , 2001, Studies in health technology and informatics.

[34]  O. Suess,et al.  Intracranial Image-Guided Neurosurgery: Experience with a new Electromagnetic Navigation System , 2001, Acta Neurochirurgica.

[35]  J M McGregor Enhancing neurosurgical endoscopy with the use of 'virtual reality' headgear. , 1997, Minimally invasive neurosurgery : MIN.

[36]  A Thron,et al.  Three-dimensional Visualization of the Pyramidal Tract in a Neuronavigation System during Brain Tumor Surgery: First Experiences and Technical Note , 2001, Neurosurgery.

[37]  J. Haase Image-guided neurosurgery/neuronavigation/the SurgiScope--reflexions on a theme. , 1999, Minimally invasive neurosurgery : MIN.

[38]  M E McAlarney Use of the boundary element method for biological morphometrics. , 1995, Journal of biomechanics.

[39]  M. Noar,et al.  The next generation of endoscopy simulation: minimally invasive surgical skills simulation. , 1995, Endoscopy.

[40]  M M Bonsanto,et al.  Image-guided neurosurgery with intraoperative MRI: update of frameless stereotaxy and radicality control. , 1997, Stereotactic and functional neurosurgery.

[41]  P. Alken,et al.  Lap simulator, animal studies, and the Laptent , 1993, Surgical Endoscopy.

[42]  U Sure,et al.  Advanced image-guided skull base surgery. , 2000, Surgical neurology.

[43]  Camille Goudeseune,et al.  Syzygy: native PC cluster VR , 2003, IEEE Virtual Reality, 2003. Proceedings..

[44]  Armando Fox,et al.  The Event Heap: a coordination infrastructure for interactive workspaces , 2002, Proceedings Fourth IEEE Workshop on Mobile Computing Systems and Applications.

[45]  Richard M Satava,et al.  Virtual reality surgical simulator: the first steps. 1993. , 2006, Clinical orthopaedics and related research.

[46]  N. Buxton,et al.  Neuroendoscopy combined with frameless neuronavigation. , 2000, British journal of neurosurgery.

[47]  V Devarajan,et al.  Bimanual haptic workstation for laparoscopic surgery simulation. , 2001, Studies in health technology and informatics.

[48]  C. Lumenta,et al.  Neuroendoscopy combined with frameless neuronavigation. , 2000, British journal of neurosurgery.

[49]  L. Ferrari de Oliveira,et al.  Coregistration of brain single-positron emission computed tomography and magnetic resonance images using anatomical features. , 2000, Journal of digital imaging.

[50]  K Masaoka,et al.  The finite element analysis of brain oedema associated with intracranial meningiomas. , 1990, Acta neurochirurgica. Supplementum.

[51]  J. Ashburner,et al.  Multimodal Image Coregistration and Partitioning—A Unified Framework , 1997, NeuroImage.

[52]  T. Nose,et al.  Image-guided procedures in brain biopsy. , 1999, Neurologia medico-chirurgica.

[53]  S Manaka,et al.  Open surgery assisted by the neuronavigator, a stereotactic, articulated, sensitive arm. , 1991, Neurosurgery.

[54]  K Miller Non-linear computer simulation of brain deformation. , 2001, Biomedical sciences instrumentation.

[55]  T. Struffert,et al.  Virtual endoscopy combined with intraoperative neuronavigation for planning of endoscopic surgery in patients with occlusive hydrocephalus and intracranial cysts , 2002, Neuroradiology.

[56]  Louis B. Rosenberg,et al.  ENT endoscopic surgical training simulator. , 1997, Studies in health technology and informatics.

[57]  A. Bagó,et al.  Early Experiences With Image-Guided Transoral Surgery for the Pathologies of the Upper Cervical Spine , 2001, Spine.

[58]  Gerald Weisser,et al.  NEUE KONZEPTE IN DER TELERADIOLOGIE MIT DICOM-E-MAIL , 2002 .

[59]  S Weghorst,et al.  Fast finite element modeling for surgical simulation. , 1999, Studies in health technology and informatics.

[60]  I. Stokes,et al.  Three-dimensional simulation of Harrington distraction instrumentation for surgical correction of scoliosis. , 1993, Spine.

[61]  J Buurman,et al.  Interactive image-guided neuroendoscopy: development and early clinical experience. , 1998, Minimally invasive neurosurgery : MIN.

[62]  R. Passingham,et al.  Initial Demonstration of in Vivo Tracing of Axonal Projections in the Macaque Brain and Comparison with the Human Brain Using Diffusion Tensor Imaging and Fast Marching Tractography , 2002, NeuroImage.

[63]  Khader M Hasan,et al.  Diffusion-tensor imaging of white matter tracts in patients with cerebral neoplasm. , 2002, Journal of neurosurgery.

[64]  A Dessl,et al.  Virtual neuroendoscopy, a comparative magnetic resonance and anatomical study. , 1999, Minimally invasive neurosurgery : MIN.

[65]  Hanna Pohjonen,et al.  PACS in Töölö Hospital , 2001, Comput. Methods Programs Biomed..

[66]  M A Srinivasan,et al.  Development and evaluation of an epidural injection simulator with force feedback for medical training. , 2001, Studies in health technology and informatics.

[67]  S Weghorst,et al.  Creating fast finite element models from medical images. , 2000, Studies in health technology and informatics.

[68]  D. Le Bihan,et al.  Diffusion tensor imaging: Concepts and applications , 2001, Journal of magnetic resonance imaging : JMRI.

[69]  M. Apuzzo,et al.  Virtual Reality Surgery: Neurosurgery and the Contemporary Landscape , 2003, Neurosurgery.

[70]  G Weisser,et al.  [New concepts in teleradiology with Dicom e-mail]. , 2002, Biomedizinische Technik. Biomedical engineering.