A Research Framework for Virtual-Reality Neurosurgery Based on Open-Source Tools

Fully immersive virtual reality (VR) has the potential to improve neurosurgical planning. However, there is a lack of research tools for this area. We present a research framework for VR neurosurgery based on open-source tools. We showcase the potential of such a framework using clinical data of two patients and research data of one subject. As first step toward practical evaluations, certified neurosurgeons positively assessed the VR visualizations and interactions using head-mounted displays. Methods and findings described in our study thus provide a foundation for research and development of versatile and user-friendly VR tools for improving neurosurgical planning and training.

[1]  Peter Y K Hwang,et al.  VIRTUAL TEMPORAL BONE: AN INTERACTIVE 3‐DIMENSIONAL LEARNING AID FOR CRANIAL BASE SURGERY , 2009, Neurosurgery.

[2]  François Conti,et al.  Virtual reality simulation in neurosurgery: technologies and evolution. , 2013, Neurosurgery.

[3]  Bin Sun,et al.  Clinical evaluation and follow-up outcome of presurgical plan by Dextroscope: a prospective controlled study in patients with skull base tumors. , 2009, Surgical neurology.

[4]  Ivan Ng,et al.  Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas , 2010, British journal of neurosurgery.

[5]  F. Charbel,et al.  Virtual Reality Cerebral Aneurysm Clipping Simulation With Real-Time Haptic Feedback , 2015, Neurosurgery.

[6]  Katrin Amunts,et al.  Interactive 3D visualization of structural changes in the brain of a person with corticobasal syndrome , 2014, Front. Neuroinform..

[7]  Hiroshi Oyama,et al.  PREDICTION OF SURGICAL VIEW OF NEUROVASCULAR DECOMPRESSION USING INTERACTIVE COMPUTER GRAPHICS , 2009, Neurosurgery.

[8]  Jingyu Zhang,et al.  Human brain functional MRI and DTI visualization with virtual reality. , 2011, Quantitative imaging in medicine and surgery.

[9]  Fady Charbel,et al.  Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. , 2006, Studies in health technology and informatics.

[10]  Darlene A Lobel,et al.  Virtual Reality-Based Simulation Training for Ventriculostomy: An Evidence-Based Approach. , 2013, Neurosurgery.

[11]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[12]  Aaron Cohen-Gadol,et al.  Operative Anatomy of the Human Skull: A Virtual Reality Expedition. , 2018, Operative neurosurgery.

[13]  Andreas Schulze-Bonhage,et al.  The role of blood vessels in high-resolution volume conductor head modeling of EEG , 2015, NeuroImage.

[14]  Ying Mao,et al.  Virtual reality presurgical planning for cerebral gliomas adjacent to motor pathways in an integrated 3-D stereoscopic visualization of structural MRI and DTI tractography , 2010, Acta Neurochirurgica.

[15]  Venkata Sreekanth Arikatla,et al.  High fidelity virtual reality orthognathic surgery simulator , 2018, Medical Imaging.

[16]  Robert DiRaddo,et al.  NeuroTouch: A Physics-Based Virtual Simulator for Cranial Microneurosurgery Training , 2012, Neurosurgery.

[17]  Fahad Alotaibi,et al.  Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection , 2015, International Journal of Computer Assisted Radiology and Surgery.

[18]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[19]  Ralf A. Kockro,et al.  Surgical planning for microsurgical excision of cerebral arterio-venous malformations using virtual reality technology , 2009, Acta Neurochirurgica.

[20]  Terry M. Peters,et al.  Visual Enhancement of MR Angiography Images to Facilitate Planning of Arteriovenous Malformation Interventions , 2015, TAP.

[21]  Nolan Ung,et al.  Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery , 2017, Journal of Clinical Neuroscience.

[22]  et al.,et al.  ISLES 2015 ‐ A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI , 2017, Medical Image Anal..

[23]  Susanne P. Lajoie,et al.  Proficiency performance benchmarks for removal of simulated brain tumors using a virtual reality simulator NeuroTouch. , 2015, Journal of surgical education.

[24]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[25]  Anil T Ahuja,et al.  Stereoscopic virtual reality simulation for microsurgical excision of cerebral arteriovenous malformation: case illustrations. , 2009, Surgical neurology.

[26]  A. Ahuja,et al.  CRANIOTOMY AND CLIPPING OF INTRACRANIAL ANEURYSM IN A STEREOSCOPIC VIRTUAL REALITY ENVIRONMENT , 2007, Neurosurgery.

[27]  M. Apuzzo,et al.  Man, mind, and machine: the past and future of virtual reality simulation in neurologic surgery. , 2011, World neurosurgery.

[28]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[29]  R. Del Maestro,et al.  Assessing Bimanual Performance in Brain Tumor Resection With NeuroTouch, a Virtual Reality Simulator , 2015, Neurosurgery.

[30]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[31]  Amir Alansary,et al.  MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans , 2015, Comput. Intell. Neurosci..

[32]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[33]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[34]  J Mocco,et al.  Evolving virtual reality simulation in neurosurgery. , 2013, Neurosurgery.

[35]  Kirby G. Vosburgh,et al.  3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support , 2014 .

[36]  Ali Alaraj,et al.  Role of cranial and spinal virtual and augmented reality simulation using immersive touch modules in neurosurgical training. , 2013, Neurosurgery.

[37]  A. Cohen-Gadol,et al.  Cerebrovascular Operative Anatomy: An Immersive 3D and Virtual Reality Description. , 2018, Operative neurosurgery.

[38]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[39]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..