Patient-Specific Virtual Reality Simulation for Minimally Invasive Neurosurgery

The Dextroscope is a surgical planning system that takes advantage of some of the key aspects of virtual reality to maximize the potential of multimodal patient data: two-handed input in 3D and stereoscopic volume-rendering visualization of 3D data. 3D patient models are manipulated in 3D by the surgeon in an easy, intuitive, and flexible manner, without the limitations imposed by mouse and keyboard. It features additionally comprehensive software tools for data segmentation, simulated bone drilling, and simulation of intraoperative views. The Dextrobeam was introduced for use as an educational tool for students and practitioners of anatomy and surgery. It was used in a number of international medical courses and teaching departments.

[1]  R A Kockro,et al.  Minimally invasive cerebral cavernoma surgery using keyhole approaches - solutions for technique-related limitations. , 2009, Minimally invasive neurosurgery : MIN.

[2]  Luis Serra,et al.  The virtual workbench: dextrous VR , 1994 .

[3]  F. Molteni,et al.  Poststroke fixed dystonia of the foot relieved by chronic stimulation of the posterior limb of the internal capsule. , 2009, Journal of neurosurgery.

[4]  Dieter Schmalstieg,et al.  Collaborative Visualization in Augmented Reality , 1998, IEEE Computer Graphics and Applications.

[5]  Ralf A. Kockro,et al.  Surgical planning for microsurgical excision of cerebral arterio-venous malformations using virtual reality technology , 2009, Acta Neurochirurgica.

[6]  Luis Serra,et al.  Neurosurgical craniotomy localization using a virtual reality planning system versus intraoperative image–guided navigation , 2011, International Journal of Computer Assisted Radiology and Surgery.

[7]  Y. Mao,et al.  Preoperative surgical planning for intracranial meningioma resection by virtual reality. , 2012, Chinese medical journal.

[8]  Xiao-Luo Zhang,et al.  Stereoscopic virtual reality presurgical planning for cerebrospinal otorrhea. , 2010, Neurosciences.

[9]  T. Yeo,et al.  A COLLABORATIVE VIRTUAL REALITY ENVIRONMENT FOR NEUROSURGICAL PLANNING AND TRAINING , 2007, Neurosurgery.

[10]  Jose J. González Sánchez,et al.  New stereoscopic virtual reality system application to cranial nerve microvascular decompression , 2010, Acta Neurochirurgica.

[11]  Ying Mao,et al.  Virtual reality presurgical planning for cerebral gliomas adjacent to motor pathways in an integrated 3-D stereoscopic visualization of structural MRI and DTI tractography , 2010, Acta Neurochirurgica.

[12]  M Hayakawa,et al.  Virtual 3-Dimensional Preoperative Planning with the Dextroscope for Excision of a 4th Ventricular Ependymoma , 2007, Minimally invasive neurosurgery : MIN.

[13]  W L Nowinski,et al.  Planning and simulation of neurosurgery in a virtual reality environment. , 2000, Neurosurgery.

[14]  Ru-xiang Xu,et al.  Combined application of virtual imaging techniques and three-dimensional computed tomographic angiography in diagnosing intracranial aneurysms. , 2008, Chinese medical journal.

[15]  Peter Y K Hwang,et al.  VIRTUAL TEMPORAL BONE: AN INTERACTIVE 3‐DIMENSIONAL LEARNING AID FOR CRANIAL BASE SURGERY , 2009, Neurosurgery.

[16]  N. Krayenbühl,et al.  Rapid and accurate anatomical localization of implanted subdural electrodes in a virtual reality environment. , 2012, Journal of neurological surgery. Part A, Central European neurosurgery.

[17]  Luis Serra,et al.  DEX‐RAY: AUGMENTED REALITY NEUROSURGICAL NAVIGATION WITH A HANDHELD VIDEO PROBE , 2009, Neurosurgery.

[18]  Xiao-dong Liu,et al.  Trigeminal neurinomas: clinical features and surgical experience in 84 patients , 2009, Neurosurgical Review.

[19]  Jaehwan Kwon,et al.  Measurements of orbital volume change using computed tomography in isolated orbital blowout fractures. , 2009, Archives of facial plastic surgery.

[20]  Luis Serra,et al.  The Brain Bench: virtual tools for stereotactic frame neurosurgery , 1997, Medical Image Anal..

[21]  R. V. O'Toole,et al.  Assessing Skill and Learning in Surgeons and Medical Students Using a Force Feedback Surgical Simulator , 1998, MICCAI.

[22]  Anil T Ahuja,et al.  Stereoscopic virtual reality simulation for microsurgical excision of cerebral arteriovenous malformation: case illustrations. , 2009, Surgical neurology.

[23]  Wei-jun Tang,et al.  Preoperative evaluation of neurovascular relationships for microvascular decompression in the cerebellopontine angle in a virtual reality environment. , 2010, Journal of neurosurgery.

[24]  Comparative Computation of Orbital Volume From Axial and Coronal CT Using Three-Dimensional Image Analysis , 2010, Ophthalmic plastic and reconstructive surgery.

[25]  Shou-sen Wang,et al.  Stereoscopic virtual reality models for planning tumor resection in the sellar region , 2012, BMC Neurology.

[26]  A. Ahuja,et al.  CRANIOTOMY AND CLIPPING OF INTRACRANIAL ANEURYSM IN A STEREOSCOPIC VIRTUAL REALITY ENVIRONMENT , 2007, Neurosurgery.

[27]  M. Apuzzo,et al.  Man, mind, and machine: the past and future of virtual reality simulation in neurologic surgery. , 2011, World neurosurgery.

[28]  Luis Serra,et al.  Dextrous virtual work , 1996, CACM.

[29]  Qi-Wu Xu,et al.  Anatomical studies on the temporal bridging veins with Dextroscope and its application in tumor surgery across the middle and posterior fossa , 2011, Clinical Neurology and Neurosurgery.

[30]  Wei-Ting Hwang,et al.  Coronary artery findings after left-sided compared with right-sided radiation treatment for early-stage breast cancer. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[31]  N. Hopf,et al.  The Minimally Invasive Supraorbital Subfrontal Key-Hole Approach for Surgical Treatment of Temporomesial Lesions of the Dominant Hemisphere , 2009, Minimally invasive neurosurgery : MIN.

[32]  A. Giese,et al.  Aneurysm Surgery with Preoperative Three-Dimensional Planning in a Virtual Reality Environment: Technique and Outcome Analysis. , 2016, World neurosurgery.

[33]  W. Ng,et al.  The relationship between parasagittal and falcine meningiomas and the superficial cortical veins: a virtual reality study , 2009, Acta Neurochirurgica.

[34]  Y. Mao,et al.  Intraoperative ultrasound assistance in resection of intracranial meningiomas. , 2013, Chinese journal of cancer research = Chung-kuo yen cheng yen chiu.

[35]  J. Barrera,et al.  An Analysis of Malar Fat Volume in Two Age Groups: Implications for Craniofacial Surgery , 2012, Craniomaxillofacial trauma & reconstruction.

[36]  Francesco Acerbi,et al.  Brain Surgery in a Stereoscopic Virtual Reality Environment: A Single Institution's Experience With 100 Cases , 2010, Neurosurgery.

[37]  Jun-Jie Jing,et al.  Virtual reality surgical anatomy of the sphenoid sinus and adjacent structures by the transnasal approach. , 2012, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[38]  Jaehwan Kwon,et al.  Three-Dimensional Analysis of Zygomatic-Maxillary Complex Fracture Patterns , 2010, Craniomaxillofacial trauma & reconstruction.

[39]  Yi Wang,et al.  [Development and clinical application of 3D operative planning system of live in virtual reality environments]. , 2009, Zhonghua wai ke za zhi [Chinese journal of surgery].

[40]  L. Tan,et al.  The use of virtual reality for the functional simulation of hepatic tumors (case control study). , 2010, International journal of surgery.

[41]  Stephan Boor,et al.  Minimally invasive superficial temporal artery to middle cerebral artery bypass through a minicraniotomy: benefit of three-dimensional virtual reality planning using magnetic resonance angiography. , 2009, Neurosurgical focus.

[42]  Fady T. Charbel,et al.  Virtual reality training in neurosurgery: Review of current status and future applications , 2011, Surgical neurology international.

[43]  Y. Mao,et al.  Surgical Strategies in Treating Brainstem Cavernous Malformations , 2011, Neurosurgery.

[44]  Luis Serra,et al.  Interactive tube finding on a Virtual Workbench , 2000 .

[45]  Bin Sun,et al.  Clinical evaluation and follow-up outcome of presurgical plan by Dextroscope: a prospective controlled study in patients with skull base tumors. , 2009, Surgical neurology.

[46]  Marco Caversaccio,et al.  Virtual Simulator as a Training Tool for Endonasal Surgery , 2003, American journal of rhinology.

[47]  Luis Serra,et al.  A three-dimensional computer-based perspective of the skull base. , 2014, World neurosurgery.

[48]  Christopher Schmandt,et al.  Spatial input/display correspondence in a stereoscopic computer graphic work station , 1983, SIGGRAPH.

[49]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[50]  Ivan Ng,et al.  Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas , 2010, British journal of neurosurgery.

[51]  Liang Xue,et al.  A virtual reality model of the clivus and surgical simulation via transoral or transnasal route. , 2014, International journal of clinical and experimental medicine.

[52]  L. L. Tay,et al.  Optimization of ventricular catheter placement via posterior approaches: a virtual reality simulation study. , 2008, Surgical neurology.

[53]  P. Cappabianca,et al.  Extended Endoscopic Endonasal Approaches for Cerebral Aneurysms: Anatomical, Virtual Reality and Morphometric Study , 2014, BioMed research international.

[54]  Fady T. Charbel,et al.  Simulation in Neurosurgery and Neurosurgical Procedures , 2013 .

[55]  Jie Chen,et al.  Three-dimensional virtual reality simulation of periarticular tumors using Dextroscope reconstruction and simulated surgery: a preliminary 10-case study. , 2014, Medical science monitor : international medical journal of experimental and clinical research.

[56]  Mark Billinghurst,et al.  3D palette: a virtual reality content creation tool , 1997, VRST '97.

[57]  Peter Stoeter,et al.  Virtual reality system for planning minimally invasive neurosurgery. Technical note. , 2008, Journal of neurosurgery.

[58]  Luis Serra,et al.  Volume-based tumor neurosurgery planning in the Virtual Workbench , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[59]  R. Kockro,et al.  Mono-stereo-autostereo: the evolution of 3-dimensional neurosurgical planning. , 2013, Neurosurgery.

[60]  N. Hopf,et al.  The keyhole concept in neurosurgery. , 2013, World neurosurgery.

[61]  Henry Sowizral.  Interacting with virtual environments using augmented virtual tools , 1994, Electronic Imaging.

[62]  Luis Serra,et al.  Interactive vessel tracing in volume data , 1997, SI3D.

[63]  M. Downes,et al.  Simulation in Neurosurgery: A Review of Computer-Based Simulation Environments and Their Surgical Applications , 2010, Neurosurgery.

[64]  Michael F. Deering.  The HoloSketch VR sketching system , 1996, CACM.