Development and evaluation of a “trackerless” surgical planning and guidance system based on 3D Slicer

Abstract. Conventional optical tracking systems use cameras sensitive to near-infrared (NIR) light and NIR illuminated/active-illuminating markers to localize instrumentation and the patient in the operating room (OR) physical space. This technology is widely used within the neurosurgical theater and is a staple in the standard of care for craniotomy planning. To accomplish, planning is largely conducted at the time of the procedure in the OR with the patient in a fixed head orientation. We propose a framework to achieve this in the OR without conventional tracking technology, i.e., a “trackerless” approach. Briefly, we investigate an extension of the 3D Slicer which combines surgical planning and craniotomy designation. While taking advantage of the well-developed 3D Slicer platform, we implement advanced features to aid the neurosurgeon in planning the location of the anticipated craniotomy relative to the preoperatively imaged tumor in a physical-to-virtual setup, and then subsequently aid the true physical procedure by correlating that physical-to-virtual plan with an intraoperative magnetic resonance imaging-to-physical registered field-of-view display. These steps are done such that the craniotomy can be designated without the use of a conventional optical tracking technology. To test this approach, four experienced neurosurgeons performed experiments on five different surgical cases using our 3D Slicer module as well as the conventional procedure for comparison. The results suggest that our planning system provides a simple, cost-efficient, and reliable solution for surgical planning and delivery without the use of conventional tracking technologies. We hypothesize that the combination of this craniotomy planning approach and our past developments in cortical surface registration and deformation tracking using stereo-pair data from the surgical microscope may provide a fundamental realization of an integrated trackerless surgical guidance platform.

[1]  Valerie Duay,et al.  A method to track cortical surface deformations using a laser range scanner , 2005, IEEE Transactions on Medical Imaging.

[2]  Benoit M. Dawant,et al.  Integrated system for point cloud reconstruction and simulated brain shift validation using tracked surgical microscope , 2017, Medical Imaging.

[3]  Michael I. Miga,et al.  Clinical evaluation of a model-updated image-guidance approach to brain shift compensation: experience in 16 cases , 2016, International Journal of Computer Assisted Radiology and Surgery.

[4]  Benoit M Dawant,et al.  Stereovision-based integrated system for point cloud reconstruction and simulated brain shift validation , 2017, Journal of medical imaging.

[5]  Michael I. Miga,et al.  Near Real-Time Computer Assisted Surgery for Brain Shift Correction Using Biomechanical Models , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[6]  Randy E. Ellis,et al.  Intraoperative application of hand-held structured light scanning: a feasibility study , 2016, International Journal of Computer Assisted Radiology and Surgery.

[7]  Benoit M. Dawant,et al.  Trackerless surgical image-guided system design using an interactive extension of 3D Slicer , 2018, Medical Imaging.

[8]  B M Dawant,et al.  Laser range scanning for image-guided neurosurgery: investigation of image-to-physical space registrations. , 2008, Medical physics.

[9]  Robert L. Galloway,et al.  Cortical surface registration for image-guided neurosurgery using laser-range scanning , 2003, IEEE Transactions on Medical Imaging.

[10]  Benoit M. Dawant,et al.  A novel craniotomy simulation system for evaluation of stereo-pair reconstruction fidelity and tracking , 2016, SPIE Medical Imaging.

[11]  Andras Lasso,et al.  PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems , 2014, IEEE Transactions on Biomedical Engineering.

[12]  Leo Joskowicz,et al.  Validation of a stereo camera system to quantify brain deformation due to breathing and pulsatility. , 2014, Medical physics.

[13]  Michael I Miga,et al.  Android application for determining surgical variables in brain-tumor resection procedures , 2017, Journal of medical imaging.

[14]  Alexandra J. Golby,et al.  Intra-operative Measurement of Brain Deformation , 2019, Biomechanics of the Brain.

[15]  Andras Lasso,et al.  Open-source platforms for navigated image-guided interventions , 2016, Medical Image Anal..