Stereovision-based integrated system for point cloud reconstruction and simulated brain shift validation

Abstract. Intraoperative soft tissue deformation, referred to as brain shift, compromises the application of current image-guided surgery navigation systems in neurosurgery. A computational model driven by sparse data has been proposed as a cost-effective method to compensate for cortical surface and volumetric displacements. We present a mock environment developed to acquire stereoimages from a tracked operating microscope and to reconstruct three-dimensional point clouds from these images. A reconstruction error of 1 mm is estimated by using a phantom with a known geometry and independently measured deformation extent. The microscope is tracked via an attached tracking rigid body that facilitates the recording of the position of the microscope via a commercial optical tracking system as it moves during the procedure. Point clouds, reconstructed under different microscope positions, are registered into the same space to compute the feature displacements. Using our mock craniotomy device, realistic cortical deformations are generated. When comparing our tracked microscope stereo-pair measure of mock vessel displacements to that of the measurement determined by the independent optically tracked stylus marking, the displacement error was ∼2  mm on average. These results demonstrate the practicality of using tracked stereoscopic microscope as an alternative to laser range scanners to collect sufficient intraoperative information for brain shift correction.

[1]  K. Paulsen,et al.  Modeling of Retraction and Resection for Intraoperative Updating of Images , 2001, Neurosurgery.

[2]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[3]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[4]  C. Nimsky,et al.  Quantification of, Visualization of, and Compensation for Brain Shift Using Intraoperative Magnetic Resonance Imaging , 2000, Neurosurgery.

[5]  Richard I. Hartley,et al.  Theory and Practice of Projective Rectification , 1999, International Journal of Computer Vision.

[6]  P. Perona,et al.  Visual methods for three-dimensional modeling , 1999 .

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Robert L. Galloway,et al.  Cortical surface registration for image-guided neurosurgery using laser-range scanning , 2003, IEEE Transactions on Medical Imaging.

[9]  Benoit M. Dawant,et al.  Persistent and automatic intraoperative 3D digitization of surfaces under dynamic magnifications of an operating microscope , 2015, Medical Image Anal..

[10]  Benoit M. Dawant,et al.  A novel craniotomy simulation system for evaluation of stereo-pair reconstruction fidelity and tracking , 2016, SPIE Medical Imaging.

[11]  N. Hata,et al.  Serial Intraoperative Magnetic Resonance Imaging of Brain Shift , 2001, Neurosurgery.

[12]  J Persliden,et al.  Mobile computerized tomography scanning in the neurosurgery intensive care unit: increase in patient safety and reduction of staff workload. , 2000, Journal of neurosurgery.

[13]  Benoit M Dawant,et al.  Incorporation of a laser range scanner into image-guided liver surgery: surface acquisition, registration, and tracking. , 2003, Medical physics.

[14]  R L Galloway,et al.  The process and development of image-guided procedures. , 2001, Annual review of biomedical engineering.

[15]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  T. B. Müller,et al.  Intra-operative 3D ultrasound in neurosurgery , 2006, Acta Neurochirurgica.