Visualizing the Correspondence of Feature Point Mapping between DICOM Images before and after Surgery

We extract feature point mapping between preoperative and postoperative Digital Imaging and Communications in Medicine (DICOM) images from magnetic resonance imaging (MRI) or from computer tomography (CT). The aim is to quantitatively investigate brain shift during intraoperative surgery. First, using 124 two-dimensional images constituting DICOM, a large number of 2D feature points are extracted as uniformly as possible inside the brain. Next, we extract one pair from the 124 preoperative images and the 124 postoperative images and construct map correspondences of similar feature points with a range of DICOM gray values. If the Euclidean distance between the two feature points in the 2D images is too large, the pair of feature points is deleted to prevent mis-mapping; brain shifts are usually less than 2-3 cm. Finally, we find image pairs with the highest number of mappings from DICOM images before and after surgery (two-dimensional stacked three-dimensional images), and generate graph representing correspondences between image pairs with the highest number. Finally, we visualize 3D correspondences between DICOM images before and after surgery.

[1]  Shaharyar Ahmed Khan Tareen,et al.  A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK , 2018, 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET).

[2]  Christos Davatzikos,et al.  A Comparative Study of Biomechanical Simulators in Deformable Registration of Brain Tumor Images , 2008, IEEE Transactions on Biomedical Engineering.

[3]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[4]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[5]  Michael I. Miga,et al.  Near Real-Time Computer Assisted Surgery for Brain Shift Correction Using Biomechanical Models , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[6]  Michael I. Miga,et al.  Integrating Retraction Modeling Into an Atlas-Based Framework for Brain Shift Prediction , 2013, IEEE Transactions on Biomedical Engineering.

[7]  Alvaro Valencia,et al.  Modeling of Brain Shift Phenomenon for Different Craniotomies and Solid Models , 2012, J. Appl. Math..

[8]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[9]  Yohan Payan,et al.  SOFT TISSUE BIOMECHANICAL MODELING FOR COMPUTER ASSISTED SURGERY: CHALLENGES AND PERSPECTIVES , 2016 .

[10]  James S. Duncan,et al.  Volumetric Intraoperative Brain Deformation Compensation: Model Development and Phantom Validation , 2012, IEEE Transactions on Medical Imaging.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  Kari Pulli,et al.  Realtime Computer Vision with OpenCV , 2012, ACM Queue.

[13]  Simon K. Warfield,et al.  Enhanced FEM-based modeling of brain shift deformation in Image-Guided Neurosurgery , 2010, J. Comput. Appl. Math..