Deformable multi-modal registration using 3D-FAST conditioned mutual information

Abstract Purpose: Mutual information (MI) has been a preferred choice of similarity measure for multi-modal image registration, but the accuracy and robustness of MI are not satisfactory as MI only considers the global intensity correlation while ignoring local and structural information. To address this problem, we combine MI with local and structural information. Method: We bring structural information extracted by a modified Accelerated Segment Test (FAST) algorithm into MI. Traditional FAST is transferred into 3 D for the first time, and the 3 D-FAST based structural information is added into MI as another channel, thereby incorporating spatial and geometric information with intensity information in the registration. Result: The robustness and accuracy of the proposed method were demonstrated in three experiments. The average registration errors of our method were 1.17, 1.33 and 1.20 compared to 1.47, 1.63 and 1.40 of LMI in T1-T2, T1-PD and T2-PD registration respectively. Discussion: In this paper, we use the structural similarity computed by 3 D-FAST as the conditional information to encode spatial and geometric cues into LMI. In all of these three experiments, our method shows to be more robust and accurate than common registration methods based on information theory.

[1]  Ioannis Patras,et al.  The fast-3D spatio-temporal interest region detector , 2009, 2009 10th Workshop on Image Analysis for Multimedia Interactive Services.

[2]  Michael Brady,et al.  Towards Realtime Multimodal Fusion for Image-Guided Interventions Using Self-similarities , 2013, MICCAI.

[3]  Masud Mansuripur,et al.  Introduction to information theory , 1986 .

[4]  Josien P. W. Pluim,et al.  Evaluation of Optimization Methods for Nonrigid Medical Image Registration Using Mutual Information and B-Splines , 2007, IEEE Transactions on Image Processing.

[5]  D. Louis Collins,et al.  Self-similarity weighted mutual information: A new nonrigid image registration metric , 2014, Medical Image Anal..

[6]  Zhijian Song,et al.  miLBP: a robust and fast modality-independent 3D LBP for multimodal deformable registration , 2016, International Journal of Computer Assisted Radiology and Surgery.

[7]  Nassir Navab,et al.  Entropy and Laplacian images: Structural representations for multi-modal registration , 2012, Medical Image Anal..

[8]  D. Louis Collins,et al.  Automatic Deformable MR-Ultrasound Registration for Image-Guided Neurosurgery , 2015, IEEE Transactions on Medical Imaging.

[9]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Stefan Klein,et al.  Automatic segmentation of the prostate in 3D MR images by atlas matching using localized mutual information. , 2008, Medical physics.

[11]  Tae-Kyun Kim,et al.  Real-time Action Recognition by Spatiotemporal Semantic and Structural Forests , 2010, BMVC.

[12]  Michael Brady,et al.  MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration , 2012, Medical Image Anal..

[13]  Colin Studholme,et al.  Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change , 2006, IEEE Transactions on Medical Imaging.

[14]  Nassir Navab,et al.  Simultaneous Registration of Multiple Images: Similarity Metrics and Efficient Optimization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Max A. Viergever,et al.  Registration of Cervical MRI Using Multifeature Mutual Information , 2009, IEEE Transactions on Medical Imaging.

[16]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[17]  Nassir Navab,et al.  Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention , 2008, Medical Image Anal..

[18]  Nassir Navab,et al.  Automatic ultrasound-MRI registration for neurosurgery using the 2D and 3D LC2 Metric , 2014, Medical Image Anal..

[19]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[20]  A. Cosse,et al.  Diffeomorphic surface-based registration for MR-US fusion in prostate brachytherapy , 2012, 2012 16th IEEE Mediterranean Electrotechnical Conference.

[21]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jiaolong Yang,et al.  Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Zhijian Song,et al.  Fast and robust multimodal image registration using a local derivative pattern , 2017, Medical physics.

[24]  Dinggang Shen,et al.  Multimodality image registration by maximization of quantitative-qualitative measure of mutual information , 2008, Pattern Recognit..

[25]  D. Louis Collins,et al.  Self-similarity Weighted Mutual Information: A New Nonrigid Image Registration Metric , 2012, MICCAI.

[26]  Sung Yong Shin,et al.  Scattered Data Interpolation with Multilevel B-Splines , 1997, IEEE Trans. Vis. Comput. Graph..

[27]  D. Louis Collins,et al.  Nonrigid Registration of Ultrasound and MRI Using Contextual Conditioned Mutual Information , 2014, IEEE Transactions on Medical Imaging.

[28]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[29]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.