Structural Representations for Multi-modal Image Registration Based on Modified Entropy

Registration of multi-modal images has been a challenging task due to the complex intensity relationship between images. The standard multi-modal approach tends to use sophisticated similarity measures, such as mutual information, to assess the accuracy of the alignment. Employing such measures imply the increase in the computational time and complexity, and makes it highly difficult for the optimization process to converge. A new registration method is proposed based on introducing a structural representation of images captured from different modalities, in order to convert the multi-modal problem into a mono-modal one. Structural features are extracted by utilizing a modified version of entropy images in a patch-based manner. Experiments are performed on simulated and real brain images from different modalities. Quantitative assessments demonstrate that better accuracy can be achieved compared to the conventional multi-modal registration method.

[1]  D. Hill,et al.  Non-rigid image registration: theory and practice. , 2004, The British journal of radiology.

[2]  D. Louis Collins,et al.  Nonrigid Registration of Ultrasound and MRI Using Contextual Conditioned Mutual Information , 2014, IEEE Transactions on Medical Imaging.

[3]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2010, IEEE Transactions on Medical Imaging.

[4]  David A. Clausi,et al.  CPOL: Complex phase order likelihood as a similarity measure for MR-CT registration , 2010, Medical Image Anal..

[5]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[6]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[7]  Jong Beom Ra,et al.  Multi-sensor image registration based on intensity and edge orientation information , 2008, Pattern Recognit..

[8]  David A. Clausi,et al.  Multi-modal image registration using structural features , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Nassir Navab,et al.  Structural image representation for image registration , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[10]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[11]  Eldad Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2006, MICCAI.

[12]  D. Louis Collins,et al.  Self-similarity weighted mutual information: A new nonrigid image registration metric , 2014, Medical Image Anal..

[13]  David A. Clausi,et al.  Cross modality label fusion in multi-atlas segmentation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[14]  Magdy A. Bayoumi,et al.  A multi-modal automatic image registration technique based on complex wavelets , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  Amir Averbuch,et al.  Multisensor image registration via implicit similarity , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.