Multimodality image registration by maximization of quantitative-qualitative measure of mutual information

This paper presents a novel image similarity measure, referred to as quantitative-qualitative measure of mutual information (Q-MI), for multimodality image registration. Conventional information measures, e.g., Shannon's entropy and mutual information (MI), reflect quantitative aspects of information because they only consider probabilities of events. In fact, each event has its own utility to the fulfillment of the underlying goal, which can be independent of its probability of occurrence. Thus, it is important to consider both quantitative (i.e., probability) and qualitative (i.e., utility) measures of information in order to fully capture the characteristics of events. Accordingly, in multimodality image registration, Q-MI should be used to integrate the information obtained from both the image intensity distributions and the utilities of voxels in the images. Different voxels can have different utilities, for example, in brain images, two voxels can have the same intensity value, but their utilities can be different, e.g., a white matter (WM) voxel near the cortex can have higher utility than a WM voxel inside a large uniform WM region. In Q-MI, the utility of each voxel in an image can be determined according to the regional saliency value calculated from the scale-space map of this image. Since the voxels with higher utility values (or saliency values) contribute more in measuring Q-MI of the two images, the Q-MI-based registration method is much more robust, compared to conventional MI-based registration methods. Also, the Q-MI-based registration method can provide a smoother registration function with a relatively larger capture range. In this paper, the proposed Q-MI has been validated and applied to the rigid registrations of clinical brain images, such as MR, CT and PET images.

[1]  James C. Gee,et al.  Using a Linear Diagnostic Function and Non-rigid Registration to Search for Morphological Differences Between Populations: An Example Involving the Male and Female Corpus Callosum , 2001, IPMI.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yang-Ming Zhu,et al.  Likelihood maximization approach to image registration , 2002, IEEE Trans. Image Process..

[4]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[5]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[6]  A. D'Amico,et al.  Evaluation of three-dimensional finite element-based deformable registration of pre- and intraoperative prostate imaging. , 2001, Medical physics.

[7]  David J. Hawkes,et al.  Incorporating connected region labelling into automated image registration using mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[8]  David J. Hawkes,et al.  A normalised entropy measure for multi-modality image alignment , 1998 .

[9]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Murray H. Loew,et al.  Weighted and deterministic entropy measure for image registration using mutual information , 1998, Medical Imaging.

[11]  Colin Studholme,et al.  Accurate alignment of functional EPI data to anatomical MRI using a physics-based distortion model , 2000, IEEE Transactions on Medical Imaging.

[12]  Daniel Rueckert,et al.  Non-rigid registration using higher-order mutual information , 2000, Medical Imaging.

[13]  Colin Studholme,et al.  Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change , 2006, IEEE Transactions on Medical Imaging.

[14]  Dimitris N. Metaxas,et al.  Hybrid Image Registration based on Configural Matching of Scale-Invariant Salient Region Features , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[15]  Takeyoshi Dohi,et al.  Multimodality Deformable Registration of Pre- and Intraoperative Images for MRI-guided Brain Surgery , 1998, MICCAI.

[16]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[17]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[18]  Murray H. Loew,et al.  Global optimization of weighted mutual information for multimodality image registration , 1999, Medical Imaging.

[19]  M Eiselt,et al.  Using mutual information to measure coupling in the cardiorespiratory system. , 1998, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[20]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[21]  R. K. Tuteja,et al.  Characterization of a quantitative-qualitative measure of relative information , 1984, Inf. Sci..

[22]  Albert C. S. Chung,et al.  Multi-dimensional Mutual Information Based Robust Image Registration Using Maximum Distance-Gradient-Magnitude , 2005, IPMI.

[23]  Bostjan Likar,et al.  A hierarchical approach to elastic registration based on mutual information , 2001, Image Vis. Comput..

[24]  Fredrik Bergholm,et al.  Edge Focusing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  M. Y. Wang,et al.  Measurement of Intraoperative Brain Surface Deformation Under a Craniotomy , 1998, MICCAI.

[26]  Rachid Deriche,et al.  A computational approach for corner and vertex detection , 1993, International Journal of Computer Vision.

[27]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[28]  Colin Studholme,et al.  Normalized entropy measure for multimodality image alignment , 1998, Medical Imaging.

[29]  Silviu Guiasu,et al.  A quantitative-qualitative measure of information in cybernetic systems (Corresp.) , 1968, IEEE Trans. Inf. Theory.

[30]  Derek L. G. Hill,et al.  Multi-channel Mutual Information Using Scale Space , 2004, MICCAI.

[31]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[32]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[33]  Paul M. Thompson,et al.  The role of image registration in brain mapping , 2001, Image Vis. Comput..

[34]  Paul Suetens,et al.  Medical image registration using mutual information , 2003, Proc. IEEE.

[35]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[36]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[37]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[38]  Dinggang Shen,et al.  Automated segmentation of white matter lesions in 3D brain MR images, using multivariate pattern classification , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[39]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[40]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[41]  Derek L. G. Hill,et al.  Measurement of Intraoperative Brain Surface Deformation Under a Craniotomy , 1998, MICCAI.

[42]  G. Marchal,et al.  Multi-modal volume registration by maximization of mutual information , 1997 .

[43]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[44]  Carlo Tomasi,et al.  Image Similarity Using Mutual Information of Regions , 2004, ECCV.

[45]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .