Multimodality image registration by maximization of mutual information

A new approach to the problem of multimodality medical image registration is proposed, using a basic concept from information theory, mutual information (MI), or relative entropy, as a new matching criterion. The method presented in this paper applies MI to measure the statistical dependence or information redundancy between the image intensities of corresponding voxels in both images, which is assumed to be maximal if the images are geometrically aligned. Maximization of MI is a very general and powerful criterion, because no assumptions are made regarding the nature of this dependence and no limiting constraints are imposed on the image content of the modalities involved. The accuracy of the MI criterion is validated for rigid body registration of computed tomography (CT), magnetic resonance (MR), and photon emission tomography (PET) images by comparison with the stereotactic registration solution, while robustness is evaluated with respect to implementation issues, such as interpolation and optimization, and image content, including partial overlap and image degradation. Our results demonstrate that subvoxel accuracy with respect to the stereotactic reference solution can be achieved completely automatically and without any prior segmentation, feature extraction, or other preprocessing steps which makes this method very well suited for clinical applications.

[1]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[2]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3]  Chi Hau Chen,et al.  Statistical Pattern Recognition. , 1973 .

[4]  Alain Venot,et al.  A new class of similarity measures for robust image registration , 1984, Comput. Vis. Graph. Image Process..

[5]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[6]  I. Vajda.  Theory of statistical inference and information , 1989 .

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Max A. Viergever,et al.  Image fusion using geometrical features , 1992, Other Conferences.

[9]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[10]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[11]  A. Baddeley.  An Error Metric for Binary Images , 1992 .

[12]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[13]  Yves Bizais,et al.  Registration of multimodality medical images using a region overlap criterion , 1992, CVGIP Graph. Model. Image Process..

[14]  M. Fitzpatrick.  A Review of Medical Image Registration , 1993 .

[15]  John Y. Chiang,et al.  Coincident bit counting-a new criterion for image registration , 1993, IEEE Trans. Medical Imaging.

[16]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[17]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[18]  David J. Hawkes,et al.  A Strategy for Automated Multimodality Image Registration Incorporating Anatomical Knowledge and Imager Characteristics , 1993, IPMI.

[19]  G. Marchal,et al.  On the problem of geometric distortion in magnetic resonance images for stereotactic neurosurgery. , 1994, Magnetic resonance imaging.

[20]  S Shalev,et al.  Pseudocorrelation: a fast, robust, absolute, grey-level image alignment algorithm. , 1994, Medical physics.

[21]  Paul F. Hemler,et al.  Grey value correlation techniques used for automatic matching of CT and MR brain and spine images , 1994, Other Conferences.

[22]  Colin Studholme,et al.  Voxel similarity measures for automated image registration , 1994, Other Conferences.

[23]  Guy Marchal,et al.  3D Multi-Modality Medical Image Registration Using Feature Space Clustering , 1995, CVRMed.

[24]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[25]  Max A. Viergever,et al.  Comparison of Feature-Based Matching of CT and MR Brain Images , 1995, CVRMed.

[26]  Max A. Viergever,et al.  Automatic registration of CT and MR brain images using correlation of geometrical features , 1995, IEEE Trans. Medical Imaging.

[27]  Colin Studholme,et al.  Automated 3D Registration of Truncated MR and CT Images of the Head , 1995, BMVC.

[28]  Guy Marchal,et al.  Automated Multimodality Medical Images Registration using Information Theory , 1995 .

[29]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[30]  Guy Marchal,et al.  Automatic image partitioning for generic object segmentation in medical images , 1995 .

[31]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[32]  Colin Studholme,et al.  Automated 3-D registration of MR and CT images of the head , 1996, Medical Image Anal..

[33]  Benoit M. Dawant,et al.  Comparison and evaluation of retrospective intermodality image registration techniques , 1996, Medical Imaging.

[34]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[35]  Charles R. Meyer,et al.  Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations , 1997, Medical Image Anal..

[36]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[37]  Ma Bin-rong,et al.  A review of medical image registration , 1999 .