Medical image registration using mutual information

Analysis of multispectral or multitemporal images requires proper geometric alignment of the images to compare corresponding regions in each image volume. Retrospective three-dimensional alignment or registration of multimodal medical images based on features intrinsic to the image data itself is complicated by their different photometric properties, by the complexity of the anatomical objects in the scene and by the large variety of clinical applications in which registration is involved. While the accuracy of registration approaches based on matching of anatomical landmarks or object surfaces suffers from segmentation errors, voxel-based approaches consider all voxels in the image without the need for segmentation. The recent introduction of the criterion of maximization of mutual information, a basic concept from information theory, has proven to be a breakthrough in the field. While solutions for intrapatient affine registration based on this concept are already commercially available, current research in the field focuses on interpatient nonrigid matching.

[1]  Paul Suetens,et al.  Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information , 1999, Medical Image Anal..

[2]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[3]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[4]  Yang-Ming Zhu,et al.  Influence of implementation parameters on registration of MR and SPECT brain images by maximization of mutual information. , 2002, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[5]  David J. Hawkes,et al.  A Strategy for Automated Multimodality Image Registration Incorporating Anatomical Knowledge and Imager Characteristics , 1993, IPMI.

[6]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[7]  Colin Studholme,et al.  Measures of 3D medical image alignment , 1997 .

[8]  A. Ardeshir Goshtasby,et al.  Volume image registration by template matching , 2001, Image Vis. Comput..

[9]  Murray H. Loew,et al.  Fully automatic 3D feature-based registration of multi-modality medical images , 2001, Image Vis. Comput..

[10]  Christian Barillot,et al.  Multimodal registration system for the fusion of MRI, CT, MEG, and 3D or stereotactic angiographic data , 1994, Medical Imaging.

[11]  Piotr J. Slomka,et al.  Automated segmentation and registration technique for HMPAO-SPECT imaging of Alzheimer's patients , 2000, Medical Imaging: Image Processing.

[12]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[13]  Colin Studholme,et al.  Automated 3-D registration of MR and CT images of the head , 1996, Medical Image Anal..

[14]  U Pietrzyk,et al.  An interactive technique for three-dimensional image registration: validation for PET, SPECT, MRI and CT brain studies. , 1994, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[15]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[16]  U Pietrzyk,et al.  Clinical applications of registration and fusion of multimodality brain images from PET, SPECT, CT, and MRI. , 1996, European journal of radiology.

[17]  Josien P. W. Pluim,et al.  MUTUAL INFORMATION BASED REGISTRATION OF MEDICAL IMAGES , 2001 .

[18]  B. Dawant,et al.  Effect of geometrical distortion correction in MR on image registration accuracy. , 1996, Journal of computer assisted tomography.

[19]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[20]  Max A. Viergever,et al.  f-information measures in medical image registration , 2004, IEEE Transactions on Medical Imaging.

[21]  Joan Serrat,et al.  Multilocal Creaseness Based on the Level-Set Extrinsic Curvature , 2000, Comput. Vis. Image Underst..

[22]  Jürgen Weese,et al.  Image registration: convex weighting functions for histogram-based similarity measures , 1997, CVRMed.

[23]  M. Fitzpatrick A Review of Medical Image Registration , 1993 .

[24]  Max A. Viergever,et al.  Comparison of edge-based and ridge-based registration of CT and MR brain images , 1996, Medical Image Anal..

[25]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[26]  Matthias Otte,et al.  Elastic registration of fMRI data using Bezier-spline transformations , 2001, IEEE Transactions on Medical Imaging.

[27]  Daniel Rueckert,et al.  Registration of Video Images to Tomographic Images by Optimising Mutual Information Using Texture Mapping , 1999, MICCAI.

[28]  Benoit M. Dawant,et al.  Adaptive free-form deformation for interpatient medical image registration , 2001, SPIE Medical Imaging.

[29]  Jean-Philippe Thiran,et al.  Affine Registration with Feature Space Mutual Information , 2001, MICCAI.

[30]  Colin Studholme,et al.  Voxel similarity measures for automated image registration , 1994, Other Conferences.

[31]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[32]  G. Glover,et al.  Characterization of spatial distortion in magnetic resonance imaging and its implications for stereotactic surgery. , 1994, Neurosurgery.

[33]  G. Malandain,et al.  Rigid registration of 3-D objects by motion analysis , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[34]  Max A. Viergever,et al.  Evaluation of Ridge Seeking Operators for Multimodality Medical Image Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[36]  K. Rohr,et al.  Biomechanical modeling of the human head for physically based, nonrigid image registration , 1999, IEEE Transactions on Medical Imaging.

[37]  David Dean,et al.  Validation of object-induced MR distortion correction for frameless stereotactic neurosurgery , 1998, IEEE Transactions on Medical Imaging.

[38]  Charles R. Meyer,et al.  Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations , 1997, Medical Image Anal..

[39]  Frithjof Kruggel,et al.  Computational cost of nonrigid registration algorithms based on fluid dynamics [MRI time series application] , 2002, IEEE Transactions on Medical Imaging.

[40]  David J. Hawkes,et al.  Incorporating connected region labelling into automated image registration using mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[41]  Gary H. Glover,et al.  MR susceptibility misregistration correction , 1993, IEEE Trans. Medical Imaging.

[42]  Yves Bizais,et al.  Registration of multimodality medical images using a region overlap criterion , 1992, CVGIP Graph. Model. Image Process..

[43]  Max A. Viergever,et al.  Interpolation Artefacts in Mutual Information-Based Image Registration , 2000, Comput. Vis. Image Underst..

[44]  Koenraad Van Leemput,et al.  Automated model-based bias field correction of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[45]  R. Bajcsy,et al.  Elastic Matching: Continuum Mechanical and Probabilistic Analysis , 1999 .

[46]  Bostjan Likar,et al.  A hierarchical approach to elastic registration based on mutual information , 2001, Image Vis. Comput..

[47]  I. Vajda Theory of statistical inference and information , 1989 .

[48]  Frithjof Kruggel,et al.  Computational Cost of Non-Rigid Registration Algorithms Based on Fluid Dynamics , 2002, IEEE Trans. Medical Imaging.

[49]  Jürgen Weese,et al.  A Comparison of Simularity Measures for use in 2D-3D Medical Image Registration , 1998, MICCAI.

[50]  Jean-Philippe Thirion,et al.  Non-rigid matching using demons , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[51]  R.J. Maciunas,et al.  An automatic technique for finding and localizing externally attached markers in CT and MR volume images of the head , 1996, IEEE Transactions on Biomedical Engineering.

[52]  Colin Studholme,et al.  Accurate alignment of functional EPI data to anatomical MRI using a physics-based distortion model , 2000, IEEE Transactions on Medical Imaging.

[53]  Gerald Q. Maguire,et al.  Graphics applied to medical image registration , 1991, IEEE Computer Graphics and Applications.

[54]  K Herholz,et al.  Three-dimensional alignment of functional and morphological tomograms. , 1990, Journal of computer assisted tomography.

[55]  Murray H. Loew,et al.  Weighted and deterministic entropy measure for image registration using mutual information , 1998, Medical Imaging.

[56]  Daniel Rueckert,et al.  Non-rigid registration using higher-order mutual information , 2000, Medical Imaging.

[57]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[58]  Christian Roux,et al.  Genetic algorithms for a robust 3-D MR-CT registration , 2000, IEEE Transactions on Information Technology in Biomedicine.

[59]  Ma Bin-rong,et al.  A review of medical image registration , 1999 .

[60]  B. F. Hutton,et al.  Improved efficiency for MRI-SPET registration based on mutual information , 2000, European Journal of Nuclear Medicine.

[61]  Robert J. Maciunas,et al.  Registration of head volume images using implantable fiducial markers , 1997, IEEE Transactions on Medical Imaging.

[62]  Boštjan Likar,et al.  Registration of serial transverse sections of muscle fibers. , 1999 .

[63]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[64]  Guy Marchal,et al.  Automated Multimodality Medical Images Registration using Information Theory , 1995 .

[65]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[66]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[67]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[68]  E Bellon,et al.  The contribution of magnetic resonance imaging to the three-dimensional treatment planning of localized prostate cancer. , 1999, International journal of radiation oncology, biology, physics.

[69]  Max A. Viergever,et al.  Mutual information matching in multiresolution contexts , 2001, Image Vis. Comput..

[70]  J. Maintz Retrospective registration of tomographic brain images , 1996 .

[71]  J. Ashburner,et al.  Multimodal Image Coregistration and Partitioning—A Unified Framework , 1997, NeuroImage.

[72]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[73]  Paul Suetens,et al.  Non-rigid Multimodal Image Registration Using Mutual Information , 1998, MICCAI.

[74]  S Shalev,et al.  Pseudocorrelation: a fast, robust, absolute, grey-level image alignment algorithm. , 1994, Medical physics.

[75]  B H Brinkmann,et al.  Quantitative and clinical analysis of SPECT image registration for epilepsy studies. , 1999, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[76]  Daniel Rueckert,et al.  Assessment of Intraoperative Brain Deformation Using Interventional MR Imaging , 1999, MICCAI.

[77]  Ron Kikinis,et al.  Registration of 3-d intraoperative MR images of the brain using a finite-element biomechanical model , 2000, IEEE Transactions on Medical Imaging.

[78]  Jean-Francois Mangin,et al.  What is the best similarity measure for motion correction in fMRI time series? , 2002, IEEE Transactions on Medical Imaging.

[79]  J. Michael Fitzpatrick,et al.  A technique for accurate magnetic resonance imaging in the presence of field inhomogeneities , 1992, IEEE Trans. Medical Imaging.

[80]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[81]  P F Hemler,et al.  A versatile system for multimodality image fusion. , 1995, Journal of image guided surgery.

[82]  Lars Kai Hansen,et al.  Enhancing the Multivariate Signal of [15O] water PET Studies with a New Non-Linear Neuroanatomical Registration Algorithm , 1999, IEEE Trans. Medical Imaging.

[83]  J. Ashburner,et al.  Nonlinear spatial normalization using basis functions , 1999, Human brain mapping.

[84]  Derek L. G. Hill,et al.  Quantifying Small Changes in Brain Ventricular Volume Using Non-rigid Registration , 2001, MICCAI.

[85]  Evan D. Morris,et al.  Computer-aided techniques for aligning interleaved sets of nonidentical medical images , 1993 .

[86]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[87]  Alain Venot,et al.  A new class of similarity measures for robust image registration , 1984, Comput. Vis. Graph. Image Process..

[88]  Alejandro F. Frangi,et al.  Automatic Construction of 3D Statistical Deformation Models Using Non-rigid Registration , 2001, MICCAI.

[89]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[90]  John Y. Chiang,et al.  Coincident bit counting-a new criterion for image registration , 1993, IEEE Trans. Medical Imaging.

[91]  Guy Marchal,et al.  3D Multi-Modality Medical Image Registration Using Feature Space Clustering , 1995, CVRMed.

[92]  F. Maes,et al.  FDG-PET scan in potentially operable non-small cell lung cancer: do anatometabolic PET-CT fusion images improve the localisation of regional lymph node metastases? , 1998, European Journal of Nuclear Medicine.

[93]  Paul Suetens,et al.  A Viscous Fluid Model for Multimodal Non-rigid Image Registration Using Mutual Information , 2002, MICCAI.

[94]  Grégoire Malandain,et al.  Improving Registration of 3-D Medical Images Using a Mechanical Based Method , 1994, ECCV.

[95]  Haiying Liu,et al.  Constructing Patient Specific Models for Correcting Intraoperative Brain Deformation , 2001, MICCAI.

[96]  Haiying Liu,et al.  A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations , 2001, MICCAI.

[97]  Norbert Schuff,et al.  Detecting Spatially Consistent Structural Differences in Alzheimer's and Fronto Temporal Dementia Using Deformation Morphometry , 2001, MICCAI.

[98]  David J. Hawkes,et al.  Voxel similarity measures for 3-D serial MR brain image registration , 1999, IEEE Transactions on Medical Imaging.

[99]  Julian G. Rosenman,et al.  FUSION: a tool for registration and visualization of multiple modality 3D medical data , 1995, Medical Imaging.

[100]  Paul F. Hemler,et al.  Grey value correlation techniques used for automatic matching of CT and MR brain and spine images , 1994, Other Conferences.

[101]  Max A. Viergever,et al.  General multimodal elastic registration based on mutual information , 1998, Medical Imaging.

[102]  Max A. Viergever,et al.  Automatic registration of CT and MR brain images using correlation of geometrical features , 1995, IEEE Trans. Medical Imaging.

[103]  B F Hutton,et al.  Non-rigid image registration using a median-filtered coarse-to-fine displacement field and a symmetric correlation ratio , 2001, Physics in medicine and biology.

[104]  Olivier D. Faugeras,et al.  Variational Methods for Multimodal Image Matching , 2002, International Journal of Computer Vision.

[105]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[106]  Boklye Kim,et al.  Mutual information for automated multimodal image warping , 1996, NeuroImage.

[107]  Richard A. Robb,et al.  New approach to 3-D registration of multimodality medical images by surface matching , 1992, Other Conferences.

[108]  Morten Bro-Nielsen,et al.  Fast Fluid Registration of Medical Images , 1996, VBC.

[109]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[110]  Benoit M. Dawant,et al.  Retrospective intermodality registration techniques for images of the head: surface-based versus volume-based , 1999, IEEE Transactions on Medical Imaging.

[111]  Pierre Hellier,et al.  Multimodal Non-rigid Warping for Correction of Distortions in Functional MRI , 2000, MICCAI.

[112]  M A Horsfield,et al.  Mapping eddy current induced fields for the correction of diffusion-weighted echo planar images. , 1999, Magnetic resonance imaging.

[113]  D. Louis Collins,et al.  ANIMAL+INSECT: Improved Cortical Structure Segmentation , 1999, IPMI.

[114]  Martin Capek,et al.  Alignment of adjacent picture frames captured by a CLSM , 1997, IEEE Transactions on Information Technology in Biomedicine.

[115]  M. Staal Textbook of Stereotactic and Functional Neurosurgery , 1999, Spinal Cord.

[116]  G. Marchal,et al.  On the problem of geometric distortion in magnetic resonance images for stereotactic neurosurgery. , 1994, Magnetic resonance imaging.

[117]  Richard A. Robb,et al.  Image registration of multimodality 3-D medical images by chamfer matching , 1992, Electronic Imaging.

[118]  G. Malandain,et al.  Physically Based Rigid Registration of 3-D Free-Form Objects : application to Medical Imaging , 1994 .

[119]  William H. Press,et al.  Numerical recipes , 1990 .

[120]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[121]  Max A. Viergever,et al.  Comparison of Feature-Based Matching of CT and MR Brain Images , 1995, CVRMed.

[122]  Takeyoshi Dohi,et al.  Multimodality Deformable Registration of Pre- and Intraoperative Images for MRI-guided Brain Surgery , 1998, MICCAI.

[123]  Morten Bro-Nielsen Rigid registration of CT, MR and cryosection images using a GLCM framework , 1997, CVRMed.