Interpolation artifacts in multimodality image registration based on maximization of mutual information

Mutual information (MI) is an increasingly popular match metric for multimodality image registration. However, its value is affected by interpolation, which may limit registration accuracy. The purpose of this study was to characterize the artifacts from eight interpolators and to investigate efficient strategies to overcome these artifacts. The interpolators were: 1) nearest neighbor; 2) linear; 3) cubic Catmull-Rom; 4) Hamming-windowed sinc; 5) partial volume; 6) NN with jittered sampling (JIT); 7) NN with histogram blurring (BLUR); and 8) NN with JIT and BLUR. The impact of interpolation on MI was evaluated in two dimensions over different translational and rotational misregistration. Interpolation caused spurious fluctuations in MI whenever the voxel grids had coinciding periodicities and were nearly aligned. The artifacts did not lessen by using intensity interpolators with wider support (e.g., cubic Catmull-Rom, Hamming-windowed sinc). PV could lead to either arch artifacts or inverted-arch artifacts, depending on the relative voxel sizes. Several strategies reduced artifacts and improved registration robustness: JIT, BLUR, avoiding an extreme number of intensity bins, and resampling the images in a rotated orientation with different relative voxel sizes (e.g., /spl pi//3). These findings also apply to related methods, including normalized MI, joint entropy, and Hill's third moment.

[1]  J. D. O'Sullivan,et al.  A Fast Sinc Function Gridding Algorithm for Fourier Inversion in Computer Tomography , 1985, IEEE Transactions on Medical Imaging.

[2]  William F. Eddyy,et al.  Improved image registration by using fourier interpolation , 1996, Magnetic resonance in medicine.

[3]  M W Vannier,et al.  Automated registration of multimodality images. , 1988, Radiology.

[4]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[5]  C R Meyer,et al.  Motion correction in fMRI via registration of individual slices into an anatomical volume , 1999, Magnetic resonance in medicine.

[6]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[7]  Guy Marchal,et al.  Automated Multimodality Medical Images Registration using Information Theory , 1995 .

[8]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[9]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[10]  D. Weinberger,et al.  Analysis of interpolation effects in the reslicing of functional MR images. , 1997, Journal of computer assisted tomography.

[11]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[12]  G. Marchal,et al.  Multi-modal volume registration by maximization of mutual information , 1997 .

[13]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[14]  T M Buzug,et al.  Image registration for DSA quality enhancement. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[15]  J. Tsao.  Correction of "Interpolation Artifacts in Multimodality Image Registration Based on Maximization of Mutual Information" , 2003, IEEE Trans. Medical Imaging.

[16]  Bostjan Likar,et al.  A hierarchical approach to elastic registration based on mutual information , 2001, Image Vis. Comput..

[17]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[18]  Colin Studholme,et al.  Voxel similarity measures for automated image registration , 1994, Other Conferences.

[19]  Guy Marchal,et al.  3D Multi-Modality Medical Image Registration Using Feature Space Clustering , 1995, CVRMed.

[20]  P. Lauterbur,et al.  Generalized clustering-based image registration for multi-modality images , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[21]  M. Unser,et al.  Interpolation revisited [medical images application] , 2000, IEEE Transactions on Medical Imaging.

[22]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[23]  Andrew Harris.  Multimodality Image Registration by Gradient Enhanced Generalized Clustering , 1999 .

[24]  Max A. Viergever,et al.  Mutual information matching and interpolation artifacts , 1999, Medical Imaging.

[25]  Morten Bro-Nielsen.  Rigid registration of CT, MR and cryosection images using a GLCM framework , 1997, CVRMed.

[26]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[27]  P. C. Lauterbur,et al.  fMRI Image Registration Using Total Local Density of Intensity Mapping Plot , 1998 .

[28]  N A Thacker,et al.  Improved quality of re‐sliced MR images using re‐normalized sinc interpolation , 1999, Journal of magnetic resonance imaging : JMRI.

[29]  Pramod K. Varshney,et al.  Mutual information-based CT-MR brain image registration using generalized partial volume joint histogram estimation , 2003, IEEE Transactions on Medical Imaging.

[30]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[31]  J. Hajnal,et al.  A Registration and Interpolation Procedure for Subvoxel Matching of Serially Acquired MR Images , 1995, Journal of computer assisted tomography.

[32]  Max A. Viergever,et al.  Interpolation Artefacts in Mutual Information-Based Image Registration , 2000, Comput. Vis. Image Underst..

[33]  E. Catmull,et al.  A CLASS OF LOCAL INTERPOLATING SPLINES , 1974 .

[34]  Jacob H.-S. Tsao.  Efficient Interpolation for Clustering-based Multimodality Image Registration , 1999 .