Curvelet-based sampling for accurate and efficient multimodal image registration

We present a new non-uniform adaptive sampling method for the estimation of mutual information in multi-modal image registration. The method uses the Fast Discrete Curvelet Transform to identify regions along anatomical curves on which the mutual information is computed. Its main advantages of over other non-uniform sampling schemes are that it captures the most informative regions, that it is invariant to feature shapes, orientations, and sizes, that it is efficient, and that it yields accurate results. Extensive evaluation on 20 validated clinical brain CT images to Proton Density (PD) and T1 and T2-weighted MRI images from the public RIRE database show the effectiveness of our method. Rigid registration accuracy measured at 10 clinical targets and compared to ground truth measurements yield a mean target registration error of 0.68mm(std=0.4mm) for CT-PD and 0.82mm(std=0.43mm) for CT-T2. This is 0.3mm (1mm) more accurate in the average (worst) case than five existing sampling methods. Our method has the lowest registration errors recorded to date for the registration of CT-PD and CT-T2 images in the RIRE website when compared to methods that were tested on at least three patient datasets.

[1]  Dinggang Shen,et al.  Multimodality image registration by maximization of quantitative-qualitative measure of mutual information , 2008, Pattern Recognit..

[2]  Rodney A. Kennedy,et al.  Gradient Intensity: A New Mutual Information-Based Registration Method , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[4]  S. Mallat A wavelet tour of signal processing , 1998 .

[5]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[6]  Guy Marchal,et al.  Automated Multimodality Medical Images Registration using Information Theory , 1995 .

[7]  Mateu Sbert,et al.  High-Dimensional Normalized Mutual Information for Image Registration Using Random Lines , 2006, WBIR.

[8]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Carlo Tomasi,et al.  Image Similarity Using Mutual Information of Regions , 2004, ECCV.

[10]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[11]  Dinggang Shen,et al.  Robust Computation of Mutual Information Using Spatially Adaptive Meshes , 2007, MICCAI.

[12]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[13]  Max A. Viergever,et al.  Interpolation Artefacts in Mutual Information-Based Image Registration , 2000, Comput. Vis. Image Underst..

[14]  Jeffrey Tsao,et al.  Interpolation artifacts in multimodality image registration based on maximization of mutual information , 2003, IEEE Transactions on Medical Imaging.

[15]  David R. Haynor,et al.  PET-CT image registration in the chest using free-form deformations , 2003, IEEE Transactions on Medical Imaging.

[16]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[17]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[18]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[19]  M.R. Sabuncu,et al.  Gradient based nonuniform subsampling for information-theoretic alignment methods , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[21]  Shu Liao,et al.  Maximum distance-gradient for robust image registration , 2008, Medical Image Anal..

[22]  M. Bierlaire,et al.  Halton Sampling for Image Registration Based on Mutual Information , 2008 .

[23]  Guoyan Zheng,et al.  Effective Incorporation of Spatial Information in a Mutual Information Based 3D-2D Registration of a CT Volume to X-Ray Images , 2008, MICCAI.

[24]  Daniel Rueckert,et al.  Non-rigid registration using higher-order mutual information , 2000, Medical Imaging.

[25]  Cheng-Chang Lu,et al.  Multi-modality Image Registration Using Mutual Information Based on Gradient Vector Flow , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[26]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[27]  Lexing Ying,et al.  3D discrete curvelet transform , 2005, SPIE Optics + Photonics.

[28]  G. Marchal,et al.  Multi-modal volume registration by maximization of mutual information , 1997 .

[29]  Rui Xu,et al.  Wavelet-based Multiresolution Medical Image Registration Strategy Combining Mutual Information with Spatial Information , 2006 .

[30]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[31]  Zhi-Pei Liang,et al.  Further Analysis of Interpolation Effects in Mutual Information-Based Image Registration , 2003, IEEE Trans. Medical Imaging.

[32]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[33]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..