Multiscale registration of medical images based on edge preserving scale space with application in image-guided radiation therapy.

Mutual information (MI) is a well-accepted similarity measure for image registration in medical systems. However, MI-based registration faces the challenges of high computational complexity and a high likelihood of being trapped into local optima due to an absence of spatial information. In order to solve these problems, multi-scale frameworks can be used to accelerate registration and improve robustness. Traditional Gaussian pyramid representation is one such technique but it suffers from contour diffusion at coarse levels which may lead to unsatisfactory registration results. In this work, a new multi-scale registration framework called edge preserving multiscale registration (EPMR) was proposed based upon an edge preserving total variation L1 norm (TV-L1) scale space representation. TV-L1 scale space is constructed by selecting edges and contours of images according to their size rather than the intensity values of the image features. This ensures more meaningful spatial information with an EPMR framework for MI-based registration. Furthermore, we design an optimal estimation of the TV-L1 parameter in the EPMR framework by training and minimizing the transformation offset between the registered pairs for automated registration in medical systems. We validated our EPMR method on both simulated mono- and multi-modal medical datasets with ground truth and clinical studies from a combined positron emission tomography/computed tomography (PET/CT) scanner. We compared our registration framework with other traditional registration approaches. Our experimental results demonstrated that our method outperformed other methods in terms of the accuracy and robustness for medical images. EPMR can always achieve a small offset value, which is closer to the ground truth both for mono-modality and multi-modality, and the speed can be increased 5-8% for mono-modality and 10-14% for multi-modality registration under the same condition. Furthermore, clinical application by adaptive gross tumor volume re-contouring for clinical PET/CT image-guided radiation therapy throughout the course of radiotherapy is also studied, and the overlap between the automatically generated contours for the CT image and the contours delineated by the oncologist used for the planning system are on average 90%.

[1]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2007, IPMI.

[2]  Thomas S. Huang,et al.  A New Coarse-to-Fine Framework for 3D Brain MR Image Registration , 2005, CVBIA.

[3]  A. Evans,et al.  MRI simulation-based evaluation of image-processing and classification methods , 1999, IEEE Transactions on Medical Imaging.

[4]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[5]  Lei Xing,et al.  Multiscale registration of planning CT and daily cone beam CT images for adaptive radiation therapy. , 2009, Medical physics.

[6]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[7]  Yang-Ming Zhu,et al.  Influence of implementation parameters on registration of MR and SPECT brain images by maximization of mutual information. , 2002, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[8]  Murray H. Loew,et al.  Weighted and deterministic entropy measure for image registration using mutual information , 1998, Medical Imaging.

[9]  Eitan Tadmor,et al.  A Multiscale Image Representation Using Hierarchical (BV, L2 ) Decompositions , 2004, Multiscale Model. Simul..

[10]  Alan C. Evans,et al.  MRI Simulation Based Evaluation and Classifications Methods , 1999, IEEE Trans. Medical Imaging.

[11]  Eduard Schreibmann,et al.  Multiscale image registration. , 2006 .

[12]  Max A. Viergever,et al.  Image Registration by Maximization of Combined Mututal Information and Gradient Information , 2000, MICCAI.

[13]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[14]  David Dagan Feng,et al.  Non-Iterative Hierarchical Registration for Medical Images , 2009, J. Signal Process. Syst..

[15]  Weiguo Lu,et al.  Deformable registration of the planning image (kVCT) and the daily images (MVCT) for adaptive radiation therapy , 2006, Physics in medicine and biology.

[16]  Lei Xing,et al.  Multiscale image registration. , 2006, Mathematical biosciences and engineering : MBE.

[17]  Max A. Viergever,et al.  Multiscale approach to mutual information matching , 1998, Medical Imaging.

[18]  Dorin Comaniciu,et al.  Total variation models for variable lighting face recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Simon R. Arridge,et al.  A survey of hierarchical non-linear medical image registration , 1999, Pattern Recognit..

[20]  Daniel Rueckert,et al.  Non-rigid registration using higher-order mutual information , 2000, Medical Imaging.

[21]  Max A. Viergever,et al.  Registration of Cervical MRI Using Multifeature Mutual Information , 2009, IEEE Transactions on Medical Imaging.

[22]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[23]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[24]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[25]  Wotao Yin,et al.  Image Cartoon-Texture Decomposition and Feature Selection Using the Total Variation Regularized L1 Functional , 2005, VLSM.

[26]  Adil Al-Mayah,et al.  Toward efficient biomechanical-based deformable image registration of lungs for image-guided radiotherapy. , 2011, Physics in medicine and biology.

[27]  Max A. Viergever,et al.  Mutual information matching in multiresolution contexts , 2001, Image Vis. Comput..

[28]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[29]  D L Hill,et al.  Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. , 1997, Medical physics.

[30]  Max A. Viergever,et al.  Comparison of edge-based and ridge-based registration of CT and MR brain images , 1996, Medical Image Anal..

[31]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.

[32]  Jae Young Lee,et al.  Non-rigid registration between 3D ultrasound and CT images of the liver based on intensity and gradient information , 2011, Physics in medicine and biology.

[33]  Wotao Yin,et al.  Background correction for cDNA microarray images using the TV+L1 model , 2005, Bioinform..

[34]  Tony F. Chan,et al.  Aspects of Total Variation Regularized L[sup 1] Function Approximation , 2005, SIAM J. Appl. Math..

[35]  A. Ardeshir Goshtasby,et al.  2-D and 3-D Image Registration: for Medical, Remote Sensing, and Industrial Applications , 2005 .