DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting

A general-purpose deformable registration algorithm referred to as "DRAMMS" is presented in this paper. DRAMMS adds to the literature of registration methods that bridge between the traditional voxel-wise methods and landmark/feature-based methods. In particular, DRAMMS extracts Gabor attributes at each voxel and selects the optimal components, so that they form a highly distinctive morphological signature reflecting the anatomical context around each voxel in a multi-scale and multi-resolution fashion. Compared with intensity or mutual-information based methods, the high-dimensional optimal Gabor attributes render different anatomical regions relatively distinctively identifiable and therefore help establish more accurate and reliable correspondence. Moreover, the optimal Gabor attribute vector is constructed in a way that generalizes well, i.e., it can be applied to different registration tasks, regardless of the image contents under registration. A second characteristic of DRAMMS is that it is based on a cost function that weights different voxel pairs according to a metric referred to as "mutual-saliency", which reflects the uniqueness (reliability) of anatomical correspondences implied by the tentative transformation. As a result, image voxels do not contribute equally to the optimization process, as in most voxel-wise methods, or in a binary selection fashion, as in most landmark/feature-based methods. Instead, they contribute according to a continuously-valued mutual-saliency map, which is dynamically updated during the algorithm's evolution. The general applicability and accuracy of DRAMMS are demonstrated by experiments in simulated images, inter-subject images, single-/multi-modality images, and longitudinal images, from human and mouse brains, breast, heart, and prostate.

[1]  A. Yezzi,et al.  A variational framework for joint segmentation and registration , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[2]  Christos Davatzikos,et al.  Matching of diffusion tensor images using Gabor features , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[3]  Rick S. Blum,et al.  Non-rigid Image Registration Using Geometric Features and Local Salient Region Features , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Matthew J. McAuliffe,et al.  Medical Image Processing, Analysis and Visualization in clinical research , 2001, Proceedings 14th IEEE Symposium on Computer-Based Medical Systems. CBMS 2001.

[5]  Dinggang Shen,et al.  Multimodality image registration by maximization of quantitative-qualitative measure of mutual information , 2008, Pattern Recognit..

[6]  Dinggang Shen,et al.  Measuring temporal morphological changes robustly in brain MR images via 4-dimensional template warping , 2004, NeuroImage.

[7]  N. Ayache,et al.  Three-dimensional reconstruction of stained histological slices and 3D non-linear registration with in-vivo MRI for whole baboon brain , 2007, Journal of Neuroscience Methods.

[8]  Jose Jeronimo,et al.  Segmentation of mosaicism in cervicographic images using support vector machines , 2009, Medical Imaging.

[9]  W. Eric L. Grimson,et al.  A Bayesian model for joint segmentation and registration , 2006, NeuroImage.

[10]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[11]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[12]  Yanxi Liu,et al.  Cervical Cancer Detection Using SVM Based Feature Screening , 2004, MICCAI.

[13]  Lei Guo,et al.  Deformation invariant attribute vector for deformable registration of longitudinal brain MR images , 2009, Comput. Medical Imaging Graph..

[14]  James S. Duncan,et al.  Shape-based tracking of left ventricular wall motion , 1997, IEEE Transactions on Medical Imaging.

[15]  Nassir Navab,et al.  Dense image registration through MRFs and efficient linear programming , 2008, Medical Image Anal..

[16]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[17]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[18]  Nacim Betrouni,et al.  Fractal and multifractal analysis: A review , 2009, Medical Image Anal..

[19]  Alain Pitiot,et al.  Piecewise affine registration of biological images for volume reconstruction , 2006, Medical Image Anal..

[20]  Dinggang Shen,et al.  Non-rigid registration between histological and MR images of the prostate: A joint segmentation and registration framework , 2009, CVPR 2009.

[21]  James S. Duncan,et al.  Measurement of non-rigid motion using contour shape descriptors , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[23]  Thomas R. Barrick,et al.  Atlas-based segmentation of white matter tracts of the human brain using diffusion tensor tractography and comparison with classical dissection , 2008, NeuroImage.

[24]  Nikos Komodakis,et al.  Performance vs computational efficiency for optimizing single and dynamic MRFs: Setting the state of the art with primal-dual strategies , 2008, Comput. Vis. Image Underst..

[25]  Paul M. Thompson,et al.  Statistical Properties of Jacobian Maps and the Realization of Unbiased Large-Deformation Nonlinear Image Registration , 2007, IEEE Transactions on Medical Imaging.

[26]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[27]  Dwarikanath Mahapatra,et al.  Registration of dynamic renal MR images using neurobiological model of saliency , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[28]  T. Wong,et al.  Automatic motion correction for breast MR imaging. , 1996, Radiology.

[29]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[30]  Stephen T. C. Wong,et al.  Joint Registration and Segmentation of Serial Lung CT Images in Microendoscopy Molecular Image-Guided Therapy , 2008, MIAR.

[31]  Hany Farid,et al.  Medical image registration with partial data , 2006, Medical Image Anal..

[32]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Dinggang Shen,et al.  Deformable registration of cortical structures via hybrid volumetric and surface warping , 2004, NeuroImage.

[34]  Dinggang Shen,et al.  Learning Best Features and Deformation Statistics for Hierarchical Registration of MR Brain Images , 2007, IPMI.

[35]  Istvan Csapo,et al.  Image registration framework for large-scale longitudinal MRI data sets: strategy and validation. , 2007, Magnetic resonance imaging.

[36]  Ben Glocker,et al.  Graphical Models and Deformable Diffeomorphic Population Registration Using Global and Local Metrics , 2009, MICCAI.

[37]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[38]  Malur K. Sundareshan,et al.  Accurate representation of local frequency using a computationally efficient Gabor filter fusion approach with application to image registration , 2005, Pattern Recognit. Lett..

[39]  Dinggang Shen,et al.  An adaptive-focus statistical shape model for segmentation and shape modeling of 3-D brain structures , 2001, IEEE Transactions on Medical Imaging.

[40]  Shu Liao,et al.  Non-rigid Image Registration with Uniform Spherical Structure Patterns , 2009, IPMI.

[41]  P. Thompson,et al.  Computational anatomical methods as applied to ageing and dementia. , 2007, The British journal of radiology.

[42]  Dinggang Shen,et al.  Estimating myocardial motion by 4D image warping , 2009, Pattern Recognit..

[43]  Takeyoshi Dohi,et al.  Multimodality Deformable Registration of Pre- and Intraoperative Images for MRI-guided Brain Surgery , 1998, MICCAI.

[44]  Paul Suetens,et al.  A viscous fluid model for multimodal non-rigid image registration using mutual information , 2003, Medical Image Anal..

[45]  Dinggang Shen,et al.  Image registration by local histogram matching , 2007, Pattern Recognit..

[46]  Michael Brady,et al.  Regularized B-spline deformable registration for respiratory motion correction in PET images , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[47]  Marcos Martín-Fernández,et al.  Review of Techniques for Registration of Diffusion Tensor Imaging , 2009, Tensors in Image Processing and Computer Vision.

[48]  James S. Duncan,et al.  Point-tracked quantitative analysis of left ventricular surface motion from 3-D image sequences , 2000, IEEE Transactions on Medical Imaging.

[49]  J. Alison Noble,et al.  MAP MRF joint segmentation and registration of medical images , 2003, Medical Image Anal..

[50]  Michael Brady,et al.  Non-rigid Registration for Colorectal Cancer MR Images , 2005, CVBIA.

[51]  John H. Gilmore,et al.  Automatic segmentation of MR images of the developing newborn brain , 2005, Medical Image Anal..

[52]  Haibin Ling,et al.  Deformation invariant image matching , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[53]  Purang Abolmaesumi,et al.  Elastic Registration of 3D Ultrasound Images , 2005, MICCAI.

[54]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[56]  R. Rabbitt,et al.  3D brain mapping using a deformable neuroanatomy. , 1994, Physics in medicine and biology.

[57]  Paul M. Thompson,et al.  A surface-based technique for warping three-dimensional images of the brain , 1996, IEEE Trans. Medical Imaging.

[58]  N. Hata,et al.  An integrated visualization system for surgical planning and guidance using image fusion and an open MR , 2001, Journal of magnetic resonance imaging : JMRI.

[59]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[60]  Dinggang Shen,et al.  Learning-based deformable registration of MR brain images , 2006, IEEE Transactions on Medical Imaging.

[61]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[63]  Bradford A Moffat,et al.  A Methodology for Registration of a Histological Slide and In Vivo MRI Volume Based on Optimizing Mutual Information , 2006, Molecular imaging.

[64]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[65]  Dinggang Shen,et al.  Diffusion Tensor Image Registration Using Tensor Geometry and Orientation Features , 2008, MICCAI.

[66]  Joni-Kristian Kämäräinen Feature extraction using Gabor filters , 2003 .

[67]  D. Hill,et al.  Non-rigid image registration: theory and practice. , 2004, The British journal of radiology.

[68]  Fei Wang,et al.  Joint registration and segmentation of neuroanatomic structures from brain MRI. , 2006, Academic radiology.

[69]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[70]  Jürgen Weese,et al.  Landmark-based elastic registration using approximating thin-plate splines , 2001, IEEE Transactions on Medical Imaging.

[71]  Jerry L. Prince,et al.  Mjolnir: Extending HAMMER Using a Diffusion Transformation Model and Histogram Equalization for Deformable Image Registration , 2009, Int. J. Biomed. Imaging.

[72]  Jerry L. Prince,et al.  Image registration based on boundary mapping , 1996, IEEE Trans. Medical Imaging.

[73]  Dinggang Shen,et al.  TIMER: Tensor Image Morphing for Elastic Registration , 2009, NeuroImage.

[74]  Jundong Liu,et al.  Local frequency representations for robust multimodal image registration , 2002, IEEE Transactions on Medical Imaging.

[75]  B. Dawant,et al.  Three-dimensional image registration of phantom vertebrae for image-guided surgery: a preliminary study. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[76]  Dinggang Shen,et al.  ORBIT: A Multiresolution Framework for Deformable Registration of Brain Tumor Images , 2008, IEEE Transactions on Medical Imaging.

[77]  Simon R. Arridge,et al.  A survey of hierarchical non-linear medical image registration , 1999, Pattern Recognit..

[78]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[79]  Hongmin Cai,et al.  Multiparametric tissue characterization of brain neoplasms and their recurrence using pattern classification of MR images. , 2008, Academic radiology.

[80]  Dinggang Shen,et al.  Determining correspondence in 3-D MR brain images using attribute vectors as morphological signatures of voxels , 2004, IEEE Transactions on Medical Imaging.

[81]  Ruzena Bajcsy,et al.  Matching structural images of the human brain using statistical and geometrical image features , 1994, Other Conferences.

[82]  Dinggang Shen,et al.  Sampling the spatial patterns of cancer: Optimized biopsy procedures for estimating prostate cancer volume and Gleason Score , 2009, Medical Image Anal..

[83]  Nicholas Ayache,et al.  Non-parametric Diffeomorphic Image Registration with the Demons Algorithm , 2007, MICCAI.

[84]  Baba C. Vemuri,et al.  Robust Nonrigid Multimodal Image Registration Using Local Frequency Maps , 2005, IPMI.

[85]  Michael I. Miller,et al.  Landmark matching via large deformation diffeomorphisms , 2000, IEEE Trans. Image Process..

[86]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[87]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[88]  Paul M. Thompson,et al.  Anatomically Driven Strategies for High-Dimensional Brain Image Warping and Pathology Detection , 1999 .

[89]  Dimitris N. Metaxas,et al.  Hybrid Image Registration based on Configural Matching of Scale-Invariant Salient Region Features , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[90]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[91]  Guido Gerig,et al.  Unbiased diffeomorphic atlas construction for computational anatomy , 2004, NeuroImage.

[92]  Michael Brady,et al.  Simultaneous Segmentation and Registration of Contrast-Enhanced Breast MRI , 2005, IPMI.

[93]  D. Shen,et al.  Registering histological and MR images of prostate for image-based cancer detection. , 2007, Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention.

[94]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[95]  Dinggang Shen,et al.  Deformable segmentation of 3-D ultrasound prostate images using statistical texture matching method , 2006, IEEE Transactions on Medical Imaging.

[96]  Dinggang Shen,et al.  Improving Parenchyma Segmentation by Simultaneous Estimation of Tissue Property T1 Map and Group-Wise Registration of Inversion Recovery MR Breast Images , 2008, MICCAI.

[97]  Seungyong Lee,et al.  Injectivity Conditions of 2D and 3D Uniform Cubic B-Spline Functions , 2000, Graph. Model..

[98]  W. Eric L. Grimson,et al.  Efficient Population Registration of 3D Data , 2005, CVBIA.

[99]  Daniel Rueckert,et al.  Diffeomorphic Registration Using B-Splines , 2006, MICCAI.

[100]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[101]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[102]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[103]  Dinggang Shen,et al.  COMPARE: Classification of Morphological Patterns Using Adaptive Regional Elements , 2007, IEEE Transactions on Medical Imaging.

[104]  Michael Unser,et al.  Fast parametric elastic image registration , 2003, IEEE Trans. Image Process..

[105]  Yihong Yang,et al.  Implicit reference-based group-wise image registration and its application to structural and functional MRI , 2009, NeuroImage.

[106]  Dinggang Shen,et al.  CLASSIC: Consistent Longitudinal Alignment and Segmentation for Serial Image Computing , 2006, NeuroImage.

[107]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[108]  Mark Holden,et al.  A Review of Geometric Transformations for Nonrigid Body Registration , 2008, IEEE Transactions on Medical Imaging.

[109]  Charles R. Meyer,et al.  Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations , 1997, Medical Image Anal..

[110]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.