A General Fast Registration Framework by Learning Deformation–Appearance Correlation

In this paper, we propose a general framework for performance improvement of the current state-of-the-art registration algorithms in terms of both accuracy and computation time. The key concept involves rapid prediction of a deformation field for registration initialization, which is achieved by a statistical correlation model learned between image appearances and deformation fields. This allows us to immediately bring a template image as close as possible to a subject image that we need to register. The task of the registration algorithm is hence reduced to estimating small deformation between the subject image and the initially warped template image, i.e., the intermediate template (IT). Specifically, to obtain a good subject-specific initial deformation, support vector regression is utilized to determine the correlation between image appearances and their respective deformation fields. When registering a new subject onto the template, an initial deformation field is first predicted based on the subject's image appearance for generating an IT. With the IT, only the residual deformation needs to be estimated, presenting much less challenge to the existing registration algorithms. Our learning-based framework affords two important advantages: 1) by requiring only the estimation of the residual deformation between the IT and the subject image, the computation time can be greatly reduced; 2) by leveraging good deformation initialization, local minima giving suboptimal solution could be avoided. Our framework has been extensively evaluated using medical images from different sources, and the results indicate that, on top of accuracy improvement, significant registration speedup can be achieved, as compared with the case where no prediction of initial deformation is performed.

[1]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[2]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[3]  Gary E. Christensen,et al.  Consistent landmark and intensity-based image registration , 2002, IEEE Transactions on Medical Imaging.

[4]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[5]  Babak A. Ardekani,et al.  Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans , 2005, Journal of Neuroscience Methods.

[6]  Gary E. Christensen,et al.  Consistent image registration , 2001, IEEE Transactions on Medical Imaging.

[7]  Dinggang Shen,et al.  Simulating deformations of MR brain images for validation of atlas-based segmentation and registration algorithms , 2006, NeuroImage.

[8]  Dinggang Shen Image Registration by Hierarchical Matching of Local Spatial Intensity Histograms , 2004, MICCAI.

[9]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[10]  Samy Bengio,et al.  SVMTorch: Support Vector Machines for Large-Scale Regression Problems , 2001, J. Mach. Learn. Res..

[11]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[12]  Dinggang Shen,et al.  Statistical representation of high-dimensional deformation fields with application to statistically constrained 3D warping , 2006, Medical Image Anal..

[13]  Yuandong Tian,et al.  A globally optimal data-driven approach for image distortion estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[15]  S. Lawrie,et al.  Voxel-based morphometry of grey matter densities in subjects at high risk of schizophrenia , 2003, Schizophrenia Research.

[16]  Alejandro F Frangi,et al.  Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[17]  Dinggang Shen,et al.  Learning-based deformable registration of MR brain images , 2006, IEEE Transactions on Medical Imaging.

[18]  Ron Kikinis,et al.  Registration of 3-d intraoperative MR images of the brain using a finite-element biomechanical model , 2000, IEEE Transactions on Medical Imaging.

[19]  Yunqian Ma,et al.  Selection of Meta-parameters for Support Vector Regression , 2002, ICANN.

[20]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[21]  Christos Davatzikos,et al.  Spatial Transformation and Registration of Brain Images Using Elastically Deformable Models , 1997, Comput. Vis. Image Underst..

[22]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[23]  R. Rabbitt,et al.  3D brain mapping using a deformable neuroanatomy. , 1994, Physics in medicine and biology.

[24]  Arthur W. Toga,et al.  Learning based coarse-to-fine image registration , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Nassir Navab,et al.  Dense Registration with Deformation Priors , 2009, IPMI.

[26]  Thomas Vetter,et al.  A statistical deformation prior for non-rigid image and shape registration , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Mert R. Sabuncu,et al.  Learning Task-Optimal Registration Cost Functions for Localizing Cytoarchitecture and Function in the Cerebral Cortex , 2010, IEEE Transactions on Medical Imaging.

[28]  Karl Rohr,et al.  Image Registration Based on Thin-Plate Splines and Local Estimates of Anisotropic Landmark Localization Uncertainties , 1998, MICCAI.

[29]  Jacqueline Spiegel-Cohen,et al.  Shape and size of the corpus callosum in schizophrenia and schizotypal personality disorder , 2000, Schizophrenia Research.

[30]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[31]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[32]  Christos Davatzikos,et al.  Voxel-Based Morphometry Using the RAVENS Maps: Methods and Validation Using Simulated Longitudinal Atrophy , 2001, NeuroImage.

[33]  Samantha L. Free,et al.  Quantitative MRI detects abnormalities in relatives of patients with epilepsy and malformations of cortical development , 2003, NeuroImage.

[34]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[35]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[36]  Bernhard Schölkopf,et al.  Learning similarity measure for multi-modal 3D image registration , 2009, CVPR 2009.

[37]  G. Frisoni,et al.  Detection of grey matter loss in mild Alzheimer's disease with voxel based morphometry , 2002, Journal of neurology, neurosurgery, and psychiatry.

[38]  S. Resnick,et al.  One-year age changes in MRI brain volumes in older adults. , 2000, Cerebral cortex.

[39]  Imran A. Pirwani,et al.  Introduction to the Non-rigid Image Registration Evaluation Project (NIREP) , 2006, WBIR.

[40]  Paul Suetens,et al.  Non-rigid Image Registration Using a Statistical Spline Deformation Model , 2003, IPMI.

[41]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[42]  Dinggang Shen,et al.  RABBIT: Rapid alignment of brains by building intermediate templates , 2009, NeuroImage.

[43]  Nick C Fox,et al.  Modeling brain deformations in Alzheimer disease by fluid registration of serial 3D MR images. , 1998, Journal of computer assisted tomography.

[44]  R. Woods,et al.  Cortical change in Alzheimer's disease detected with a disease-specific population-based brain atlas. , 2001, Cerebral cortex.

[45]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[46]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[47]  Fernando De la Torre,et al.  Metric Learning for Image Alignment , 2009, International Journal of Computer Vision.

[48]  Dinggang Shen,et al.  Learning Best Features and Deformation Statistics for Hierarchical Registration of MR Brain Images , 2007, IPMI.

[49]  Dinggang Shen,et al.  Very High-Resolution Morphometry Using Mass-Preserving Deformations and HAMMER Elastic Registration , 2003, NeuroImage.