Deformable medical image registration: setting the state of the art with discrete methods.

This review introduces a novel deformable image registration paradigm that exploits Markov random field formulation and powerful discrete optimization algorithms. We express deformable registration as a minimal cost graph problem, where nodes correspond to the deformation grid, a node's connectivity corresponds to regularization constraints, and labels correspond to 3D deformations. To cope with both iconic and geometric (landmark-based) registration, we introduce two graphical models, one for each subproblem. The two graphs share interconnected variables, leading to a modular, powerful, and flexible formulation that can account for arbitrary image-matching criteria, various local deformation models, and regularization constraints. To cope with the corresponding optimization problem, we adopt two optimization strategies: a computationally efficient one and a tight relaxation alternative. Promising results demonstrate the potential of this approach. Discrete methods are an important new trend in medical image registration, as they provide several improvements over the more traditional continuous methods. This is illustrated with several key examples where the presented framework outperforms existing general-purpose registration methods in terms of both performance and computational complexity. Our methods become of particular interest in applications where computation time is a critical issue, as in intraoperative imaging, or where the huge variation in data demands complex and application-specific matching criteria, as in large-scale multimodal population studies. The proposed registration framework, along with a graphical interface and corresponding publications, is available for download for research purposes (for Windows and Linux platforms) from http://www.mrf-registration.net.

[1]  Pierre Hellier,et al.  Coupling dense and landmark-based approaches for nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[2]  Nikos Komodakis,et al.  Beyond Loose LP-Relaxations: Optimizing MRFs by Repairing Cycles , 2008, ECCV.

[3]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[4]  Ergun Ahunbay,et al.  Automated registration of large deformations for adaptive radiation therapy of prostate cancer. , 2009 .

[5]  Nassir Navab,et al.  Deformable Mosaicing for Whole-Body MRI , 2008, MICCAI.

[6]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[7]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[8]  Christopher M. Brown,et al.  The theory and practice of Bayesian image labeling , 1990, International Journal of Computer Vision.

[9]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[10]  Peter Lorenzen,et al.  Multi-modal image set registration and atlas formation , 2006, Medical Image Anal..

[11]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[12]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[13]  M. Kessler Image registration and data fusion in radiation therapy. , 2006, The British journal of radiology.

[14]  Christos Davatzikos,et al.  Nonlinear elastic registration of brain images with tumor pathology using a biomechanical model [MRI] , 1999, IEEE Transactions on Medical Imaging.

[15]  Torsten Rohlfing,et al.  Volume-preserving nonrigid registration of MR breast images using free-form deformation with an incompressibility constraint , 2003, IEEE Transactions on Medical Imaging.

[16]  Karl Rohr,et al.  Hybrid Spline-Based Multimodal Registration Using Local Measures for Joint Entropy and Mutual Information , 2009, MICCAI.

[17]  Daniel Rueckert,et al.  Simultaneous Fine and Coarse Diffeomorphic Registration: Application to Atrophy Measurement in Alzheimer's Disease , 2010, MICCAI.

[18]  Robert J. Maciunas,et al.  Registration of head CT images to physical space using a weighted combination of points and surfaces [image-guided surgery] , 1998, IEEE Transactions on Medical Imaging.

[19]  V. Boldea,et al.  Simulation of four-dimensional CT images from deformable registration between inhale and exhale breath-hold CT scans. , 2006, Medical physics.

[20]  Guido Gerig,et al.  Unbiased diffeomorphic atlas construction for computational anatomy , 2004, NeuroImage.

[21]  Jiann-Der Lee,et al.  Fast-MICP for frameless image-guided surgery. , 2010, Medical physics.

[22]  Jean-Francois Mangin,et al.  Multisubject Non-rigid Registration of Brain MRI Using Intensity and Geometric Features , 2001, MICCAI.

[23]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[24]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[25]  Karl Rohr,et al.  Elastic registration of medical images using radial basis functions with compact support , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  Ben Glocker,et al.  Simultaneous Geometric - Iconic Registration , 2010, MICCAI.

[27]  M. Miller,et al.  Landmark Matching via Large Deformation , 2000 .

[28]  Nikos Komodakis,et al.  MRF Energy Minimization and Beyond via Dual Decomposition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[30]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[31]  James S. Duncan,et al.  Estimation of 3-D left ventricular deformation from medical images using biomechanical models , 2002, IEEE Transactions on Medical Imaging.

[32]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[33]  Sang Uk Lee,et al.  Nonrigid Image Registration Using DynamicHigher-Order MRF Model , 2008, ECCV.

[34]  D. R. Fulkerson,et al.  Flows in Networks. , 1964 .

[35]  Andrew V. Goldberg,et al.  A new approach to the maximum flow problem , 1986, STOC '86.

[36]  Nikos Komodakis,et al.  Approximate Labeling via Graph Cuts Based on Linear Programming , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Stan Z. Li Markov Random Field Modeling in Image Analysis , 2009, Advances in Pattern Recognition.

[38]  Josien P. W. Pluim,et al.  Evaluation of Optimization Methods for Nonrigid Medical Image Registration Using Mutual Information and B-Splines , 2007, IEEE Transactions on Image Processing.

[39]  Bernhard Schölkopf,et al.  Learning similarity measure for multi-modal 3D image registration , 2009, CVPR 2009.

[40]  H. Huisman,et al.  Prostate cancer localization with dynamic contrast-enhanced MR imaging and proton MR spectroscopic imaging. , 2006, Radiology.

[41]  Ben Glocker,et al.  Graphical Models and Deformable Diffeomorphic Population Registration Using Global and Local Metrics , 2009, MICCAI.

[42]  Jianhua Xuan,et al.  Nonrigid Medical Image Registration by Finite-Element Deformable Sheet-Curve Models , 2006, Int. J. Biomed. Imaging.

[43]  W. Eric L. Grimson,et al.  Multi-modal Image Registration by Minimising Kullback-Leibler Distance , 2002, MICCAI.

[44]  Olivier D. Faugeras,et al.  Variational Methods for Multimodal Image Matching , 2002, International Journal of Computer Vision.

[45]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[46]  James C. Gee,et al.  Point similarity measures for non-rigid registration of multi-modal data , 2003, Comput. Vis. Image Underst..

[47]  Nicholas Ayache,et al.  Polyrigid and Polyaffine Transformations: A New Class of Diffeomorphisms for Locally Rigid or Affine Registration , 2003, MICCAI.

[48]  Jerry L Prince,et al.  Cardiac motion tracking using CINE harmonic phase (HARP) magnetic resonance imaging , 1999, Magnetic resonance in medicine.

[49]  Nassir Navab,et al.  Dense Registration with Deformation Priors , 2009, IPMI.

[50]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[51]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[52]  C. Nimsky,et al.  Intraoperative compensation for brain shift. , 2001, Surgical neurology.

[53]  Nick C Fox,et al.  Automated Hippocampal Segmentation by Regional Fluid Registration of Serial MRI: Validation and Application in Alzheimer's Disease , 2001, NeuroImage.

[54]  F. Bookstein Thin-plate splines and decomposition of deformation , 1989 .

[55]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[57]  Nikos Paragios,et al.  Data fusion through cross-modality metric learning using similarity-sensitive hashing , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[58]  Pushmeet Kohli,et al.  Dynamic Graph Cuts for Efficient Inference in Markov Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Andrew W. Fitzgibbon,et al.  Global stereo reconstruction under second order smoothness priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[60]  Brendan J. Frey,et al.  A Revolution: Belief Propagation in Graphs with Cycles , 1997, NIPS.

[61]  Robert T. Schultz,et al.  A unified non-rigid feature registration method for brain mapping , 2003, Medical Image Anal..

[62]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[63]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[64]  Vaithilingam Jeyakumar,et al.  Continuous optimization : current trends and modern applications , 2005 .

[65]  Dinggang Shen,et al.  Deformable registration of brain tumor images via a statistical model of tumor-induced deformation , 2006, Medical Image Anal..

[66]  Jürgen Weese,et al.  Landmark-based elastic registration using approximating thin-plate splines , 2001, IEEE Transactions on Medical Imaging.

[67]  Nikos Komodakis,et al.  A Kernel-based graphical model for diffusion tensor registration , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[68]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[69]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[70]  Nassir Navab,et al.  Primal/Dual Linear Programming and Statistical Atlases for Cartilage Segmentation , 2007, MICCAI.

[71]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[72]  Daniel Rueckert,et al.  Diffeomorphic Registration Using B-Splines , 2006, MICCAI.

[73]  Nassir Navab,et al.  Optical flow estimation with uncertainties through dynamic MRFs , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[74]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[75]  Nick C Fox,et al.  Brain atrophy progression measured from registered serial MRI: Validation and application to alzheimer's disease , 1997, Journal of magnetic resonance imaging : JMRI.

[76]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[77]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[78]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[79]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[80]  Nassir Navab,et al.  Inter and Intra-modal Deformable Registration: Continuous Deformations Meet Efficient Optimal Linear Programming , 2007, IPMI.

[81]  Gary E. Christensen,et al.  Consistent landmark and intensity-based image registration , 2002, IEEE Transactions on Medical Imaging.

[82]  Patrick Clarysse,et al.  A review of cardiac image registration methods , 2002, IEEE Transactions on Medical Imaging.

[83]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[84]  Nassir Navab,et al.  Dense image registration through MRFs and efficient linear programming , 2008, Medical Image Anal..

[85]  Paul Suetens,et al.  Nonrigid Image Registration Using Free-Form Deformations with a Local Rigidity Constraint , 2004, MICCAI.

[86]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[87]  Nikos Komodakis,et al.  Performance vs computational efficiency for optimizing single and dynamic MRFs: Setting the state of the art with primal-dual strategies , 2008, Comput. Vis. Image Underst..

[88]  Anil K. Jain,et al.  Markov random fields : theory and application , 1993 .

[89]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[90]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[91]  Nicholas Ayache,et al.  Processing of in vivo fibered confocal microscopy video sequences , 2008 .