A variational approach to non-rigid image registration with Bregman divergences and multiple features

Abstract Variational methods register images by minimizing functionals that balance measures of smoothness and image similarity. However, the specificity of image-similarity measures can limit the application of variational methods. To address this issue, we propose a new energy functional that generalizes the classical variational method for nonrigid image registration. Our generalization uses Bregman divergences as the similarity measure of the registration functional. These divergences include a number of important similarity measures, such as the Squared Loss distance, the KL divergence, the Logistic Loss, the Mahalanobis distance, the Itakura–Saito divergence, and the I-divergence. We derive the Euler Lagrange and gradient-flow equations associated with the new functional. By using Bregman divergences, our registration method can combine various types of image characterization as well as spatial and statistical information. Our experiments show that the use of Bregman divergences improves registration quality.

[1]  Paul M. Thompson,et al.  Fluid Registration of Diffusion Tensor Images Using Information Theory , 2008, IEEE Transactions on Medical Imaging.

[2]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[3]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[4]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[5]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[6]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[7]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[8]  Jundong Liu,et al.  Local frequency representations for robust multimodal image registration , 2002, IEEE Transactions on Medical Imaging.

[9]  Wei Liu,et al.  Estimating Nonrigid Shape Deformation Using Moments , 2010, 2010 20th International Conference on Pattern Recognition.

[10]  Lawrence Cayton,et al.  Fast nearest neighbor retrieval for bregman divergences , 2008, ICML '08.

[11]  Shu Liao,et al.  Maximum distance-gradient for robust image registration , 2008, Medical Image Anal..

[12]  Frank Nielsen,et al.  Tailored Bregman Ball Trees for Effective Nearest Neighbors , 2009 .

[13]  Frank Nielsen,et al.  Shape Retrieval Using Hierarchical Total Bregman Soft Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Célia A. Zorzo Barcelos,et al.  Bregman Divergence Applied to Hierarchical Segmentation Problems , 2015, CIARP.

[15]  Simon Wildermuth,et al.  Experience of 4 years with open MR defecography: pictorial review of anorectal anatomy and disease. , 2002, Radiographics : a review publication of the Radiological Society of North America, Inc.

[16]  Max A. Viergever,et al.  f-information measures in medical image registration , 2004, IEEE Transactions on Medical Imaging.

[17]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[18]  Jinsong Leng,et al.  Analysis of Hu's moment invariants on image scaling and rotation , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[19]  J. Flusser,et al.  Moments and Moment Invariants in Pattern Recognition , 2009 .

[20]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[21]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[22]  A. Ardeshir Goshtasby.  Image Registration: Principles, Tools and Methods , 2012 .

[23]  J. Modersitzki,et al.  A unified approach to fast image registration and a new curvature based registration technique , 2004 .

[24]  Wei Xie,et al.  Variational method for joint optical flow estimation and edge-aware image restoration , 2017, Pattern Recognit..

[25]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[26]  Célia A. Zorzo Barcelos,et al.  MR defecography registration for computer-aided diagnosis of pelvic floor disorder , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[27]  C. Broit.  Optimal registration of deformed images , 1981 .

[28]  Svetha Venkatesh,et al.  Efficient and accurate set-based registration of time-separated aerial images , 2015, Pattern Recognit..

[29]  Murray E. Alexander,et al.  Nonlinear registration using variational principle for mutual information , 2008, Pattern Recognit..

[30]  Paul Suetens,et al.  Image registration using mutual information , 2015 .

[31]  Colin Fyfe,et al.  Extending metric multidimensional scaling with Bregman divergences , 2011, Pattern Recognit..

[32]  Christos Davatzikos,et al.  Spatial Transformation and Registration of Brain Images Using Elastically Deformable Models , 1997, Comput. Vis. Image Underst..

[33]  Frank Sauer,et al.  Learning Based Non-rigid Multi-modal Image Registration Using Kullback-Leibler Divergence , 2005, MICCAI.

[34]  L. Bregman.  The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[35]  Yun He,et al.  A generalized divergence measure for robust image registration , 2003, IEEE Trans. Signal Process..

[36]  Yunmei Chen,et al.  Inverse Consistent Deformable Image Registration , 2010 .

[37]  Noppadol Chumchob,et al.  Vectorial Total Variation-Based Regularization for Variational Image Registration , 2013, IEEE Transactions on Image Processing.