Gabor Feature-Based LogDemons With Inertial Constraint for Nonrigid Image Registration

Nonrigid image registration plays an important role in the field of computer vision and medical application. The methods based on Demons algorithm for image registration usually use intensity difference as similarity criteria. However, intensity based methods can not preserve image texture details well and are limited by local minima. In order to solve these problems, we propose a Gabor feature based LogDemons registration method in this article, called GFDemons. We extract Gabor features of the registered images to construct feature similarity metric since Gabor filters are suitable to extract image texture information. Furthermore, because of the weak gradients in some image regions, the update fields are too small to transform the moving image to the fixed image correctly. In order to compensate this deficiency, we propose an inertial constraint strategy based on GFDemons, named IGFDemons, using the previous update fields to provide guided information for the current update field. The inertial constraint strategy can further improve the performance of the proposed method in terms of accuracy and convergence. We conduct experiments on three different types of images and the results demonstrate that the proposed methods achieve better performance than some popular methods.

[1]  Nicholas Ayache,et al.  A Log-Euclidean Framework for Statistics on Diffeomorphisms , 2006, MICCAI.

[2]  Dongdong Yu,et al.  A new region descriptor for multi-modal medical image registration and region detection , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Le Zhang,et al.  Incorporation of Structural Tensor and Driving Force Into Log-Demons for Large-Deformation Image Registration , 2019, IEEE Transactions on Image Processing.

[4]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[5]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[6]  Nicholas Ayache,et al.  Iconic feature based nonrigid registration: the PASHA algorithm , 2003, Comput. Vis. Image Underst..

[7]  Dinggang Shen,et al.  BIRNet: Brain image registration using dual‐supervised fully convolutional networks , 2018, Medical Image Anal..

[8]  Joni-Kristian Kämäräinen,et al.  Invariance properties of Gabor filter-based features-overview and applications , 2006, IEEE Transactions on Image Processing.

[9]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[10]  Leo Grady,et al.  Spectral Demons - Image Registration via Global Spectral Correspondence , 2012, ECCV.

[11]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[12]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[13]  David J. Nutt,et al.  Inertial Demons: A Momentum-Based Diffeomorphic Registration Framework , 2016, MICCAI.

[14]  Yue Wu,et al.  A Novel Two-Step Registration Method for Remote Sensing Images Based on Deep and Local Features , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Tianzi Jiang,et al.  Diffeomorphic Metric Landmark Mapping Using Stationary Velocity Field Parameterization , 2015, International Journal of Computer Vision.

[16]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[18]  Daniel Rueckert,et al.  Diffeomorphic Registration Using B-Splines , 2006, MICCAI.

[19]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Edward H. Adelson,et al.  Human-assisted motion annotation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Philippe Carré,et al.  Spectral Graph Wavelet based Nonrigid Image Registration , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[22]  P. Thomas Fletcher,et al.  Fast Diffeomorphic Image Registration via Fourier-Approximated Lie Algebras , 2018, International Journal of Computer Vision.

[23]  Jundong Liu,et al.  Local frequency representations for robust multimodal image registration , 2002, IEEE Transactions on Medical Imaging.

[24]  Lei Zhang,et al.  Gabor Feature Based Sparse Representation for Face Recognition with Gabor Occlusion Dictionary , 2010, ECCV.

[25]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[26]  Emad Fatemizadeh,et al.  Image Registration Based on Low Rank Matrix: Rank-Regularized SSD , 2018, IEEE Transactions on Medical Imaging.

[27]  Pei Yang,et al.  An Effective Non-rigid Image Registration Method Based on Active Demons Algorithm , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[28]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[29]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[30]  Monica Hernandez,et al.  Contributions to 3D Diffeomorphic Atlas Estimation: Application to Brain Images , 2007, MICCAI.

[31]  Nicholas Ayache,et al.  Symmetric Log-Domain Diffeomorphic Registration: A Demons-Based Approach , 2008, MICCAI.

[32]  J. Sherman,et al.  Adjustment of an Inverse Matrix Corresponding to a Change in One Element of a Given Matrix , 1950 .

[33]  Yaxin Peng,et al.  Nonlinear image registration with bidirectional metric and reciprocal regularization , 2017, PloS one.

[34]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[35]  Benoit M. Dawant,et al.  Morphometric analysis of white matter lesions in MR images: method and validation , 1994, IEEE Trans. Medical Imaging.

[36]  Zeyun Yu,et al.  Multi-Modal Medical Image Registration with Full or Partial Data: A Manifold Learning Approach , 2018, J. Imaging.

[37]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[38]  Leo Grady,et al.  Spectral Log-Demons: Diffeomorphic Image Registration with Very Large Deformations , 2013, International Journal of Computer Vision.

[39]  Karl J. Friston,et al.  Diffeomorphic registration using geodesic shooting and Gauss–Newton optimisation , 2011, NeuroImage.

[40]  Dinggang Shen,et al.  TPS-HAMMER: Improving HAMMER registration algorithm by soft correspondence matching and thin-plate splines based deformation interpolation , 2010, NeuroImage.

[41]  Joe Y. Chang,et al.  Validation of an accelerated ‘demons’ algorithm for deformable image registration in radiation therapy , 2005, Physics in medicine and biology.

[42]  Mert R. Sabuncu,et al.  An Unsupervised Learning Model for Deformable Medical Image Registration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[43]  Junjun Jiang,et al.  Guided Locality Preserving Feature Matching for Remote Sensing Image Registration , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.