Multimodal retinal image registration using edge map and feature guided Gaussian mixture model

In this paper, we propose a method for multimodal retinal image registration based on feature guided Gaussian mixture model (GMM) and edge map. We extract two sets of feature points from the edge maps of two images, and formulate image registration as the estimation of a feature guided mixture of densities: a GMM is fitted to one point set, such that both the centers and local features of the Gaussian densities are constrained to coincide with the other point set. The problem is solved under a maximum-likelihood framework together with an iterative EM algorithm initialized by confident feature matches, where the image transformation is modeled by an affine function. Extensive experiments on various retinal images show the robustness of our method, which consistently outperforms other state-of-the-arts, especially when the data is badly degraded.

[1]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yu Zhou,et al.  Mismatch removal via coherent spatial mapping , 2012, 2012 19th IEEE International Conference on Image Processing.

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[6]  Gérard G. Medioni,et al.  Retinal image registration from 2D to 3D , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Zhuowen Tu,et al.  Robust Estimation of Nonrigid Transformation for Point Set Registration , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[9]  Paul L. Rosin,et al.  Improving Accuracy and E � ciency of Mutual Information for Multi-modal Retinal Image Registration using Adaptive Probability Density Estimation , 2015 .

[10]  Ruimin Hu,et al.  Facial Image Hallucination Through Coupled-Layer Neighbor Embedding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Radu Horaud,et al.  Rigid and Articulated Point Registration with Expectation Conditional Maximization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ruimin Hu,et al.  Noise Robust Face Hallucination via Locality-Constrained Representation , 2014, IEEE Transactions on Multimedia.

[13]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[14]  Xing Zhang,et al.  Salient Feature Region: A New Method for Retinal Image Registration , 2011, IEEE Transactions on Information Technology in Biomedicine.

[15]  Guoliang Fan,et al.  Hybrid retinal image registration , 2006, IEEE Transactions on Information Technology in Biomedicine.

[16]  A. V. Cideciyan,et al.  Registration of ocular fundus images: an algorithm using cross-correlation of triple invariant image descriptors , 1995 .

[17]  Ali M. Reza,et al.  Realization of the Contrast Limited Adaptive Histogram Equalization (CLAHE) for Real-Time Image Enhancement , 2004, J. VLSI Signal Process..

[18]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  V. Harabis,et al.  Hybrid retinal image registration using phase correlation , 2013 .

[20]  Jie Ma,et al.  A robust method for vector field learning with application to mismatch removing , 2011, CVPR 2011.

[21]  Yuan Gao,et al.  Symmetric Non-rigid Structure from Motion for Category-Specific Object Structure Estimation , 2016, ECCV.