Removing mismatches for retinal image registration via multi-attribute-driven regularized mixture model

In order to address the problem of retinal image registration, this paper proposes and analyzes a novel and general matching algorithm called Multi-Attribute-Driven Regularized Mixture Model (MAD-RMM). Mismatches removal can play a key role in image registration, which refers to establish reliable matches between two point sets. Here the presented approach starts from multi-feature attributes which are used to guide the feature matching to identify inliers (correct matches) from outliers (incorrect matches), and then estimates the spatial transformation. In this paper, motivated by the problem of feature matching that the initial correspondence is always contaminated by outliers, thereby we formulate this issue as a probability deformable mixture model which consists of Gaussian components for inliers and uniform components for outliers. Moreover, the algorithm takes full advantage of using multiple attributes for better general matching performance. Here we are assuming all inliers are mapped into a high-dimensional feature space, namely reproducing kernel Hilbert space (RKHS), and the closed-form solution to the mapping function is given by the representation theorem with L2 norm regularization under the Expectation-Maximization (EM) algorithm. Finally, we evaluate the performance of the algorithm by applying it to retinal image registration on several datasets, where experimental results demonstrate that the MAD-RMM outperforms current state-of-the-art methods and shows the robustness to outliers on real retinal images.

[1]  Ji Zhao,et al.  Non-rigid visible and infrared face registration via regularized Gaussian fields criterion , 2015, Pattern Recognit..

[2]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Zhanyi Hu,et al.  Rejecting Mismatches by Correspondence Function , 2010, International Journal of Computer Vision.

[5]  Charles A. Micchelli,et al.  On Learning Vector-Valued Functions , 2005, Neural Computation.

[6]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[7]  Gang Wang,et al.  A robust non-rigid point set registration method based on asymmetric gaussian representation , 2015, Comput. Vis. Image Underst..

[8]  Vikas Sindhwani,et al.  Vector-valued Manifold Regularization , 2011, ICML.

[9]  Zhuowen Tu,et al.  Regularized vector field learning with sparse approximation for mismatch removal , 2013, Pattern Recognit..

[10]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[11]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[12]  Mongi A. Abidi,et al.  Gaussian fields: a new criterion for 3D rigid registration , 2004, Pattern Recognit..

[13]  Jean Claude Nunes,et al.  A multiscale elastic registration scheme for retinal angiograms , 2004, Comput. Vis. Image Underst..

[14]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[15]  Shu Liao,et al.  A Markov Random Field Groupwise Registration Framework for Face Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Lei Zhang,et al.  Sparse Representation Classifier for microaneurysm detection and retinal blood vessel extraction , 2012, Inf. Sci..

[17]  Dinggang Shen,et al.  S‐HAMMER: Hierarchical attribute‐guided, symmetric diffeomorphic registration for MR brain images , 2014, Human brain mapping.

[18]  Chia-Ling Tsai,et al.  The Edge-Driven Dual-Bootstrap Iterative Closest Point Algorithm for Registration of Multimodal Fluorescein Angiogram Sequence , 2010, IEEE Transactions on Medical Imaging.

[19]  Frédéric Zana,et al.  A multimodal registration algorithm of eye fundus images using vessels detection and Hough transform , 1999, IEEE Transactions on Medical Imaging.

[20]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[21]  Paul L. Rosin,et al.  Improving accuracy and efficiency of mutual information for multi-modal retinal image registration using adaptive probability density estimation , 2013, Comput. Medical Imaging Graph..

[22]  Dinggang Shen,et al.  Hierarchical Attribute-Guided Symmetric Diffeomorphic Registration for MR Brain Images , 2012, MICCAI.

[23]  Yuan Yan Tang,et al.  Elastic registration for retinal images based on reconstructed vascular trees , 2006, IEEE Transactions on Biomedical Engineering.

[24]  Anand Rangarajan,et al.  The Softassign Procrustes Matching Algorithm , 1997, IPMI.

[25]  A. V. Cideciyan,et al.  Registration of ocular fundus images: an algorithm using cross-correlation of triple invariant image descriptors , 1995 .

[26]  Mateu Sbert,et al.  Image registration by compression , 2010, Inf. Sci..

[27]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[28]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[29]  Chia-Ling Tsai,et al.  The dual-bootstrap iterative closest point algorithm with application to retinal image registration , 2003, IEEE Transactions on Medical Imaging.

[30]  Dinggang Shen,et al.  Improved image registration by sparse patch-based deformation estimation , 2015, NeuroImage.

[31]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[32]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Tieniu Tan,et al.  Phase Correlation Based Iris Image Registration Model , 2005, Journal of Computer Science and Technology.

[34]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[35]  Liang Zhou,et al.  The detection and quantification of retinopathy using digital angiograms , 1994, IEEE Trans. Medical Imaging.

[36]  Gang Wang,et al.  Robust Point Matching Using Mixture of Asymmetric Gaussians for Nonrigid Transformation , 2014, ACCV.

[37]  Michael H. Goldbaum,et al.  Registering retinal images using automatically selected control point pairs , 1994, Proceedings of 1st International Conference on Image Processing.

[38]  Lester Ingber,et al.  Simulated annealing: Practice versus theory , 1993 .

[39]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[40]  Charles V. Stewart,et al.  A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[42]  Leslie Greengard,et al.  The Fast Gauss Transform , 1991, SIAM J. Sci. Comput..

[43]  Jiang Liu,et al.  A low-dimensional step pattern analysis algorithm with application to multimodal retinal image registration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[45]  Jie Ma,et al.  A robust method for vector field learning with application to mismatch removing , 2011, CVPR 2011.

[46]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[47]  Gang Wang,et al.  Robust point matching method for multimodal retinal image registration , 2015, Biomed. Signal Process. Control..

[48]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Guoliang Fan,et al.  Hybrid retinal image registration , 2006, IEEE Transactions on Information Technology in Biomedicine.

[51]  Yulong Shen,et al.  Registration and fusion of retinal images-an evaluation study , 2003, IEEE Transactions on Medical Imaging.

[52]  Gang Wang,et al.  Fuzzy Correspondences and Kernel Density Estimation for Contaminated Point Set Registration , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[53]  L. Zangwill,et al.  Using optical imaging summary data to detect glaucoma. , 2001, Ophthalmology.

[54]  George K. Matsopoulos,et al.  Multimodal registration of retinal images using self organizing maps , 2004, IEEE Transactions on Medical Imaging.

[55]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[56]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[57]  Michael S. Brown,et al.  In Defence of RANSAC for Outlier Rejection in Deformable Registration , 2012, ECCV.