Fuzzy correspondences guided Gaussian mixture model for point set registration

The proposed fuzzy correspondences guided Gaussian mixture model for registration.Soft-assignment strategy is used to construct fuzzy correspondences.The proposed method is robust to data degradations and non-rigid transformation. Recovering correspondences and estimating transformations are challenging to solve in the presence of outliers and other degradations for non-rigid point set registration. In this paper, we propose a new methodology based on fuzzy correspondences guided Gaussian Mixture Model (GMM) to solve the registration problem between two or more feature point sets. We first construct a mixture model to represent the moving point set, where inliers are formulated as a mixture of Gaussian, and outliers are formulated as an additional uniform distribution. Then we use the context-aware shape descriptor to assign the points and obtain the fuzzy correspondences. On the one hand, the soft-assignment is used to classify the weight of inliers and outliers. On the other hand, by using the fuzzy correspondences, the Gaussian elements in the mixture model can be estimated to increase the registration accuracy efficiently. In this way, the optimal transformation between two point sets can be expressed by representation theorem and solved by EM algorithm iteratively in a high-dimensional feature space (i.e., reproducing kernel Hilbert space, RKHS). Extensive experiments on synthesized and real datasets demonstrate the proposed method performs favorably against the state-of-the-art methods in most tested scenarios.

[1]  Gang Wang,et al.  Robust Point Matching Using Mixture of Asymmetric Gaussians for Nonrigid Transformation , 2014, ACCV.

[2]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[3]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Mongi A. Abidi,et al.  A new method for the registration of three-dimensional point-sets: The Gaussian Fields framework , 2010, Image Vis. Comput..

[5]  Sami Romdhani,et al.  Optimal Step Nonrigid ICP Algorithms for Surface Registration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Takeo Kanade,et al.  A Correlation-Based Approach to Robust Point Set Registration , 2004, ECCV.

[7]  Gang Wang,et al.  Robust point matching method for multimodal retinal image registration , 2015, Biomed. Signal Process. Control..

[8]  Gang Wang,et al.  Removing mismatches for retinal image registration via multi-attribute-driven regularized mixture model , 2016, Inf. Sci..

[9]  David S. Doermann,et al.  Robust point matching for nonrigid shapes by preserving local neighborhood structures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Gang Wang,et al.  Context-Aware Gaussian Fields for Non-rigid Point Set Registration , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Charles A. Micchelli,et al.  On Learning Vector-Valued Functions , 2005, Neural Computation.

[12]  Adrian Hilton,et al.  Correspondence labelling for wide-timeframe free-form surface matching , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[13]  Andriy Myronenko,et al.  On the closed-form solution of the rotation matrix arising in computer vision problems , 2009, ArXiv.

[14]  Eric Mjolsness,et al.  New Algorithms for 2D and 3D Point Matching: Pose Estimation and Correspondence , 1998, NIPS.

[15]  Jean Ponce,et al.  Learning Graphs to Match , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[17]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[18]  Changming Zhu,et al.  Entropy-based matrix learning machine for imbalanced data sets , 2017, Pattern Recognit. Lett..

[19]  Alan L. Yuille,et al.  A mathematical analysis of the motion coherence theory , 1989, International Journal of Computer Vision.

[20]  Fernando De la Torre,et al.  Deformable Graph Matching , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Fernando De la Torre,et al.  Factorized Graph Matching , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Gang Wang,et al.  Robust Non-Rigid Point Set Registration Using Spatially Constrained Gaussian Fields , 2017, IEEE Transactions on Image Processing.

[23]  Miguel Á. Carreira-Perpiñán,et al.  Non-rigid point set registration: Coherent Point Drift , 2006, NIPS.

[24]  Alan L. Yuille,et al.  The Motion Coherence Theory , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[25]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[26]  Gang Wang,et al.  A robust non-rigid point set registration method based on asymmetric gaussian representation , 2015, Comput. Vis. Image Underst..

[27]  Haibin Ling,et al.  Shape Classification Using the Inner-Distance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[29]  Zhuowen Tu,et al.  Robust Estimation of Nonrigid Transformation for Point Set Registration , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Leslie Greengard,et al.  The Fast Gauss Transform , 1991, SIAM J. Sci. Comput..

[31]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[32]  Gang Wang,et al.  Fuzzy Correspondences and Kernel Density Estimation for Contaminated Point Set Registration , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[33]  H. Chui,et al.  A feature registration framework using mixture models , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[34]  Hongdong Li,et al.  A new and compact algorithm for simultaneously matching and estimation , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Ji Zhao,et al.  Non-rigid visible and infrared face registration via regularized Gaussian fields criterion , 2015, Pattern Recognit..

[36]  H. C. Longuet-Higgins,et al.  An algorithm for associating the features of two images , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[37]  Lei Peng,et al.  Learning coherent vector fields for robust point matching under manifold regularization , 2016, Neurocomputing.

[38]  Minsu Cho,et al.  Reweighted Random Walks for Graph Matching , 2010, ECCV.

[39]  Zhuowen Tu,et al.  Regularized vector field learning with sparse approximation for mismatch removal , 2013, Pattern Recognit..

[40]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Jiaolong Yang,et al.  Go-ICP: Solving 3D Registration Efficiently and Globally Optimally , 2013, 2013 IEEE International Conference on Computer Vision.

[42]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[44]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Alan L. Yuille,et al.  Non-Rigid Point Set Registration by Preserving Global and Local Structures , 2016, IEEE Transactions on Image Processing.

[46]  Zhuowen Tu,et al.  Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration , 2015, IEEE Transactions on Signal Processing.