Probabilistic Model for Robust Affine and Non-Rigid Point Set Matching

In this work, we propose a combinative strategy based on regression and clustering for solving point set matching problems under a Bayesian framework, in which the regression estimates the transformation from the model to the sceneand the clustering establishes the correspondence between two point sets. The point set matching model is illustrated by a hierarchical directed graph, and the matching uncertainties are approximated by a coarse-to-fine variational inference algorithm. Furthermore, two Gaussian mixtures are proposed for the estimation of heteroscedastic noise and spurious outliers, and an isotropic or anisotropic covariance can be imposed on each mixture in terms of the transformed model points. The experimental results show that the proposed approach achieves comparable performance to state-of-the-art matching or registration algorithms in terms of both robustness and accuracy.

[1]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[2]  Zhuowen Tu,et al.  Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration , 2015, IEEE Transactions on Signal Processing.

[3]  Jie Ma,et al.  A robust method for vector field learning with application to mismatch removing , 2011, CVPR 2011.

[4]  Eric Mjolsness,et al.  Two-Dimensional Object Localization by Coarse-to-Fine Correlation Matching , 1993, NIPS.

[5]  Vikas Singh,et al.  Solving the multi-way matching problem by permutation synchronization , 2013, NIPS.

[6]  Shaobo Hou,et al.  Robust estimation of gaussian mixtures from noisy input data , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Matthew J. Beal.  Variational algorithms for approximate Bayesian inference , 2003 .

[9]  Yonghuai Liu,et al.  Automatic registration of overlapping 3D point clouds using closest points , 2006, Image Vis. Comput..

[10]  Radu Horaud,et al.  A Generative Model for the Joint Registration of Multiple Point Sets , 2014, ECCV.

[11]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  H. Chui,et al.  A feature registration framework using mixture models , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[14]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  R. Tibshirani,et al.  Generalized Additive Models , 1986 .

[16]  Scott C. Schmidler,et al.  Fast Bayesian Shape Matching Using Geometric Algorithms , 2006 .

[17]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[18]  Takeo Kanade,et al.  A Correlation-Based Approach to Robust Point Set Registration , 2004, ECCV.

[19]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[20]  Radu Horaud,et al.  Rigid and Articulated Point Registration with Expectation Conditional Maximization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yonghuai Liu,et al.  Automatic 3d free form shape matching using the graduated assignment algorithm , 2005, Pattern Recognit..

[22]  Yang Xiang,et al.  Retinal image registration using bifurcation structures , 2011, 2011 18th IEEE International Conference on Image Processing.

[23]  Takeo Kanade,et al.  A Generative Shape Regularization Model for Robust Face Alignment , 2008, ECCV.

[24]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[25]  William D. Penny,et al.  Variational Bayes for generalized autoregressive models , 2002, IEEE Trans. Signal Process..

[26]  Yong Wang,et al.  A generalized-constraint neural network model: Associating partially known relationships for nonlinear regressions , 2009, Inf. Sci..

[27]  Bao-Gang Hu,et al.  Variational learning for Generalized Associative Functional Networks in modeling dynamic process of plant growth , 2009, Ecol. Informatics.

[28]  Stefan Schaal,et al.  The Bayesian backfitting relevance vector machine , 2004, ICML.

[29]  JianBing,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011 .

[30]  Matthew J. Beal,et al.  The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures , 2003 .

[31]  Douglas A. Reynolds,et al.  Gaussian Mixture Models , 2018, Encyclopedia of Biometrics.

[32]  Mohamed A. Deriche,et al.  3D registration using a new implementation of the ICP algorithm based on a comprehensive lookup matrix: Application to medical imaging , 2007, Pattern Recognit. Lett..

[33]  Neil D. Lawrence,et al.  Variational Bayesian Independent Component Analysis , 1999 .

[34]  Michael Werman,et al.  On using priors in affine matching , 2004, Image Vis. Comput..

[35]  I. Dryden,et al.  Bayesian matching of unlabeled marked point sets using random fields, with an application to molecular alignment , 2011, 1203.0098.

[36]  Vincent Lepetit,et al.  Real-time nonrigid surface detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[38]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[39]  Z. Li,et al.  A fast expected time algorithm for the 2-D point pattern matching problem , 2004, Pattern Recognit..

[40]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[41]  Mark W. Woolrich,et al.  Probabilistic inference of regularisation in non-rigid registration , 2012, NeuroImage.

[42]  Dale Schuurmans,et al.  Graphical Models and Point Pattern Matching , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Gang Wang,et al.  From images to models: automatic 3D object model construction from multiple views , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[44]  Daniel Pizarro-Perez,et al.  Feature-Based Deformable Surface Detection with Self-Occlusion Reasoning , 2011, International Journal of Computer Vision.