Image Registration Algorithm Based on Manifold Regularization with Thin-Plate Spline Model

In this paper, we propose a new method based on manifold regularization technology with a thin-plate spline for image registration, which is used to remove the outlier by approximating the transformation function. Under a Bayesian framework, we use a latent variable to indicate whether a correspondence is an inlier that should satisfy a mapping function; and then, we formulate the problem as optimizing a posterior problem related to the mapping function. The initial correspondences discard some mismatching points because of the similarity constraint, which may contain important information; however, the manifold regularization (MR) term utilizes all of the feature points and preserve this information as a constraint. In addition, we use the thin-plate spline (TPS) model, which is composed of a global affine transformation and local bending function, to construct the transformation function. Finally, we obtain the solution using the expectation-maximization algorithm. Extensive experiments show that our method outperforms with other comparable state-of-art methods.

[1]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[2]  Zhuowen Tu,et al.  Robust Estimation of Nonrigid Transformation for Point Set Registration , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Junjun Jiang,et al.  Guided Locality Preserving Feature Matching for Remote Sensing Image Registration , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Zhuowen Tu,et al.  Regularized vector field learning with sparse approximation for mismatch removal , 2013, Pattern Recognit..

[5]  Quan Z. Sheng,et al.  Nonrigid Point Set Registration With Robust Transformation Learning Under Manifold Regularization , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Shuicheng Yan,et al.  Common visual pattern discovery via spatially coherent correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Junjun Jiang,et al.  Robust Feature Matching Using Spatial Clustering With Heavy Outliers , 2020, IEEE Transactions on Image Processing.

[8]  Hans P. Moravec Rover Visual Obstacle Avoidance , 1981, IJCAI.

[9]  Zhuowen Tu,et al.  Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration , 2015, IEEE Transactions on Signal Processing.

[10]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[11]  Junjun Jiang,et al.  Multiscale Locality and Rank Preservation for Robust Feature Matching of Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[13]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[14]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[15]  Junjun Jiang,et al.  LMR: Learning a Two-Class Classifier for Mismatch Removal , 2019, IEEE Transactions on Image Processing.

[16]  Junjun Jiang,et al.  Locality Preserving Matching , 2018, International Journal of Computer Vision.

[17]  Tao Lu,et al.  Image Deformation With Vector-Field Interpolation Based on MRLS-TPS , 2018, IEEE Access.

[18]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[19]  Li Ma,et al.  Non-rigid point set registration via coherent spatial mapping , 2015, Signal Process..

[20]  Jie Ma,et al.  A robust method for vector field learning with application to mismatch removing , 2011, CVPR 2011.

[21]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[23]  Noah Snavely,et al.  Image matching using local symmetry features , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Yansheng Li,et al.  Feature guided Gaussian mixture model with semi-supervised EM and local geometric constraint for retinal image registration , 2017, Inf. Sci..

[25]  Junjun Jiang,et al.  Non-Rigid Point Set Registration with Robust Transformation Estimation under Manifold Regularization , 2017, AAAI.

[26]  Zhenghong Yu,et al.  Feature guided non-rigid image/surface deformation via moving least squares with manifold regularization , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).