A Novel Correspondence Selection Technique for Affine Rigid Image Registration

This paper presents a novel technique called correspondence selection for rigid transformations in order to effectively refine keypoint matches in rigid image registration. The proposed technique mainly lies in the following two components. First, keypoint matches are ranked and selected by the distance ratio between the best match and the second best match. Second, keypoint matches are further selected by ranking the geometric similarity between corresponding keypoint triplets. These two components enhance the discriminative power of potential keypoint matches in a progressive way. The proposed technique is generally applicable to affine rigid image registration. Experiments have been conducted using a set of benchmark datasets in the field of image registration, indicating that the proposed technique is very effective and achieves the state-of-the-art performance in refining keypoint matches for affine rigid image registration.

[1]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[2]  Guojun Lu,et al.  Multimodal image registration technique based on improved local feature descriptors , 2015, J. Electronic Imaging.

[3]  Peter Meer,et al.  Subspace Estimation Using Projection Based M-Estimators over Grassmann Manifolds , 2006, ECCV.

[4]  Guojun Lu,et al.  Enhancing SIFT-based image registration performance by building and selecting highly discriminating descriptors , 2016, Pattern Recognit. Lett..

[5]  Peter Meer,et al.  Beyond RANSAC: User Independent Robust Regression , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[6]  Jiri Matas,et al.  Randomized RANSAC with sequential probability ratio test , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Shiliang Zhang,et al.  Edge-SIFT: Discriminative Binary Descriptor for Scalable Partial-Duplicate Mobile Search , 2013, IEEE Transactions on Image Processing.

[8]  Xiong Fengguang,et al.  A 3D Surface Matching Method Using Keypoint- Based Covariance Matrix Descriptors , 2017, IEEE Access.

[9]  Guojun Lu,et al.  Improved Symmetric-SIFT for Multi-modal Image Registration , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[10]  Peter Meer,et al.  Generalized projection based M-estimator: Theory and applications , 2011, CVPR 2011.

[11]  Hanzi Wang,et al.  AMSAC: An adaptive robust estimator for model fitting , 2013, 2013 IEEE International Conference on Image Processing.

[12]  Jan-Michael Frahm,et al.  USAC: A Universal Framework for Random Sample Consensus , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Guohua Lv Robust and effective techniques for multi-modal image registration , 2015 .

[14]  Jiri Matas,et al.  Randomized RANSAC with Td, d test , 2004, Image Vis. Comput..

[15]  Yong Li,et al.  Multimodal image registration by iteratively searching keypoint correspondences , 2013, Electronic Imaging.

[16]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[18]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[19]  Peter Meer,et al.  Generalized Projection-Based M-Estimator , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Alan L. Yuille,et al.  Non-Rigid Point Set Registration by Preserving Global and Local Structures , 2016, IEEE Transactions on Image Processing.

[21]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[22]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[23]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Sabine Süsstrunk,et al.  Illuminant estimation and detection using near-infrared , 2009, Electronic Imaging.

[25]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[26]  Jong Beom Ra,et al.  Multi-sensor image registration based on intensity and edge orientation information , 2008, Pattern Recognit..

[27]  Yong Li,et al.  Incorporating global information in feature-based multimodal image registration , 2014, J. Electronic Imaging.

[28]  Guojun Lu,et al.  Enhancing image registration performance by incorporating distribution and spatial distance of local descriptors , 2018, Pattern Recognit. Lett..

[29]  Charles V. Stewart,et al.  Keypoint Descriptors for Matching Across Multiple Image Modalities and Non-linear Intensity Variations , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Noah Snavely,et al.  Image matching using local symmetry features , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  W. Marsden I and J , 2012 .

[32]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Guojun Lu,et al.  COREG: a corner based registration technique for multimodal images , 2017, Multimedia Tools and Applications.

[34]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[35]  Jiri Matas,et al.  Optimal Randomized RANSAC , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Xiaochun Cao,et al.  Good match exploration using triangle constraint , 2012, Pattern Recognit. Lett..

[37]  Cordelia Schmid,et al.  A Robust and Efficient Video Representation for Action Recognition , 2015, International Journal of Computer Vision.

[38]  Jie Tian,et al.  Real-time multi-modal rigid registration based on a novel symmetric-SIFT descriptor , 2009 .