A novel coarse-to-fine method for registration of multispectral images

Abstract Due to non-linear intensity changes between multispectral images, the existed descriptors often yield low matching performance. In order to build reliable keypoint mappings on multispectral images, a novel coarse-to-fine method is designed using projective transformation and the information of edge overlap. The method consists of a coarse process and a fine-tuning process. In the coarse process, initial keypoint mappings are built with the descriptors associated with keypoints and the relative distance constraints are employed on them to remove outliers. In the fine-tuning process, the edge overlap information is utilized as similarity metric and an iterative framework is applied to search correct keypoint mappings. The performance of the proposed is investigated with keypoints extracted by speeded-up robust features. The experiment results show that the proposed method can build more reliable keypoint mappings on multispectral images than existed methods.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Angel Domingo Sappa,et al.  Feature Point Descriptors: Infrared and Visible Spectra , 2014, Sensors.

[3]  Z. Yi,et al.  Multi-spectral remote image registration based on SIFT , 2008 .

[4]  Sabine Süsstrunk,et al.  Multi-spectral SIFT for scene category recognition , 2011, CVPR 2011.

[5]  Ayan Chakrabarti,et al.  Statistics of real-world hyperspectral images , 2011, CVPR 2011.

[6]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[7]  Pierre-Marc Jodoin,et al.  Perspective-SIFT: An efficient tool for low-altitude remote sensing image registration , 2013, Signal Process..

[8]  Angel Domingo Sappa,et al.  Multispectral Image Feature Points , 2012, Sensors.

[9]  Guojun Lu,et al.  Improved Symmetric-SIFT for Multi-modal Image Registration , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[10]  Jie Tian,et al.  Real-time multi-modal rigid registration based on a novel symmetric-SIFT descriptor , 2009 .

[11]  Yong Li,et al.  Incorporating global information in feature-based multimodal image registration , 2014, J. Electronic Imaging.

[12]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[14]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[15]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[16]  Sajid Saleem,et al.  A Robust SIFT Descriptor for Multispectral Images , 2014, IEEE Signal Processing Letters.

[17]  K. M. Simonson,et al.  A Statistics-Based Approach to Binary Image Registration with Uncertainty Analysis , 2007 .

[18]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[20]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[22]  Maoguo Gong,et al.  A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.