Mutual information based multi-modal remote sensing image registration using adaptive feature weight

ABSTRACT Multi-module images registration is a challenging task in image processing, and more especially in the field of remote sensing. In this letter, we strive to present a novel mutual information scheme for image registration in remote sensing scenario based on feature map technique. We firstly take saliency detection advantages to extract geographic pattern, and then utilize the efficient Laplacian of Gaussian(LOG) and Guided Filter methods to construct a new feature map based on different characteristic of multi-channel images. To avoid practical traps of sub-optimization, we propose an novel mutual information(MI) algorithm based on an adapted weight strategy. The proposed model divides an image into patches and assigns weighted values according to patch similarities in order to solve the optimization problem, improve accuracy and enhance performance. Note that, our proposed method incorporates the LOG and Guided Filter methods into image registration for the first time to construct a new feature map based on differences and similarities strategy. Experiments are conducted over island and coastline scenes, and reveal that our hybrid model has a significant performance and outperforms the state-of-the-art methods in remote sensing image registration.

[1]  Said M. Easa,et al.  Polygon-based image registration: a new approach for geo-referencing historical maps , 2017 .

[2]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Z. Yi,et al.  Multi-spectral remote image registration based on SIFT , 2008 .

[4]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[5]  Romà Tauler,et al.  A new matching image preprocessing for image data fusion , 2017 .

[6]  Delian Liu,et al.  Spectral Curve Shape Matching Using Derivatives in Hyperspectral Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  David R. Haynor,et al.  Nonrigid multimodality image registration , 2001, SPIE Medical Imaging.

[12]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[13]  Josien P. W. Pluim,et al.  Image registration , 2003, IEEE Transactions on Medical Imaging.

[14]  Ying Li,et al.  Remote sensing image registration based on Gaussian-Hermite moments and the Pseudo-RANSAC algorithm , 2017 .

[15]  Jie Jiang,et al.  A Robust Point-Matching Algorithm Based on Integrated Spatial Structure Constraint for Remote Sensing Image Registration , 2016, IEEE Geoscience and Remote Sensing Letters.

[16]  Luís A. Alexandre,et al.  BIK-BUS: Biologically Motivated 3D Keypoint Based on Bottom-Up Saliency , 2015, IEEE Transactions on Image Processing.

[17]  Weisi Lin,et al.  Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum , 2014, IEEE Transactions on Industrial Informatics.

[18]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[19]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[20]  Francisco Argüello,et al.  Fourier–Mellin registration of two hyperspectral images , 2017 .

[21]  Jitendra Malik,et al.  Shape Matching and Object Recognition , 2006, Toward Category-Level Object Recognition.