Universal SAR and optical image registration via a novel SIFT framework based on nonlinear diffusion and a polar spatial-frequency descriptor

Abstract Due to severe speckle noise in synthetic aperture radar (SAR) images and the large nonlinear intensity differences between SAR and optical images, the registration of SAR and optical images is a challenging problem that remains to be solved. In this paper, an improved nonlinear scale-invariant feature transform (SIFT)-framework-based algorithm that combines spatial feature detection with local frequency-domain description for the registration of SAR and optical images is proposed. First, multiscale representations of the SAR and optical images are constructed based on nonlinear diffusion to better preserve edges and obtain consistent edge information. The ratio of exponentially weighted averages (ROEWA) operator and the Sobel operator are utilized in the process of scale space construction to calculate consistent gradient information. Then, a new feature detection strategy based on the Harris–Laplace ROEWA and Harris–Laplace Sobel techniques is proposed to detect stable and repeatable keypoints in the scale space. Finally, a novel descriptor, called the rotation-invariant amplitudes of log-Gabor orientation histograms (RI-ALGH), and a simplified version, ALGH, are proposed. The proposed descriptors are built based on the amplitudes of multiscale and multiorientation log-Gabor responses and utilize an improved spatial structure of the gradient location and orientation histogram (GLOH) descriptor, which is robust to local distortions. The experimental results on both simulated and real images demonstrate that the proposed method can achieve better results than other state-of-the-art methods in terms of registration accuracy.

[1]  M. Havlena,et al.  Recent developments in large-scale tie-point matching , 2016 .

[2]  Yan Wu,et al.  SAR Image Change Detection Based on Iterative Label-Information Composite Kernel Supervised by Anisotropic Texture , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Angel Domingo Sappa,et al.  LGHD: A feature descriptor for matching across non-linear intensity variations , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[5]  Henry Leung,et al.  A maximum likelihood approach for image registration using control point and intensity , 2004, IEEE Transactions on Image Processing.

[6]  Peter Reinartz,et al.  Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Chunhong Pan,et al.  Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT , 2013, IEEE Geoscience and Remote Sensing Letters.

[8]  A. Lopes,et al.  A statistical and geometrical edge detector for SAR images , 1988 .

[9]  Feng Wang,et al.  Adapted Anisotropic Gaussian SIFT Matching Strategy for SAR Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[10]  Yue Wu,et al.  Remote Sensing Image Registration Based on Phase Congruency Feature Detection and Spatial Constraint Matching , 2018, IEEE Access.

[11]  Lorenzo Bruzzone,et al.  A local phase based invariant feature for remote sensing image matching , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  B. Robson,et al.  Automated classification of debris-covered glaciers combining optical, SAR and topographic data in an object-based environment , 2015 .

[13]  Guisheng Liao,et al.  SAR Image Registration Using Phase Congruency and Nonlinear Diffusion-Based SIFT , 2015, IEEE Geoscience and Remote Sensing Letters.

[14]  Yongjun Zhang,et al.  A novel extended phase correlation algorithm based on Log-Gabor filtering for multimodal remote sensing image registration , 2019, International Journal of Remote Sensing.

[15]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Qingwu Hu,et al.  RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform , 2019, IEEE Transactions on Image Processing.

[17]  Priti P. Rege,et al.  Pixel level fusion techniques for SAR and optical images: A review , 2020, Inf. Fusion.

[18]  Kun Gao,et al.  Infrared and visual image registration based on mutual information with a combined particle swarm optimization – Powell search algorithm , 2016 .

[19]  Jong-Sen Lee,et al.  Unsupervised estimation of speckle noise in radar images , 1992, Int. J. Imaging Syst. Technol..

[20]  Yunfeng Ai,et al.  A Novel Affine and Contrast Invariant Descriptor for Infrared and Visible Image Registration , 2018, Remote. Sens..

[21]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[22]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[23]  P Kovesi,et al.  Phase congruency: A low-level image invariant , 2000, Psychological research.

[24]  Maoguo Gong,et al.  Remote Sensing Image Registration With Modified SIFT and Enhanced Feature Matching , 2017, IEEE Geoscience and Remote Sensing Letters.

[25]  Amin Sedaghat,et al.  Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Maoguo Gong,et al.  A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[27]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[28]  Damian Gromek,et al.  Geometrical Matching of SAR and Optical Images Utilizing ASIFT Features for SAR-based Navigation Aided Systems , 2019, Sensors.

[29]  Ying Yang,et al.  Remote sensing image registration via active contour model , 2009 .

[30]  Haigang Sui,et al.  Automatic Optical-to-SAR Image Registration by Iterative Line Extraction and Voronoi Integrated Spectral Point Matching , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Shu Liao,et al.  Nonrigid Brain MR Image Registration Using Uniform Spherical Region Descriptor , 2012, IEEE Transactions on Image Processing.

[32]  Siamak Khorram,et al.  A feature-based image registration algorithm using improved chain-code representation combined with invariant moments , 1999, IEEE Trans. Geosci. Remote. Sens..

[33]  Lorenzo Bruzzone,et al.  Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Giampaolo Ferraioli,et al.  Edge Detection Using Real and Imaginary Decomposition of SAR Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Xiao Xiang Zhu,et al.  Semantic segmentation of slums in satellite images using transfer learning on fully convolutional neural networks , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  Hongjian You,et al.  BFSIFT: A Novel Method to Find Feature Matches for SAR Image Registration , 2012, IEEE Geoscience and Remote Sensing Letters.

[37]  Haigang Sui,et al.  An automatic optical and SAR image registration method with iterative level set segmentation and SIFT , 2015 .

[38]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Yong Xu,et al.  High-Performance SAR Image Matching Using Improved SIFT Framework Based on Rolling Guidance Filter and ROEWA-Powered Feature , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[41]  Göran Salomonsson,et al.  Image enhancement based on a nonlinear multiscale method , 1997, IEEE Trans. Image Process..

[42]  Yuming Xiang,et al.  OS-SIFT: A Robust SIFT-Like Algorithm for High-Resolution Optical-to-SAR Image Registration in Suburban Areas , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Philippe Marthon,et al.  An optimal multiedge detector for SAR image segmentation , 1998, IEEE Trans. Geosci. Remote. Sens..