Robust Feature Matching Method for SAR and Optical Images by Using Gaussian-Gamma-Shaped Bi-Windows-Based Descriptor and Geometric Constraint

Improving the matching reliability of multi-sensor imagery is one of the most challenging issues in recent years, particularly for synthetic aperture radar (SAR) and optical images. It is difficult to deal with the noise influence, geometric distortions, and nonlinear radiometric difference between SAR and optical images. In this paper, a method for SAR and optical images matching is proposed. First, interest points that are robust to speckle noise in SAR images are detected by improving the original phase-congruency-based detector. Second, feature descriptors are constructed for all interest points by combining a new Gaussian-Gamma-shaped bi-windows-based gradient operator and the histogram of oriented gradient pattern. Third, descriptor similarity and geometrical relationship are combined to constrain the matching processing. Finally, an approach based on global and local constraints is proposed to eliminate outliers. In the experiments, SAR images including COSMO-Skymed, RADARSAT-2, TerraSAR-X and HJ-1C images, and optical images including ZY-3 and Google Earth images are used to evaluate the performance of the proposed method. The experimental results demonstrate that the proposed method provides significant improvements in the number of correct matches and matching precision compared with the state-of-the-art SIFT-like methods. Near 1 pixel registration accuracy is obtained based on the matching results of the proposed method.

[1]  Qing Zhu,et al.  GGSOR: A Gaussian-Gamma-Shaped bi-windows based descriptor for optical and SAR images matching , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[2]  马文萍 A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2014 .

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Peter Reinartz,et al.  Combining Mutual Information and Scale Invariant Feature Transform for Fast and Robust Multisensor SAR Image Registration , 2009 .

[5]  Liu Jing-zheng ON SAR IMAGE MATCHING TECHNOLOGY BASED ON SIFT , 2008 .

[6]  Fawwaz T. Ulaby,et al.  Statistical properties of logarithmically transformed speckle , 2002, IEEE Trans. Geosci. Remote. Sens..

[7]  Haigang Sui,et al.  Automatic Optical-to-SAR Image Registration by Iterative Line Extraction and Voronoi Integrated Spectral Point Matching , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Peter Reinartz,et al.  Modifications in the SIFT operator for effective SAR image matching , 2010 .

[9]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Dong Cheng,et al.  Edge Detector of SAR Images Using Gaussian-Gamma-Shaped Bi-Windows , 2012, IEEE Geoscience and Remote Sensing Letters.

[11]  Olivier Germain,et al.  On the bias of the likelihood ratio edge detector for SAR images , 2000, IEEE Trans. Geosci. Remote. Sens..

[12]  Olivier Germain,et al.  Edge location in SAR images: performance of the likelihood ratio filter and accuracy improvement with an active contour approach , 2001, IEEE Trans. Image Process..

[13]  Yun Zhang,et al.  A Novel Interest-Point-Matching Algorithm for High-Resolution Satellite Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Min Chen,et al.  Invariant matching method for different viewpoint angle images. , 2013, Applied optics.

[15]  Y. Ye,et al.  HOPC: A NOVEL SIMILARITY METRIC BASED ON GEOMETRIC STRUCTURAL PROPERTIES FOR MULTI-MODAL REMOTE SENSING IMAGE MATCHING , 2016 .

[16]  Nicolas Baghdadi,et al.  Rapid Urban Mapping Using SAR/Optical Imagery Synergy , 2008, Sensors.

[17]  Joni Storie,et al.  Evaluating SAR-Optical Image Fusions for Urban LULC Classification in Vancouver Canada , 2014 .

[18]  Hong Gu,et al.  Edge detection of SAR images using incorporate shift-invariant DWT and binarization method , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[19]  Carlos Roberto de Souza Filho,et al.  Evaluating Moisture and Geometry Effects on L-Band SAR Classification Performance Over a Tropical Rain Forest Environment , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Li Shen,et al.  Robust Optical-to-SAR Image Matching Based on Shape Properties , 2017, IEEE Geoscience and Remote Sensing Letters.

[21]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[22]  Peter Kovesi,et al.  Image Features from Phase Congruency , 1995 .

[23]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[24]  Maoguo Gong,et al.  Remote Sensing Image Registration With Modified SIFT and Enhanced Feature Matching , 2017, IEEE Geoscience and Remote Sensing Letters.

[25]  Chunhong Pan,et al.  Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT , 2013, IEEE Geoscience and Remote Sensing Letters.

[26]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[27]  Knut Conradsen,et al.  CFAR edge detector for polarimetric SAR images , 2003, IEEE Trans. Geosci. Remote. Sens..

[28]  A. Gruen Development and Status of Image Matching in Photogrammetry , 2012 .

[29]  A. Ardeshir Goshtasby,et al.  Piecewise linear mapping functions for image registration , 1986, Pattern Recognit..

[30]  Peter Reinartz,et al.  Applicability of the SIFT operator to geometric SAR image registration , 2010 .

[31]  Yuanxin Ye,et al.  A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differences , 2014 .

[32]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[33]  Sidnei J. S. Sant'Anna,et al.  ALOS/PALSAR Data Evaluation for Land Use and Land Cover Mapping in the Amazon Region , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Luisa Verdoliva,et al.  Detection of environmental hazards through the feature-based fusion of optical and SAR data: a case study in southern Italy , 2015 .

[35]  Peter Kovesi,et al.  Phase Congruency Detects Corners and Edges , 2003, DICTA.