Exploring the optimal integration levels between SAR and optical data for better urban land cover mapping in the Pearl River Delta

Abstract Integrating synthetic aperture radar (SAR) and optical data to improve urban land cover classification has been identified as a promising approach. However, which integration level is the most suitable remains unclear but important to many researchers and engineers. This study aimed to compare different integration levels for providing a scientific reference for a wide range of studies using optical and SAR data. SAR data from TerraSAR-X and ENVISAT ASAR in both WSM and IMP modes were used to be combined with optical data at pixel level, feature level and decision levels using four typical machine learning methods. The experimental results indicated that: 1) feature level that used both the original images and extracted features achieved a significant improvement of up to 10% compared to that using optical data alone; 2) different levels of fusion required different suitable methods depending on the data distribution and data resolution. For instance, support vector machine was the most stable at both the feature and decision levels, while random forest was suitable at the pixel level but not suitable at the decision level. 3) By examining the distribution of SAR features, some features (e.g., homogeneity) exhibited a close-to-normal distribution, explaining the improvement from the maximum likelihood method at the feature and decision levels. This indicated the benefits of using texture features from SAR data when being combined with optical data for land cover classification. Additionally, the research also shown that combining optical and SAR data does not guarantee improvement compared with using single data source for urban land cover classification, depending on the selection of appropriate fusion levels and fusion methods.

[1]  U. Soergel Radar Remote Sensing of Urban Areas , 2010 .

[2]  Paolo Gamba,et al.  Combining SAR-Based and Multispectral-Based Extractions to Map Urban Areas at Multiple Spatial Resolutions , 2015, IEEE Geoscience and Remote Sensing Magazine.

[3]  Hongsheng Zhang,et al.  Improving the impervious surface estimation with combined use of optical and SAR remote sensing images , 2014 .

[4]  Yasser Maghsoudi,et al.  Classification of Polarimetric SAR Images Based on Modeling Contextual Information and Using Texture Features , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[5]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[6]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[7]  Hui Lin,et al.  Mapping urban impervious surface with dual-polarimetric SAR data: An improved method , 2016 .

[8]  Lior Rokach,et al.  Ensemble-based classifiers , 2010, Artificial Intelligence Review.

[9]  Paolo Gamba,et al.  Texture-based characterization of urban environments on satellite SAR images , 2003, IEEE Trans. Geosci. Remote. Sens..

[10]  Thomas Blaschke,et al.  Fusion of TerraSAR-x and Landsat ETM+ data for protected area mapping in Uganda , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[11]  Christine Pohl,et al.  Remote sensing image fusion: an update in the context of Digital Earth , 2014, Int. J. Digit. Earth.

[12]  Jinghui Yang,et al.  Block-regression based fusion of optical and SAR imagery for feature enhancement , 2010 .

[13]  R. Pontius,et al.  Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment , 2011 .

[14]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[15]  Craig A. Coburn,et al.  A multiscale texture analysis procedure for improved forest stand classification , 2004 .

[16]  E. Nezry,et al.  Adaptive speckle filters and scene heterogeneity , 1990 .

[17]  Paolo Gamba,et al.  Spatial Indexes for the Extraction of Formal and Informal Human Settlements From High-Resolution SAR Images , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  André Twele,et al.  Regional land cover mapping in the humid tropics using combined optical and SAR satellite data—a case study from Central Sulawesi, Indonesia , 2009 .

[19]  F. D. van der Meer,et al.  What does multisensor image fusion add in terms of information content for visual interpretation , 1997 .

[20]  Zong-Guo Xia,et al.  SAR applications in human settlement detection, population estimation and urban land use pattern analysis: a status report , 1997, IEEE Trans. Geosci. Remote. Sens..

[21]  Jixian Zhang Multi-source remote sensing data fusion: status and trends , 2010 .

[22]  Björn Waske,et al.  Classifying Multilevel Imagery From SAR and Optical Sensors by Decision Fusion , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Paolo Gamba,et al.  Feature fusion to improve road network extraction in high-resolution SAR images , 2006, IEEE Geoscience and Remote Sensing Letters.

[24]  Kenneth Grogan,et al.  A Review of the Application of Optical and Radar Remote Sensing Data Fusion to Land Use Mapping and Monitoring , 2016, Remote. Sens..

[25]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[26]  Fawwaz T. Ulaby,et al.  SAR speckle reduction using wavelet denoising and Markov random field modeling , 2002, IEEE Trans. Geosci. Remote. Sens..

[27]  Christine Pohl,et al.  Remote Sensing Image Fusion: A Practical Guide , 2016 .

[28]  Hui Lin,et al.  A comparison study of impervious surfaces estimation using optical and SAR remote sensing images , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[29]  David A. Clausi,et al.  A fast method to determine co-occurrence texture features , 1998, IEEE Trans. Geosci. Remote. Sens..

[30]  H. B. Mitchell Image Fusion: Theories, Techniques and Applications , 2010 .

[31]  Liangpei Zhang,et al.  Scene Classification Based on the Multifeature Fusion Probabilistic Topic Model for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Xiao Xiang Zhu,et al.  Data Fusion and Remote Sensing: An ever-growing relationship , 2016, IEEE Geoscience and Remote Sensing Magazine.

[33]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[34]  J. Dubois,et al.  Evaluation Of The Grey-level Co-occurrence Matrix Method For Land-cover Classification Using Spot Imagery , 1990 .

[35]  Anne Puissant,et al.  The utility of texture analysis to improve per‐pixel classification for high to very high spatial resolution imagery , 2005 .

[36]  Peng Gong,et al.  Geographic stacking: Decision fusion to increase global land cover map accuracy , 2015 .

[37]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[38]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[39]  Yun Zhang,et al.  Recent advances in pansharpening and key problems in applications , 2014 .