FSDAF 2.0: Improving the performance of retrieving land cover changes and preserving spatial details

Abstract Spatiotemporal fusion is a feasible solution to resolve the tradeoff between the temporal and spatial resolutions of remote sensing images. However, the development of spatiotemporal fusion algorithms has not yet reached maturity, and existing methods still face many challenges, e.g., accurately retrieving land cover changes and improving the robustness of fusion algorithms. The Flexible Spatiotemporal DAta Fusion (FSDAF) method proposed by Zhu et al. in 2016 solved the abovementioned problems to some extent. However, FSDAF has two shortcomings that can be further improved: (1) FSDAF is prone to losing spatial details and predicting a “blurrier” image due to the input of coarse pixels containing type change information and a large amount of boundary information for unmixing calculation, and (2) FSDAF does not optimize the areas of land cover change. In this paper, an improved FSDAF method incorporating change detection technology and an optimized model for changed-type areas (FSDAF 2.0) was proposed to improve the aforementioned problems. Based on the existing FSDAF algorithm, FSDAF 2.0 excludes changed pixels and boundary pixels for unmixing calculation, and establishes a model to optimize the changed pixels. Its performance was compared with that of the Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM), the original FSDAF, and the enhanced FSDAF that incorporates sub-pixel class fraction change information (SFSDAF). Two sites consisting of landscapes with heterogeneous and large-scale abrupt land cover changes were employed for testing. The results of the experiments demonstrate that FSDAF 2.0 effectively improves the shortcomings of FSDAF, blends synthetic fine-resolution images with higher accuracy than that of the other three methods at two different sites, and strengthens the robustness of the fusion algorithm. More importantly, FSDAF 2.0 has a powerful ability to retrieve land cover changes and provides a feasible way to improve the performance of retrieving land cover changes. Consequently, FSDAF 2.0 has great potential for monitoring complex dynamic changes in the Earth's surface.

[1]  Xiaolin Zhu,et al.  An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions , 2010 .

[2]  Xiaolin Zhu,et al.  Monitoring interannual dynamics of desertification in Minqin County, China, using dense Landsat time series , 2020, Int. J. Digit. Earth.

[3]  Mingquan Wu,et al.  Use of MODIS and Landsat time series data to generate high-resolution temporal synthetic Landsat data using a spatial and temporal reflectance fusion model , 2012 .

[4]  Meng Liu,et al.  An Improved Flexible Spatiotemporal DAta Fusion (IFSDAF) method for producing high spatiotemporal resolution normalized difference vegetation index time series , 2019, Remote Sensing of Environment.

[5]  Sushma Panigrahy,et al.  Study on the utility of IRS-P6 AWiFS SWIR band for crop discrimination and classification , 2009 .

[6]  Yanhong Tang,et al.  Influences of temperature and precipitation before the growing season on spring phenology in grasslands of the central and eastern Qinghai-Tibetan Plateau , 2011 .

[7]  Jindi Wang,et al.  Bayesian Method for Building Frequent Landsat-Like NDVI Datasets by Integrating MODIS and Landsat NDVI , 2016, Remote. Sens..

[8]  Bo Huang,et al.  Spatiotemporal Reflectance Fusion via Sparse Representation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[9]  O. Dubrule Comparing splines and kriging , 1984 .

[10]  H. Lilliefors On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[11]  Dieter Oertel,et al.  Unmixing-based multisensor multiresolution image fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[12]  Joanne C. White,et al.  A new data fusion model for high spatial- and temporal-resolution mapping of forest disturbance based on Landsat and MODIS , 2009 .

[13]  C. Rudorff,et al.  Remote sensing monitoring of the impact of a major mining wastewater disaster on the turbidity of the Doce River plume off the eastern Brazilian coast , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[14]  Yasushi Yamaguchi,et al.  Spectral indices for lithologic discrimination and mapping by using the ASTER SWIR bands , 2003 .

[15]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[16]  V. Moosavi,et al.  A wavelet-artificial intelligence fusion approach (WAIFA) for blending Landsat and MODIS surface temperature , 2015 .

[17]  Giles M. Foody,et al.  SFSDAF: An enhanced FSDAF that incorporates sub-pixel class fraction change information for spatio-temporal image fusion , 2020, Remote Sensing of Environment.

[18]  Wenzhong Shi,et al.  A spatio-temporal fusion method for remote sensing data Using a linear injection model and local neighbourhood information , 2018, International Journal of Remote Sensing.

[19]  Fernando Pérez-Cabello,et al.  Fusing Landsat and MODIS data to retrieve multispectral information from fire-affected areas over tropical savannah environments in the Brazilian Amazon , 2018, International Journal of Remote Sensing.

[20]  T. Esch,et al.  Monitoring urbanization in mega cities from space , 2012 .

[21]  Bo Huang,et al.  Spatiotemporal Satellite Image Fusion Through One-Pair Image Learning , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Liangpei Zhang,et al.  An Error-Bound-Regularized Sparse Coding for Spatiotemporal Reflectance Fusion , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Michael A. Lefsky,et al.  A flexible spatiotemporal method for fusing satellite images with different resolutions , 2016 .

[24]  Tim R. McVicar,et al.  Assessing the accuracy of blending Landsat–MODIS surface reflectances in two landscapes with contrasting spatial and temporal dynamics: A framework for algorithm selection , 2013 .

[25]  Luis Alonso,et al.  Multitemporal fusion of Landsat/TM and ENVISAT/MERIS for crop monitoring , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[26]  Desheng Liu,et al.  Blending MODIS and Landsat images for urban flood mapping , 2014 .

[27]  C. Woodcock,et al.  Classification and Change Detection Using Landsat TM Data: When and How to Correct Atmospheric Effects? , 2001 .

[28]  Bo Huang,et al.  A generalization of spatial and temporal fusion methods for remotely sensed surface parameters , 2015 .

[29]  Michael E. Schaepman,et al.  Unmixing-Based Landsat TM and MERIS FR Data Fusion , 2008, IEEE Geoscience and Remote Sensing Letters.

[30]  Wei Zhang,et al.  An Enhanced Spatial and Temporal Data Fusion Model for Fusing Landsat and MODIS Surface Reflectance to Generate High Temporal Landsat-Like Data , 2013, Remote. Sens..

[31]  Xiaolin Zhu,et al.  Spatiotemporal Fusion of Multisource Remote Sensing Data: Literature Survey, Taxonomy, Principles, Applications, and Future Directions , 2018, Remote. Sens..

[32]  Peter M. Atkinson,et al.  Enhancing Spatio-Temporal Fusion of MODIS and Landsat Data by Incorporating 250 m MODIS Data , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Liping Di,et al.  Deriving High Spatiotemporal Remote Sensing Images Using Deep Convolutional Network , 2018, Remote. Sens..

[34]  Peter M. Atkinson,et al.  Spatio-temporal fusion for daily Sentinel-2 images , 2018 .

[35]  Ahmad Al Bitar,et al.  Estimating maize biomass and yield over large areas using high spatial and temporal resolution Sentinel-2 like remote sensing data , 2016 .

[36]  S. Jones,et al.  A linear physically-based model for remote sensing of soil moisture using short wave infrared bands , 2015 .

[37]  Qi Yin,et al.  Comparison of Five Spatio-Temporal Satellite Image Fusion Models over Landscapes with Various Spatial Heterogeneity and Temporal Variation , 2019, Remote. Sens..

[38]  Mathew R. Schwaller,et al.  On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Wang,et al.  A Comprehensive and Automated Fusion Method: The Enhanced Flexible Spatiotemporal DAta Fusion Model for Monitoring Dynamic Changes of Land Surface , 2019, Applied Sciences.

[40]  P. Royston Approximating the Shapiro-Wilk W-test for non-normality , 1992 .

[41]  Hua Zhang,et al.  A Two-Stage Spatiotemporal Fusion Method for Remote Sensing Images , 2019 .

[42]  Yu-Kun Lai,et al.  Efficient Circular Thresholding , 2014, IEEE Transactions on Image Processing.

[43]  Yanchen Bo,et al.  Blending multi-resolution satellite sea surface temperature (SST) products using Bayesian maximum entropy method , 2013 .