Spatiotemporal fusion method to simultaneously generate full-length normalized difference vegetation index time series (SSFIT)

Abstract High spatiotemporal resolution normalized difference vegetation index (NDVI) time-series imagery is required for monitoring vegetation dynamics with dense observations and spatial details, and in recent years, many spatiotemporal data fusion methods have been proposed to fulfill this need. However, strict data requirements and inappropriate modeling strategies often limit their performance, particularly under poor conditions of available input data. In this study, we proposed a Spatiotemporal fusion method to Simultaneously generate Full-length normalized difference vegetation Index Time series (SSFIT) with a high spatial resolution and frequent coverage. The utilization of temporal information across sensors contributes to its two distinct features: (1) no cloud-free high-spatial-resolution image is required and (2) high-spatial-resolution images on multiple prediction dates are generated at the same time. Comparison experiments were conducted by simulating ideal and challenging conditions of input time-series data in two characteristic areas, and the proposed methods were also compared with four typical methods: The Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM), Flexible Spatiotemporal DAta Fusion (FSDAF), Fit-FC (regression model Fitting, spatial Filtering and residual Compensation), and Improved FSDAF. The results demonstrate that SSFIT yields a better overall prediction accuracy and efficiency under ideal input conditions (average root mean square error of 0.1037 and 0.0713, average correlation coefficient of 0.9180 and 0.7875, and computation time of 109 and 120 s, computed in the two test areas) and is more robust against the decrease in available input data under challenging conditions. SSFIT is thus expected to be extended to various remote sensing products and support applications for monitoring land surface dynamics.

[1]  Qi Yin,et al.  Comparison of Five Spatio-Temporal Satellite Image Fusion Models over Landscapes with Various Spatial Heterogeneity and Temporal Variation , 2019, Remote. Sens..

[2]  D. Roy,et al.  Spatially and temporally complete Landsat reflectance time series modelling: The fill-and-fit approach , 2020 .

[3]  Jinpei Ou,et al.  Assessing the impacts of urban sprawl on net primary productivity using fusion of Landsat and MODIS data. , 2018, Science of the Total Environment.

[4]  Donghui Xie,et al.  Improving Spatial-Temporal Data Fusion by Choosing Optimal Input Image Pairs , 2018, Remote. Sens..

[5]  Joanne C. White,et al.  A new data fusion model for high spatial- and temporal-resolution mapping of forest disturbance based on Landsat and MODIS , 2009 .

[6]  Wenzhong Shi,et al.  FSDAF 2.0: Improving the performance of retrieving land cover changes and preserving spatial details , 2020 .

[7]  Abdollah A. Jarihani,et al.  Blending Landsat and MODIS Data to Generate Multispectral Indices: A Comparison of "Index-then-Blend" and "Blend-then-Index" Approaches , 2014, Remote. Sens..

[8]  Martha C. Anderson,et al.  Toward mapping crop progress at field scales through fusion of Landsat and MODIS imagery , 2017 .

[9]  C. Woodcock,et al.  Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images , 2015 .

[10]  C. Tucker,et al.  Interannual variations in satellite-sensed vegetation index data from 1981 to 1991 , 1998 .

[11]  Bo Huang,et al.  Spatiotemporal Satellite Image Fusion Through One-Pair Image Learning , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Peijuan Wang,et al.  Operational Data Fusion Framework for Building Frequent Landsat-Like Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  D. Roy,et al.  Multi-temporal MODIS-Landsat data fusion for relative radiometric normalization, gap filling, and prediction of Landsat data , 2008 .

[14]  Matthew F. McCabe,et al.  High-Resolution NDVI from Planet's Constellation of Earth Observing Nano-Satellites: A New Data Source for Precision Agriculture , 2016, Remote. Sens..

[15]  Peter M. Atkinson,et al.  Spatio-temporal fusion for daily Sentinel-2 images , 2018 .

[16]  Xiaolin Zhu,et al.  An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions , 2010 .

[17]  Mingquan Wu,et al.  Use of MODIS and Landsat time series data to generate high-resolution temporal synthetic Landsat data using a spatial and temporal reflectance fusion model , 2012 .

[18]  Songnian Li,et al.  Combining spatiotemporal fusion and object-based image analysis for improving wetland mapping in complex and heterogeneous urban landscapes , 2019 .

[19]  Jin Chen,et al.  Sensitivity of six typical spatiotemporal fusion methods to different influential factors: A comparative study for a normalized difference vegetation index time series reconstruction , 2021 .

[20]  Qi Jing,et al.  Estimating winter wheat biomass by assimilating leaf area index derived from fusion of Landsat-8 and MODIS data , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[21]  Richard H. Day,et al.  The Impact of Lidar Elevation Uncertainty on Mapping Intertidal Habitats on Barrier Islands , 2017, Remote. Sens..

[22]  Xinghua Li,et al.  Cloud removal in remote sensing images using nonnegative matrix factorization and error correction , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[23]  James Dean Brown,et al.  Statistics Corner Questions and answers about language testing statistics: Choosing the Right Number of Components or Factors in PCA and EFA Choosing the Right Number of Components or Factors in PCA and EFA , 2009 .

[24]  Xiaolin Zhu,et al.  Spatiotemporal Fusion of Multisource Remote Sensing Data: Literature Survey, Taxonomy, Principles, Applications, and Future Directions , 2018, Remote. Sens..

[25]  Zhe Zhu,et al.  Cloud detection algorithm comparison and validation for operational Landsat data products , 2017 .

[26]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[27]  Paul E. Johnson,et al.  Spectral mixture modeling: A new analysis of rock and soil types at the Viking Lander 1 Site , 1986 .

[28]  Jean-François Cornu,et al.  Landsat-8 cloud-free observations in wet tropical areas: a case study in South East Asia , 2017 .

[29]  Mathew R. Schwaller,et al.  On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Lifan Chen,et al.  Dynamic monitoring of the Poyang Lake wetland by integrating Landsat and MODIS observations , 2018 .

[31]  Cornelius Senf,et al.  Mapping land cover in complex Mediterranean landscapes using Landsat: Improved classification accuracies from integrating multi-seasonal and synthetic imagery , 2015 .

[32]  N. Delbart,et al.  Remote sensing of spring phenology in boreal regions: A free of snow-effect method using NOAA-AVHRR and SPOT-VGT data (1982-2004) , 2006 .

[33]  Matthew F. McCabe,et al.  A Spatio-Temporal Enhancement Method for medium resolution LAI (STEM-LAI) , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[34]  R. Fensholt,et al.  Evaluation of earth observation based long term vegetation trends - Intercomparing NDVI time series trend analysis consistency of Sahel from AVHRR GIMMS, Terra MODIS and SPOT VGT data , 2009 .

[35]  M. Joseph Hughes,et al.  Automated Detection of Cloud and Cloud Shadow in Single-Date Landsat Imagery Using Neural Networks and Spatial Post-Processing , 2014, Remote. Sens..

[36]  Bin Chen,et al.  Comparison of Spatiotemporal Fusion Models: A Review , 2015, Remote. Sens..

[37]  Jin Chen,et al.  A new geostatistical approach for filling gaps in Landsat ETM+ SLC-off images , 2012 .

[38]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[39]  Xiaohua Tong,et al.  Virtual image pair-based spatio-temporal fusion , 2020, Remote Sensing of Environment.

[40]  S. Goward,et al.  Global Primary Production: A Remote Sensing Approach , 1995 .

[41]  Ji Zhou,et al.  A simple method to improve the quality of NDVI time-series data by integrating spatiotemporal information with the Savitzky-Golay filter , 2018, Remote Sensing of Environment.

[42]  S. Running,et al.  Global products of vegetation leaf area and fraction absorbed PAR from year one of MODIS data , 2002 .

[43]  Edwin W. Pak,et al.  An extended AVHRR 8‐km NDVI dataset compatible with MODIS and SPOT vegetation NDVI data , 2005 .

[44]  Xiangnan Liu,et al.  A Modified Spatiotemporal Fusion Algorithm Using Phenological Information for Predicting Reflectance of Paddy Rice in Southern China , 2018, Remote. Sens..

[45]  Molly E. Brown,et al.  Evaluation of the consistency of long-term NDVI time series derived from AVHRR,SPOT-vegetation, SeaWiFS, MODIS, and Landsat ETM+ sensors , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Lin Yan,et al.  Large-Area Gap Filling of Landsat Reflectance Time Series by Spectral-Angle-Mapper Based Spatio-Temporal Similarity (SAMSTS) , 2018, Remote. Sens..

[47]  Xiaolin Zhu,et al.  "Blend-then-Index" or "Index-then-Blend": A Theoretical Analysis for Generating High-resolution NDVI Time Series by STARFM , 2018 .

[48]  Michael A. Lefsky,et al.  A flexible spatiotemporal method for fusing satellite images with different resolutions , 2016 .

[49]  Peijuan Wang,et al.  Fusing Landsat and MODIS Data for Vegetation Monitoring , 2015, IEEE Geoscience and Remote Sensing Magazine.

[50]  Gérard Dedieu,et al.  Methodology for the estimation of terrestrial net primary production from remotely sensed data , 1994 .

[51]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .

[52]  Giles M. Foody,et al.  SFSDAF: An enhanced FSDAF that incorporates sub-pixel class fraction change information for spatio-temporal image fusion , 2020, Remote Sensing of Environment.

[53]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[54]  W. J. Bell,et al.  Seasonal adaptations of insects. , 1987 .

[55]  Jin Chen,et al.  A simple method for reconstructing a high-quality NDVI time-series data set based on the Savitzky-Golay filter , 2004 .

[56]  Yanchen Bo,et al.  Blending multi-resolution satellite sea surface temperature (SST) products using Bayesian maximum entropy method , 2013 .

[57]  D. Roy,et al.  The availability of cloud-free Landsat ETM+ data over the conterminous United States and globally , 2008 .

[58]  Qingshan Liu,et al.  Spatiotemporal Satellite Image Fusion Using Deep Convolutional Neural Networks , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Peter M. Atkinson,et al.  Fusion of Landsat 8 OLI and Sentinel-2 MSI Data , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[60]  A. Strahler,et al.  Climate controls on vegetation phenological patterns in northern mid‐ and high latitudes inferred from MODIS data , 2004 .

[61]  Liangpei Zhang,et al.  An Integrated Framework for the Spatio–Temporal–Spectral Fusion of Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Feng Gao,et al.  A simple and effective method for filling gaps in Landsat ETM+ SLC-off images , 2011 .

[63]  F. Javier García-Haro,et al.  A comparison of STARFM and an unmixing-based algorithm for Landsat and MODIS data fusion , 2015 .

[64]  Ji Zhou,et al.  Modeling vegetation green-up dates across the Tibetan Plateau by including both seasonal and daily temperature and precipitation , 2018 .

[65]  Tim R. McVicar,et al.  Assessing the accuracy of blending Landsat–MODIS surface reflectances in two landscapes with contrasting spatial and temporal dynamics: A framework for algorithm selection , 2013 .

[66]  Rob J Hyndman,et al.  Detecting trend and seasonal changes in satellite image time series , 2010 .

[67]  Mingquan Wu,et al.  Reconstruction of Daily 30 m Data from HJ CCD, GF-1 WFV, Landsat, and MODIS Data for Crop Monitoring , 2015, Remote. Sens..

[68]  Jin Chen,et al.  An Improved Method for Producing High Spatial-Resolution NDVI Time Series Datasets with Multi-Temporal MODIS NDVI Data and Landsat TM/ETM+ Images , 2015, Remote. Sens..

[69]  Meng Liu,et al.  An Improved Flexible Spatiotemporal DAta Fusion (IFSDAF) method for producing high spatiotemporal resolution normalized difference vegetation index time series , 2019, Remote Sensing of Environment.

[70]  R. Lunetta,et al.  Land-cover change detection using multi-temporal MODIS NDVI data , 2006 .

[71]  W. Verhoef,et al.  Reconstruction of the full spectrum of solar-induced chlorophyll fluorescence: Intercomparison study for a novel method , 2018, Remote Sensing of Environment.

[72]  Zhe Zhu,et al.  Object-based cloud and cloud shadow detection in Landsat imagery , 2012 .

[73]  Jin Chen,et al.  A New Cross-Fusion Method to Automatically Determine the Optimal Input Image Pairs for NDVI Spatiotemporal Data Fusion , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[74]  Dieter Oertel,et al.  Unmixing-based multisensor multiresolution image fusion , 1999, IEEE Trans. Geosci. Remote. Sens..