Developing Long Time Series 1-km Land Cover Maps From 5-km AVHRR Data Using a Super-Resolution Method

Dynamic land cover (LC) information is an essential part of environmental and ecological research. Therefore, acquiring dynamic LC data with high spatial resolution has attracted a great deal of attention in the remote sensing community. Nevertheless, the high-temporal resolution satellite data tend to have a coarse spatial resolution, and satellite data with high temporal resolution are often relatively low. Obtaining LC with high spatiotemporal resolution is extremely challenging. The super-resolution method can help researchers achieve this goal, and the recently developed neural-network-based deep learning algorithms have great potential for use as an alternative solution. This study proposes a focal loss temporal convolutional long short-term memory (FL-T-ConvLSTM) model for super-resolution LC classification research. It first trains the deep FL-T-ConvLSTM network to establish a transformation between low-resolution quantitative remote sensing parameters and high-resolution quantitative remote sensing parameters and then engages in nonlinear mapping with a high-resolution LC map. A long-term series 1-km super-resolution LC classification model based on deep learning was established and applied to the Beijing–Tianjin–Hebei region. Based on this method, a long-term series of 1-km LC maps from 1982 to 2019 can be obtained. The test accuracy and field validation accuracy of the model reached 90.1% and 86.8% when using reliable test samples and field test samples, respectively. This study provides a method for obtaining high-resolution LC classification products from low-resolution quantitative remote-sensing products.

[1]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[2]  Zhe Zhu,et al.  Understanding an urbanizing planet: Strategic directions for remote sensing , 2019, Remote Sensing of Environment.

[3]  Damien Sulla-Menashe,et al.  MODIS Collection 5 global land cover: Algorithm refinements and characterization of new datasets , 2010 .

[4]  Fei Xiao,et al.  Interpolation-based super-resolution land cover mapping , 2013 .

[5]  C. Justice,et al.  Global land cover classification by remote sensing: present capabilities and future possibilities , 1991 .

[6]  Dino Ienco,et al.  Land Cover Classification via Multitemporal Spatial Data by Deep Recurrent Neural Networks , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Qing Xiao,et al.  Advances in quantitative remote sensing product validation: Overview and current status , 2019, Earth-Science Reviews.

[8]  Tao Liu,et al.  Deep learning-based fusion of Landsat-8 and Sentinel-2 images for a harmonized surface reflectance product , 2019 .

[9]  Damien Sulla-Menashe,et al.  A global land-cover validation data set, part I: fundamental design principles , 2012 .

[10]  Steven W. Running,et al.  Ecosystem Disturbance, Carbon, and Climate , 2008, Science.

[11]  Peipei Wang,et al.  Brain Tumor Segmentation Based on 3D Unet with Multi-Class Focal Loss , 2018, 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[12]  Aparna Shukla,et al.  Synergistic approach for mapping debris-covered glaciers using optical–thermal remote sensing data with inputs from geomorphometric parameters , 2010 .

[13]  Bin Chen,et al.  Stable classification with limited sample: transferring a 30-m resolution sample set collected in 2015 to mapping 10-m resolution global land cover in 2017. , 2019, Science bulletin.

[14]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Yuan Gao,et al.  Fine Land-Cover Mapping in China Using Landsat Datacube and an Operational SPECLib-Based Approach , 2019, Remote. Sens..

[16]  Atul K. Jain,et al.  Hotspots of uncertainty in land‐use and land‐cover change projections: a global‐scale model comparison , 2016, Global change biology.

[17]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[18]  Suming Jin,et al.  A land cover change detection and classification protocol for updating Alaska NLCD 2001 to 2011. , 2017 .

[19]  Michael A. Wulder,et al.  Landsat continuity: Issues and opportunities for land cover monitoring , 2008 .

[20]  Gerard B. M. Heuvelink,et al.  Super-Resolution Land Cover Mapping Based on the Convolutional Neural Network , 2019, Remote. Sens..

[21]  Paul M. Mather,et al.  Some issues in the classification of DAIS hyperspectral data , 2006 .

[22]  Joanne C. White,et al.  Optical remotely sensed time series data for land cover classification: A review , 2016 .

[23]  J. Townshend,et al.  A long-term Global LAnd Surface Satellite (GLASS) data-set for environmental studies , 2013 .

[24]  C. A. Mücher,et al.  Environmental science: Agree on biodiversity metrics to track from space , 2015, Nature.

[25]  C. Woodcock,et al.  Continuous change detection and classification of land cover using all available Landsat data , 2014 .

[26]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Yang Shao,et al.  Comparison of support vector machine, neural network, and CART algorithms for the land-cover classification using limited training data points , 2012 .

[28]  J. Townshend,et al.  Global land cover classi(cid:142) cation at 1 km spatial resolution using a classi(cid:142) cation tree approach , 2004 .

[29]  Thomas Wiatowski,et al.  A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction , 2015, IEEE Transactions on Information Theory.

[30]  Rui Li,et al.  Byte Segment Neural Network for Network Traffic Classification , 2018, 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS).

[31]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[32]  Timothy A. Warner,et al.  A time series of annual land use and land cover maps of China from 1982 to 2013 generated using AVHRR GIMMS NDVI3g data , 2017 .

[33]  Jun Chen,et al.  Analysis and Applications of GlobeLand30: A Review , 2017, ISPRS Int. J. Geo Inf..

[34]  G. Meehl,et al.  The Importance of Land-Cover Change in Simulating Future Climates , 2005, Science.

[35]  Josh Harguess,et al.  Image quality assessment for determining efficacy and limitations of Super-Resolution Convolutional Neural Network (SRCNN) , 2019, Optical Engineering + Applications.

[36]  Nathan P. Gillett,et al.  Natural and anthropogenic climate change: incorporating historical land cover change, vegetation dynamics and the global carbon cycle , 2004 .

[37]  G. Foody,et al.  Generating a series of fine spatial and temporal resolution land cover maps by fusing coarse spatial resolution remotely sensed images and fine spatial resolution land cover maps , 2017 .

[38]  Chih-Fong Tsai,et al.  Clustering-based undersampling in class-imbalanced data , 2017, Inf. Sci..

[39]  A. Ducharne,et al.  The impact of global land-cover change on the terrestrial water cycle , 2013 .

[40]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[41]  Martin Herold,et al.  Some challenges in global land cover mapping : An assessment of agreement and accuracy in existing 1 km datasets , 2008 .

[42]  Giles M. Foody,et al.  An evaluation of some factors affecting the accuracy of classification by an artificial neural network , 1997 .

[43]  Le Yu,et al.  Towards a common validation sample set for global land-cover mapping , 2014 .

[44]  J. W. Bruce,et al.  The causes of land-use and land-cover change: moving beyond the myths , 2001 .

[45]  L. S. Davis,et al.  An assessment of support vector machines for land cover classi(cid:142) cation , 2002 .

[46]  Wei Li,et al.  Major forest changes and land cover transitions based on plant functional types derived from the ESA CCI Land Cover product , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[47]  G. Foody,et al.  Super-resolution land cover mapping by deep learning , 2019, Remote Sensing Letters.

[48]  Shunlin Liang,et al.  Analysis of global land surface albedo climatology and spatial‐temporal variation during 1981–2010 from multiple satellite products , 2014 .

[49]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[50]  Jindi Wang,et al.  Long-Time-Series Global Land Surface Satellite Leaf Area Index Product Derived From MODIS and AVHRR Surface Reflectance , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Giles M. Foody,et al.  Super‐resolution mapping of the waterline from remotely sensed data , 2005 .

[52]  Giuseppe Scarpa,et al.  A CNN-Based Fusion Method for Feature Extraction from Sentinel Data , 2018, Remote. Sens..

[53]  Jindi Wang,et al.  Estimating the fraction of absorbed photosynthetically active radiation from the MODIS data based GLASS leaf area index product , 2015 .

[54]  Junwei Han,et al.  Learning Compact and Discriminative Stacked Autoencoder for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Yuqi Bai,et al.  Annual dynamics of global land cover and its long-term changes from 1982 to 2015 , 2020, Earth System Science Data.

[56]  Xian Sun,et al.  Deep Residual Squeeze and Excitation Network for Remote Sensing Image Super-Resolution , 2019, Remote. Sens..

[57]  R. Tateishi,et al.  Remote sensing and GIS for mapping and monitoring land cover and land-use changes in the Northwestern coastal zone of Egypt , 2007 .

[58]  Christopher E. Holden,et al.  Including land cover change in analysis of greenness trends using all available Landsat 5, 7, and 8 images: A case study from Guangzhou, China (2000–2014) , 2016 .

[59]  Bartosz Krawczyk,et al.  Analyzing the oversampling of different classes and types of examples in multi-class imbalanced datasets , 2016, Pattern Recognit..

[60]  Sarnam Singh,et al.  Forest cover change detection of Western Ghats of Maharashtra using satellite remote sensing based visual interpretation technique. , 2010 .

[61]  Hankui K. Zhang,et al.  Finer resolution observation and monitoring of global land cover: first mapping results with Landsat TM and ETM+ data , 2013 .

[62]  D. Roberts,et al.  A comparison of methods for monitoring multitemporal vegetation change using Thematic Mapper imagery , 2002 .

[63]  Yang Shao,et al.  Sub-Pixel Mapping of Tree Canopy, Impervious Surfaces, and Cropland in the Laurentian Great Lakes Basin Using MODIS Time-Series Data , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[64]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[65]  M. Körner,et al.  MULTI-TEMPORAL LAND COVER CLASSIFICATION WITH LONG SHORT-TERM MEMORY NEURAL NETWORKS , 2017 .

[66]  Giles M. Foody,et al.  Optimal Endmember-Based Super-Resolution Land Cover Mapping , 2019, IEEE Geoscience and Remote Sensing Letters.

[67]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[68]  Ruth S. DeFries,et al.  The NOAA/NASA pathfinder AVHRR 8-Km land data set , 1997 .

[69]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Yang Song,et al.  Class-Balanced Loss Based on Effective Number of Samples , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[71]  J. Zidek,et al.  Interpolation with uncertain spatial covariances: a Bayesian alternative to Kriging , 1992 .

[72]  René Roland Colditz,et al.  An Evaluation of Different Training Sample Allocation Schemes for Discrete and Continuous Land Cover Classification Using Decision Tree-Based Algorithms , 2015, Remote. Sens..

[73]  Carsten Brockmann,et al.  Automated Training Sample Extraction for Global Land Cover Mapping , 2014, Remote. Sens..

[74]  Liping Di,et al.  Using long short-term memory recurrent neural network in land cover classification on Landsat and Cropland data layer time series , 2018, International Journal of Remote Sensing.

[75]  Xiang Zhao,et al.  Long Time Series Land Cover Classification in China from 1982 to 2015 Based on Bi-LSTM Deep Learning , 2019, Remote. Sens..

[76]  R. Cowling,et al.  Ecosystem Services, Land-Cover Change, and Stakeholders: Finding a Sustainable Foothold for a Semiarid Biodiversity Hotspot , 2009 .

[77]  Lisa J. Graumlich,et al.  Global Land-Cover Change: Recent Progress, Remaining Challenges , 2006 .

[78]  Qiwei Xie,et al.  An Improved Algorithm for Imbalanced Data and Small Sample Size Classification , 2015 .

[79]  Russell G. Congalton,et al.  Global Land Cover Mapping: A Review and Uncertainty Analysis , 2014, Remote. Sens..

[80]  Xiao Zhang,et al.  A SPECLib-based operational classification approach: A preliminary test on China land cover mapping at 30 m , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[81]  Chandra P. Giri,et al.  Next generation of global land cover characterization, mapping, and monitoring , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[82]  S. Bruin,et al.  Trend changes in global greening and browning: contribution of short‐term trends to longer‐term change , 2012 .

[83]  Shunlin Liang,et al.  Time‐lag effects of global vegetation responses to climate change , 2015, Global change biology.

[84]  Hang Zhou,et al.  Deep learning based multi-temporal crop classification , 2019, Remote Sensing of Environment.

[85]  Ramakrishna R. Nemani,et al.  Development of an evapotranspiration index from Aqua/MODIS for monitoring surface moisture status , 2003, IEEE Trans. Geosci. Remote. Sens..

[86]  Lei Guo,et al.  Exploring Hierarchical Convolutional Features for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[87]  Johannes R. Sveinsson,et al.  Random Forests for land cover classification , 2006, Pattern Recognit. Lett..

[88]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[89]  Bin Yan,et al.  Weighted Focal Loss: An Effective Loss Function to Overcome Unbalance Problem of Chest X-ray14 , 2018, IOP Conference Series: Materials Science and Engineering.

[90]  Chi-Hyuck Jun,et al.  Instance categorization by support vector machines to adjust weights in AdaBoost for imbalanced data classification , 2017, Inf. Sci..

[91]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[92]  Khizar Hayat,et al.  Super-Resolution via Deep Learning , 2017, Digit. Signal Process..