TimeSen2Crop: A Million Labeled Samples Dataset of Sentinel 2 Image Time Series for Crop-Type Classification

This article presents TimeSen2Crop, a pixel-based dataset made up of more than 1 million samples of Sentinel 2 time series (TSs) associated to 16 crop types. This dataset, publicly available, aims to contribute to the worldwide research related to the supervised classification of TSs of Sentinel 2 data for crop type mapping. TimeSen2Crop includes atmospherically corrected images and reports the snow, shadows, and clouds information per labeled unit. The provided TSs represent an agronomic year (i.e., period from one year's harvest to the next one for agricultural commodity) ranging from September 2017 to August 2018. To generate the dataset, the publicly available Austrian crop type map based on farmer's declarations has been considered. To ensure the selection of reliable labeled units from the map (i.e., pure pixels correctly associated to their labels), an automatic procedure for the extraction of the training set based on a multitemporal deep learning model has been defined. TimeSen2Crop also includes a TS of Sentinel 2 images acquired in the following agronomic year (i.e., from September 2018 to August 2019). These data are provided with the aim of attract more research activities for solving a typical challenge of the crop type mapping task: adapting multitemporal deep learning models to different year (domain adaptation). The design of the dataset is described along with a benchmark comparison of deep learning models for crop type mapping.

[1]  Lorenzo Bruzzone,et al.  A Novel Approach to the Unsupervised Extraction of Reliable Training Samples From Thematic Products , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[2]  S. Migdall,et al.  Food Security TEP - Supporting sustainable intensification of food production from Space , 2020, IOP Conference Series: Earth and Environmental Science.

[3]  Marc Rußwurm,et al.  Self-Attention for Raw Optical Satellite Time Series Classification , 2019, ArXiv.

[4]  Jan Dirk Wegner,et al.  Gating Revisited: Deep Multi-Layer RNNs That can be Trained , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Geoffrey I. Webb,et al.  InceptionTime: Finding AlexNet for time series classification , 2019, Data Mining and Knowledge Discovery.

[6]  Xiao Xiang Zhu,et al.  SEN12MS - A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusion , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[7]  Marc Russwurm,et al.  BREIZHCROPS: A TIME SERIES DATASET FOR CROP TYPE MAPPING , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[8]  Marc Rußwurm,et al.  BreizhCrops: A Satellite Time Series Dataset for Crop Type Identification , 2019, ArXiv.

[9]  Xin Huang,et al.  Deep neural network for remote-sensing image interpretation: status and perspectives , 2019, National science review.

[10]  Begüm Demir,et al.  Bigearthnet: A Large-Scale Benchmark Archive for Remote Sensing Image Understanding , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Geoffrey I. Webb,et al.  Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series , 2018, Remote. Sens..

[12]  Alexandre Boulch,et al.  Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[13]  Jing Huang,et al.  DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[15]  Andreas Dengel,et al.  EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Marco Körner,et al.  Temporal Vegetation Modelling Using Long Short-Term Memory Networks for Crop Identification from Medium-Resolution Multi-spectral Satellite Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[18]  Yady Tatiana Solano Correa,et al.  Spatio-temporal evolution of crop fields in Sentinel-2 Satellite Image Time Series , 2017, 2017 9th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp).

[19]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[20]  Francesca Bovolo,et al.  Detection of Land-Cover Transitions in Multitemporal Remote Sensing Images With Active-Learning-Based Compound Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[21]  T. Wrbka,et al.  How farming styles influence biodiversity maintenance in Austrian agricultural landscapes , 2005 .

[22]  W. Verhoef,et al.  Simulation of hyperspectral and directional radiance images using coupled biophysical and atmospheric radiative transfer models , 2003 .

[23]  Lorenzo Bruzzone,et al.  A multiple-cascade-classifier system for a robust and partially unsupervised updating of land-cover maps , 2002, IEEE Trans. Geosci. Remote. Sens..

[24]  Lorenzo Bruzzone,et al.  A partially unsupervised cascade classifier for the analysis of multitemporal remote-sensing images , 2002, Pattern Recognit. Lett..

[25]  Gail P. Anderson,et al.  MODTRAN4 radiative transfer modeling for atmospheric correction , 1999, Optics & Photonics.

[26]  Lorenzo Bruzzone,et al.  Classification of imbalanced remote-sensing data by neural networks , 1997, Pattern Recognit. Lett..

[27]  Katarzyna Kocur-Bera.  Data compatibility between the Land and Building Cadaster (LBC) and the Land Parcel Identification System (LPIS) in the context of area-based payments: A case study in the Polish Region of Warmia and Mazury , 2019, Land Use Policy.

[28]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .