Evaluation of advanced time series similarity measures for object-based cropland mapping

ABSTRACT With more and more high-resolution remote-sensing data becoming available, satellite image time series (SITS) analysis is often used to map crops at the pixel level. Although the object-based image analysis paradigm has proven superior to pixel-based image analysis for overcoming salt-and-pepper effects, object-based time series crop classification is still rare. Except for time-weighted dynamic time warping (TWDTW), other time series similarity measuring algorithms popular in the signal processing domain, such as shape-based distance (SBD) and global alignment kernel (GAK), remain poorly explored at the object level. Accordingly, this study aimed to explore better object-based time series classification frameworks by investigating similarity measures, including SBD, GAK and TWDTW, and thus experiments were designed to analyse the response of these methods to various parameters, including crop types, time series density, processing efficiency and so on. The results show that GAK is superior to SBD and TWDTW in general. Specifically, GAK performs better than TWDTW with the limited available images, e.g. in cloudy and rainy climate regions. Also, GAK outperforms SBD in identifying crops with a complex phenological pattern, such as alfalfa. Furthermore, TWDTW has the lowest processing efficiency. This study addresses the scarcity of similarity measurement methods in the object-based time series paradigm, and it is expected that this study could provide some guidance for the selection of cropland mapping methods.

[1]  Saishuai Zhao,et al.  Classification of salt marsh vegetation in the Yangtze River Delta of China using the pixel-level time-series and XGBoost algorithm , 2023, Journal of Remote Sensing.

[2]  Wei Han,et al.  A 30 m Resolution Distribution Map of Maize for China Based on Landsat and Sentinel Images , 2022, Journal of Remote Sensing.

[3]  J. Yang,et al.  The effects of Landsat image acquisition date on winter wheat classification in the North China Plain , 2022, ISPRS Journal of Photogrammetry and Remote Sensing.

[4]  I. Săvulescu,et al.  NDVI-based ecological dynamics of forest vegetation and its relationship to climate change in Romania during 1987–2018 , 2022, Ecological Indicators.

[5]  Lifu Zhang,et al.  Automatic Cotton Mapping Using Time Series of Sentinel-2 Images , 2021, Remote. Sens..

[6]  Xiaoxiang Zhu,et al.  Uncertainty Analysis of Object-Based Land-Cover Classification Using Sentinel-2 Time-Series Data , 2020, Remote. Sens..

[7]  Z. Niu,et al.  Early-season mapping of winter wheat in China based on Landsat and Sentinel images , 2020, Earth System Science Data.

[8]  P. Teodoro,et al.  Mapping LULC types in the Cerrado-Atlantic Forest ecotone region using a Landsat time series and object-based image approach: A case study of the Prata River Basin, Mato Grosso do Sul, Brazil , 2020, Environmental Monitoring and Assessment.

[9]  Meng Zhang,et al.  Mapping paddy rice by the object-based random forest method using time series Sentinel-1/Sentinel-2 data , 2019 .

[10]  Ning Jin,et al.  The Effect of NDVI Time Series Density Derived from Spatiotemporal Fusion of Multisource Remote Sensing Data on Crop Classification Accuracy , 2019, ISPRS Int. J. Geo Inf..

[11]  Patrick Hostert,et al.  Detailed agricultural land classification in the Brazilian cerrado based on phenological information from dense satellite image time series , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[12]  Tianxu Zhang,et al.  Temporal Attention Networks for Multitemporal Multisensor Crop Classification , 2019, IEEE Access.

[13]  Yunsong Li,et al.  Cloud Detection in High-Resolution Remote Sensing Images Using Multi-features of Ground Objects , 2019, Journal of Geovisualization and Spatial Analysis.

[14]  Dehai Zhu,et al.  Large-Scale Crop Mapping Based on Machine Learning and Parallel Computation with Grids , 2019, Remote. Sens..

[15]  Gregory Asner,et al.  Object-Based Time-Constrained Dynamic Time Warping Classification of Crops Using Sentinel-2 , 2019, Remote. Sens..

[16]  Luis Guanter,et al.  Estimating Crop Primary Productivity with Sentinel-2 and Landsat 8 using Machine Learning Methods Trained with Radiative Transfer Simulations , 2019, Remote Sensing of Environment.

[17]  P. Strobl,et al.  Benefits of the free and open Landsat data policy , 2019, Remote Sensing of Environment.

[18]  A. Frick,et al.  A Framework for the Long-term Monitoring of Urban Green Volume Based on Multi-temporal and Multi-sensoral Remote Sensing Data , 2019, Journal of Geovisualization and Spatial Analysis.

[19]  Gérard Dedieu,et al.  Near real-time agriculture monitoring at national scale at parcel resolution: Performance assessment of the Sen2-Agri automated system in various cropping systems around the world , 2019, Remote Sensing of Environment.

[20]  Edzer Pebesma,et al.  dtwSat: Time-Weighted Dynamic Time Warping for Satellite Image Time Series Analysis in R , 2019, Journal of Statistical Software.

[21]  Geoffrey I. Webb,et al.  Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series , 2018, Remote. Sens..

[22]  Damien Arvor,et al.  Big earth observation time series analysis for monitoring Brazilian agriculture , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[23]  Clement Atzberger,et al.  How much does multi-temporal Sentinel-2 data improve crop type classification? , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[24]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[25]  Luciano Vieira Dutra,et al.  Mapping croplands, cropping patterns, and crop types using MODIS time-series data , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[26]  Lin Wang,et al.  A Regional Mapping Method for Oilseed Rape Based on HSV Transformation and Spectral Features , 2018, ISPRS Int. J. Geo Inf..

[27]  Zheng Niu,et al.  The effect of EVI time series density on crop classification accuracy , 2018 .

[28]  Timothy A. Warner,et al.  Implementation of machine-learning classification in remote sensing: an applied review , 2018 .

[29]  Russell G. Congalton,et al.  MODIS phenology-derived, multi-year distribution of conterminous U.S. crop types , 2017 .

[30]  Peijun Du,et al.  A review of supervised object-based land-cover image classification , 2017 .

[31]  Eamonn J. Keogh,et al.  The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances , 2016, Data Mining and Knowledge Discovery.

[32]  Enrico Cadau,et al.  SENTINEL-2 SEN2COR: L2A Processor for Users , 2016 .

[33]  Joanne C. White,et al.  Optical remotely sensed time series data for land cover classification: A review , 2016 .

[34]  Rui Sun,et al.  Mapping Irrigated and Rainfed Wheat Areas Using Multi-Temporal Satellite Data , 2016, Remote. Sens..

[35]  Gilberto Câmara,et al.  A Time-Weighted Dynamic Time Warping Method for Land-Use and Land-Cover Mapping , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Jianxi Huang,et al.  Assimilating a synthetic Kalman filter leaf area index series into the WOFOST model to improve regional winter wheat yield estimation , 2016 .

[37]  Xudong Guan,et al.  Mapping Rice Cropping Systems in Vietnam Using an NDVI-Based Time-Series Similarity Measurement Based on DTW Distance , 2016, Remote. Sens..

[38]  Luis Gravano,et al.  k-Shape: Efficient and Accurate Clustering of Time Series , 2015, SIGMOD Conference.

[39]  Steffen Fritz,et al.  Improved global cropland data as an essential ingredient for food security , 2015 .

[40]  François Petitjean,et al.  Satellite Image Time Series Analysis Under Time Warping , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Stefan W. Maier,et al.  Area-based and location-based validation of classified image objects , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[42]  O. Csillik,et al.  Automated parameterisation for multi-scale image segmentation on multiple layers , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[43]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[44]  Christopher Conrad,et al.  Impact of feature selection on the accuracy and spatial uncertainty of per-field crop classification using Support Vector Machines , 2013 .

[45]  Jude H. Kastens,et al.  Classifying multiyear agricultural land use data from Mato Grosso using time-series MODIS vegetation index data , 2013 .

[46]  Yun Zhang,et al.  A Supervised and Fuzzy-based Approach to Determine Optimal Multi-resolution Image Segmentation Parameters , 2012 .

[47]  Michael A. Wulder,et al.  Opening the archive: How free data has enabled the science and monitoring promise of Landsat , 2012 .

[48]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .

[49]  Bo Wang,et al.  Discrepancy measures for selecting optimal combination of parameter values in object-based image analysis , 2012 .

[50]  W. Verstraeten,et al.  A comparison of time series similarity measures for classification and change detection of ecosystem dynamics , 2011 .

[51]  Christopher Conrad,et al.  Temporal segmentation of MODIS time series for improving crop classification in Central Asian irrigation systems , 2011 .

[52]  Marco Cuturi,et al.  Fast Global Alignment Kernels , 2011, ICML.

[53]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[54]  Zhengwei Yang,et al.  Monitoring US agriculture: the US Department of Agriculture, National Agricultural Statistics Service, Cropland Data Layer Program , 2011 .

[55]  E. Lambin,et al.  Global land use change, economic globalization, and the looming land scarcity , 2011, Proceedings of the National Academy of Sciences.

[56]  B. Wardlow,et al.  Analysis of time-series MODIS 250 m vegetation index data for crop classification in the U.S. Central Great Plains , 2007 .

[57]  J. Demšar Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[58]  Changsheng Li,et al.  Mapping paddy rice agriculture in southern China using multi-temporal MODIS images , 2005 .

[59]  Changsheng Li,et al.  Combining remote sensing and ground census data to develop new maps of the distribution of rice agriculture in China , 2002 .

[60]  A. Huete,et al.  Overview of the radiometric and biophysical performance of the MODIS vegetation indices , 2002 .

[61]  Jiyuan Liu,et al.  Characterization of forest types in Northeastern China, using multi-temporal SPOT-4 VEGETATION sensor data , 2002 .

[62]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[63]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[64]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[65]  Jianqiang Ren,et al.  Comparison of Regional Winter Wheat Mapping Results from Different Similarity Measurement Indicators of NDVI Time Series and Their Optimized Thresholds , 2021, Remote. Sens..

[66]  C. Milesi,et al.  Global cropland-extent product at 30-m resolution (GCEP30) derived from Landsat satellite time-series data for the year 2015 using multiple machine-learning algorithms on Google Earth Engine cloud , 2021, Professional Paper.

[67]  M. Weiss,et al.  Remote sensing for agricultural applications: A meta-review , 2020 .

[68]  Mariana Belgiu,et al.  Sentinel-2 cropland mapping using pixel-based and object-based time-weighted dynamic time warping analysis , 2018 .

[69]  Martha C. Anderson,et al.  Toward mapping crop progress at field scales through fusion of Landsat and MODIS imagery , 2017 .

[70]  Chongcheng Chen,et al.  Winter wheat mapping combining variations before and after estimated heading dates , 2017 .

[71]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Alexis Sarda-Espinosa,et al.  Comparing Time-Series Clustering Algorithms in R Using the dtwclust Package , 2017 .

[73]  Luis Gravano,et al.  k-Shape: Efficient and Accurate Clustering of Time Series , 2016, SGMD.

[74]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[75]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .