A novel crop classification method based on ppfSVM classifier with time-series alignment kernel from dual-polarization SAR datasets

Abstract Rapid and accurate crop type mapping is of great significance for agricultural management and sustainable development. Time-series multi-polarization synthetic aperture radar (SAR) data is suitable for obtaining the large-scale distribution of crop types and continuously monitoring crops. At present, the classification method based on the time-series alignment of time-varying feature curves has been widely used, which can take the uncertainty of the phenological cycles of crops into account. The most classical method is the nearest neighbor (NN) classifier based on the dynamic time warping (DTW) alignment. While the DTW alignment does not consider the local shape of the curves and temporal ranges, and the NN classifier is inadequate in generalization, which restricts the accuracy of crop type mapping. In this paper, a pairwise proximity function support vector machine (ppfSVM) classification method with the time-weighted shapeDTW (TWshapeDTW) alignment is proposed. Firstly, the novel alignment method simultaneously considers the local shape of the curve and the temporal range of crops. Besides, the novel ppfSVM classifier with the time-series alignment kernel is established. Such kernel matrix considers dual-similarity metrics of multiple features, and it is positive semi-definite (PSD) in this classifier. With 42 Sentinel-1 dual-polarization SAR images located in Gansu Province, China, the crop classification maps in 2018 and 2019 are generated respectively. The proposed method in this paper obtains the overall accuracies of more than 90% in both two years, and the changes of crop types from 2018 to 2019 are also in line with the actual crop rotation. Compared with traditional classification methods (SVM and the NN method with the DTW alignment), it is found that the proposed method has higher overall accuracy (OA) and better robustness in the case of small number of samples. The OA's improvements of our method compared with the SVM method are 3% and 1% in 2018 and 2019, respectively. Such improvements are 14% and 12% respect to the NN method with the DTW alignment. This method can achieve more obvious improvement under the condition of less training samples and unaligned phenological sequences. Furthermore, the novel TWshapeDTW alignment is superior to the DTW and the time-weighted DTW alignment under the ppfSVM classifier. The OA's improvement introduced by the TWshapeDTW alignment respect to the DTW alignment can obtain 5% and 4% in 2018 and 2019, respectively.

[1]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[2]  Luis Alonso,et al.  A RADARSAT-2 Quad-Polarized Time Series for Monitoring Crop and Soil Conditions in Barrax, Spain , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Malcolm Davidson,et al.  Crop Classification Using Short-Revisit Multitemporal SAR Data , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  A. Fung,et al.  Microwave Remote Sensing Active and Passive-Volume III: From Theory to Applications , 1986 .

[5]  Juan M. Lopez-Sanchez,et al.  Crop Monitoring and Classification Using Polarimetric RADARSAT-2 Time-Series Data Across Growing Season: A Case Study in Southwestern Ontario, Canada , 2021, Remote. Sens..

[6]  D. Civco,et al.  Optimizing multi-resolution segmentation scale using empirical methods: Exploring the sensitivity of the supervised discrepancy measure Euclidean distance 2 (ED2) , 2014 .

[7]  Juan M. Lopez-Sanchez,et al.  Rice Phenology Monitoring by Means of SAR Polarimetry at X-Band , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Bruno Basso,et al.  Multi-temporal RADARSAT-2 polarimetric SAR for maize mapping supported by segmentations from high-resolution optical image , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[9]  Ron Kwok,et al.  Classification of multi-look polarimetric SAR imagery based on complex Wishart distribution , 1994 .

[10]  Hiroyoshi Yamada,et al.  Theoretical Characterization of X-Band Multiincidence Angle and Multipolarimetric SAR Data From Rice Paddies at Late Vegetative Stage , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Luo Liu,et al.  Mapping sugarcane plantation dynamics in Guangxi, China, by time series Sentinel-1, Sentinel-2 and Landsat images , 2020 .

[12]  U. Meier,et al.  Growth stages of mono- and dicotyledonous plants , 1997 .

[13]  T. K. Vintsyuk Speech discrimination by dynamic programming , 1968 .

[14]  Jinwei Dong,et al.  Examining earliest identifiable timing of crops using all available Sentinel 1/2 imagery and Google Earth Engine , 2020 .

[15]  Pascal Vincent,et al.  K-Local Hyperplane and Convex Distance Nearest Neighbor Algorithms , 2001, NIPS.

[16]  Peter M. Atkinson,et al.  Full year crop monitoring and separability assessment with fully-polarimetric L-band UAVSAR: A case study in the Sacramento Valley, California , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[17]  Laurent Itti,et al.  shapeDTW: Shape Dynamic Time Warping , 2016, Pattern Recognit..

[18]  Thomas Philip Runarsson,et al.  Support vector machines and dynamic time warping for time series , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[19]  Kari Pulli,et al.  Style translation for human motion , 2005, SIGGRAPH 2005.

[20]  J. Ndambuki,et al.  Accuracy Assessment of Land Use/Land Cover Classification Using Remote Sensing and GIS , 2017 .

[21]  Raja Jayaraman,et al.  Support vector-based algorithms with weighted dynamic time warping kernel function for time series classification , 2015, Knowl. Based Syst..

[22]  Jinsong Chen,et al.  Application of multi-temporal ENVISAT ASAR data to agricultural area mapping in the Pearl River Delta , 2010 .

[23]  Suresh Venkatasubramanian,et al.  Curve Matching, Time Warping, and Light Fields: New Algorithms for Computing Similarity between Curves , 2007, Journal of Mathematical Imaging and Vision.

[24]  Heather McNairn,et al.  The Contribution of ALOS PALSAR Multipolarization and Polarimetric Data to Crop Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Hiroshi Tani,et al.  Discrimination of crop types with TerraSAR-X-derived information , 2015 .

[26]  Johann-Christoph Freytag,et al.  Dynamic Time Warping and the (Windowed) Dog-Keeper Distance , 2017, SISAP.

[27]  Raul Queiroz Feitosa,et al.  Hidden Markov Models for crop recognition in remote sensing image sequences , 2011, Pattern Recognit. Lett..

[28]  Henning Skriver,et al.  Crop Classification by Multitemporal C- and L-Band Single- and Dual-Polarization and Fully Polarimetric SAR , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jiali Shang,et al.  Application of polarization signature to land cover scattering mechanism analysis and classification using multi-temporal C-band polarimetric RADARSAT-2 imagery. , 2017 .

[30]  Pekka Matilainen,et al.  Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle , 2018, Behavioural Processes.

[31]  Sylvie Gibet,et al.  On Recursive Edit Distance Kernels With Application to Time Series Classification , 2010, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Björn Waske,et al.  Classifier ensembles for land cover mapping using multitemporal SAR imagery , 2009 .

[33]  Francescopaolo Sica,et al.  Repeat-pass SAR interferometry for land cover classification: A methodology using Sentinel-1 Short-Time-Series , 2019, Remote Sensing of Environment.

[34]  Bing-Yu Sun,et al.  A Study on the Dynamic Time Warping in Kernel Machines , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[35]  Mariana Belgiu,et al.  Sentinel-2 cropland mapping using pixel-based and object-based time-weighted dynamic time warping analysis , 2018 .

[36]  Stefano Berretti,et al.  A Novel Geometric Framework on Gram Matrix Trajectories for Human Behavior Understanding , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Thomas L. Ainsworth,et al.  Polarimetric Analysis of Dual Polarimetric SAR Imagery , 2008 .

[38]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[39]  S. Erasmi,et al.  Sentinel-1 time series data for monitoring the phenology of winter wheat , 2020 .

[40]  Fabio Del Frate,et al.  Crop classification using multiconfiguration C-band SAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[41]  Avik Bhattacharya,et al.  A Novel Phenology Based Feature Subset Selection Technique Using Random Forest for Multitemporal PolSAR Crop Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Gilberto Câmara,et al.  A Time-Weighted Dynamic Time Warping Method for Land-Use and Land-Cover Mapping , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  J. Kovacs,et al.  Object-oriented crop mapping and monitoring using multi-temporal polarimetric RADARSAT-2 data , 2014 .

[44]  Isabella Pfeil,et al.  Sentinel-1 Cross Ratio and Vegetation Optical Depth: A Comparison over Europe , 2020, Remote. Sens..

[45]  D. Bargiel,et al.  A new method for crop classification combining time series of radar images and crop phenology information. , 2017 .

[46]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[47]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[48]  Yifang Ban,et al.  Multitemporal ERS-1 SAR data for crop classification : A sequential-masking approach , 1999 .

[49]  Jianjun Zhu,et al.  A New Crop Classification Method Based on the Time-Varying Feature Curves of Time Series Dual-Polarization Sentinel-1 Data Sets , 2020, IEEE Geoscience and Remote Sensing Letters.

[50]  P. Siqueira,et al.  Use of time-series L-band UAVSAR data for the classification of agricultural fields in the San Joaquin Valley , 2017 .

[51]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[52]  Uwe Soergel,et al.  Higher Order Dynamic Conditional Random Fields Ensemble for Crop Type Classification in Radar Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Hiroyoshi Yamada,et al.  Sensitivity Analysis of Multifrequency MIMP SAR Data From Rice Paddies , 2019, IEEE Transactions on Geoscience and Remote Sensing.