Evaluation of Sentinel-1 and Sentinel-2 Feature Sets for Delineating Agricultural Fields in Heterogeneous Landscapes

The Group on Earth Observations Global Agricultural Monitoring Initiative (GEOGLAM) considers agricultural fields as one of the essential variables that can be derived from satellite data. We evaluated the accuracy at which agricultural fields can be delineated from Sentinel-1 (S1) and Sentinel-2 (S2) images in different agricultural landscapes throughout the growing season. We used supervised segmentation based on the multiresolution segmentation (MRS) algorithm to first identify the optimal feature set from S1 and S2 images for field delineation. Based on this optimal feature set, we analyzed the segmentation accuracy of the fields delineated with increasing data availability between March and October of 2018. From the S1 feature sets, the combination of the two polarizations and two radar indices attained the best segmentation results. For S2, the best results were achieved using a combination of all bands (coastal aerosol, water vapor, and cirrus bands were excluded) and six spectral indices. Combining the radar and spectral indices further improved the results. Compared to the single-period dataset in March, using the dataset covering the whole season led to a significant increase in the segmentation accuracy. For very small fields (< 0.5 ha), the segmentation accuracy obtained was 27.02%, for small fields (0.5 – 1.5 ha), the accuracy was 57.65%, for medium fields (1.5 ha – 15 ha), the accuracy was 75.71%, and for large fields (>15 ha), the accuracy stood at 68.31%. As a use case, the segmentation result was used to aggregate and improve a pixel-based crop type map in Lower Saxony, Germany.

[1]  Clement Atzberger,et al.  Self-Guided Segmentation and Classification of Multi-Temporal Landsat 8 Images for Crop Type Mapping in Southeastern Brazil , 2015, Remote. Sens..

[2]  Prasanna H. Gowda,et al.  Using Thematic Mapper Data to Identify Contrasting Soil Plains and Tillage Practices , 1997 .

[3]  W. E. Larson,et al.  Coincident detection of crop water stress, nitrogen status and canopy density using ground-based multispectral data. , 2000 .

[4]  Andreas Uhl,et al.  Improvement of the Fmask algorithm for Sentinel-2 images: Separating clouds from bright surfaces based on parallax effects , 2018, Remote Sensing of Environment.

[5]  C. Ji.  Delineating agricultural field boundaries from TM imagery using dyadic wavelet transforms , 1996 .

[6]  Nicolas Baghdadi,et al.  A Novel Approach for Mapping Wheat Areas Using High Resolution Sentinel-2 Images , 2018, Sensors.

[7]  Weimin Huang,et al.  Object-Based Classification of Wetlands in Newfoundland and Labrador Using Multi-Temporal PolSAR Data , 2017 .

[8]  Un Desa.  Transforming our world : The 2030 Agenda for Sustainable Development , 2016 .

[9]  Wenfu Wu,et al.  Field-based rice classification in Wuhua county through integration of multi-temporal Sentinel-1A and Landsat-8 OLI data , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[10]  Christopher Conrad,et al.  Per-Field Irrigated Crop Classification in Arid Central Asia Using SPOT and ASTER Data , 2010, Remote. Sens..

[11]  J. Strobl,et al.  Object-Oriented Image Processing in an Integrated GIS/Remote Sensing Environment and Perspectives for Environmental Applications , 2000 .

[12]  François Waldner,et al.  Deep learning on edge: extracting field boundaries from satellite images with a convolutional neural network , 2019, ArXiv.

[13]  Lin Yan,et al.  Automated crop field extraction from multi-temporal Web Enabled Landsat Data , 2014 .

[14]  D. Pairman,et al.  Boundary Delineation of Agricultural Fields in Multitemporal Satellite Imagery , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Bruno Basso,et al.  Multi-temporal RADARSAT-2 polarimetric SAR for maize mapping supported by segmentations from high-resolution optical image , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[16]  Huanjun Liu,et al.  Using Time Series Sentinel-1 Images for Object-Oriented Crop Classification in Google Earth Engine , 2021, Remote. Sens..

[17]  P. Shanmugapriya,et al.  Applications of Remote Sensing in Agriculture - A Review , 2019, International Journal of Current Microbiology and Applied Sciences.

[18]  Dirk Hoffmeister,et al.  Analysis of Multitemporal and Multisensor Remote Sensing Data for Crop Rotation Mapping , 2012 .

[19]  Mariana Belgiu,et al.  Sentinel-2 cropland mapping using pixel-based and object-based time-weighted dynamic time warping analysis , 2018 .

[20]  Olena Dubovyk,et al.  Derivation of temporal windows for accurate crop discrimination in heterogeneous croplands of Uzbekistan using multitemporal RapidEye images , 2014 .

[21]  Zhe Zhu,et al.  Object-based cloud and cloud shadow detection in Landsat imagery , 2012 .

[22]  Jaco Kemp,et al.  Effect of pan-sharpening multi-temporal Landsat 8 imagery for crop type differentiation using different classification techniques , 2017, Comput. Electron. Agric..

[23]  Gérard Dedieu,et al.  Production of a Dynamic Cropland Mask by Processing Remote Sensing Image Series at High Temporal and Spatial Resolutions , 2016, Remote. Sens..

[24]  Krištof Oštir,et al.  Investigating the impact of spatial and spectral resolution of satellite images on segmentation quality , 2014 .

[25]  Kristof Van Tricht,et al.  Synergistic Use of Radar Sentinel-1 and Optical Sentinel-2 Imagery for Crop Mapping: A Case Study for Belgium , 2018, Remote. Sens..

[26]  B. Tan,et al.  Land-cover change in the Caucasus Mountains since 1987 based on the topographic correction of multi-temporal Landsat composites , 2020 .

[27]  Mark Berman,et al.  Segmenting multispectral Landsat TM images into field units , 2002, IEEE Trans. Geosci. Remote. Sens..

[28]  Patrick Hostert,et al.  Mapping Brazilian savanna vegetation gradients with Landsat time series , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[29]  Christopher O. Justice,et al.  No pixel left behind: Toward integrating Earth Observations for agriculture into the United Nations Sustainable Development Goals framework , 2019 .

[30]  Natascha Oppelt,et al.  Extracting Agricultural Fields from Remote Sensing Imagery Using Graph-Based Growing Contours , 2020, Remote. Sens..

[31]  Z. Çakır,et al.  Sensitivity Analysis of Multi-Temporal Sentinel-1 SAR Parameters to Crop Height and Canopy Coverage , 2019, Applied Sciences.

[32]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[33]  Gérard Dedieu,et al.  Multi-temporal remote sensing image segmentation of croplands constrained by a topographical database , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[34]  Stefan Erasmi,et al.  Unsupervised Parameterization for Optimal Segmentation of Agricultural Parcels from Satellite Images in Different Agricultural Landscapes , 2020, Remote. Sens..

[35]  B. Gao.  NDWI—A normalized difference water index for remote sensing of vegetation liquid water from space , 1996 .

[36]  J. Six,et al.  Object-based crop identification using multiple vegetation indices, textural features and crop phenology , 2011 .

[37]  C. Woodcock,et al.  Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images , 2015 .

[38]  Jiaguo Qi,et al.  RANGES improves satellite-based information and land cover assessments in southwest United States , 2002 .

[39]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[40]  David P. Roy,et al.  Adjustment of Sentinel-2 Multi-Spectral Instrument (MSI) Red-Edge Band Reflectance to Nadir BRDF Adjusted Reflectance (NBAR) and Quantification of Red-Edge Band BRDF Effects , 2017, Remote. Sens..

[41]  Abderrahim Nemmaoui,et al.  AssesSeg - A Command Line Tool to Quantify Image Segmentation Quality: A Test Carried Out in Southern Spain from Satellite Imagery , 2017, Remote. Sens..

[42]  D. Polsby,et al.  The Third Criterion: Compactness as a Procedural Safeguard Against Partisan Gerrymandering , 1991 .

[43]  Gregory Asner,et al.  Object-Based Time-Constrained Dynamic Time Warping Classification of Crops Using Sentinel-2 , 2019, Remote. Sens..

[44]  Marco Ottinger,et al.  Mapping rice areas with Sentinel-1 time series and superpixel segmentation , 2018 .

[45]  Joachim Hill,et al.  An Operational Radiometric Landsat Preprocessing Framework for Large-Area Time Series Applications , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[46]  M. Weiss,et al.  Remote sensing for agricultural applications: A meta-review , 2020 .

[47]  Xinyu Li,et al.  Mapping wetland using the object-based stacked generalization method based on multi-temporal optical and SAR data , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[48]  A. Gitelson,et al.  Novel algorithms for remote estimation of vegetation fraction , 2002 .

[49]  Adriaan Van Niekerk,et al.  A comparison of object-based image analysis approaches for field boundary delineation using multi-temporal Sentinel-2 imagery , 2019, Comput. Electron. Agric..

[50]  Christopher Conrad,et al.  Integration of Optical and Synthetic Aperture Radar Imagery for Improving Crop Mapping in Northwestern Benin, West Africa , 2014, Remote. Sens..

[51]  Lucy Marshall,et al.  Object-oriented crop classification using multitemporal ETM+ SLC-off imagery and random forest , 2013 .

[52]  Francisca López-Granados,et al.  Object- and pixel-based analysis for mapping crops and their agro-environmental associated measures using QuickBird imagery , 2009 .

[53]  Urs Wegmüller,et al.  C-band polarimetric indexes for maize monitoring based on a validated radiative transfer model , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Jordan Graesser,et al.  Detection of cropland field parcels from Landsat imagery , 2017 .

[55]  D. Roy,et al.  Conterminous United States crop field size quantification from multi-temporal Landsat data , 2015 .

[56]  Gideon Okpoti Tetteh,et al.  Optimal parameters for delineating agricultural parcels from satellite images based on supervised Bayesian optimization , 2020, Comput. Electron. Agric..

[57]  David Frantz,et al.  FORCE - Landsat + Sentinel-2 Analysis Ready Data and Beyond , 2019, Remote. Sens..

[58]  F. J. García-Haro,et al.  A Copernicus Sentinel-1 and Sentinel-2 Classification Framework for the 2020+ European Common Agricultural Policy: A Case Study in València (Spain) , 2019, Agronomy.

[59]  John Ray Bergado,et al.  Delineation of agricultural fields in smallholder farms from satellite images using fully convolutional networks and combinatorial grouping , 2019, Remote sensing of environment.

[60]  Adriaan Van Niekerk,et al.  Automating field boundary delineation with multi-temporal Sentinel-2 imagery , 2019, Comput. Electron. Agric..

[61]  Consuelo Gonzalo-Martín,et al.  Deep Learning for Automatic Outlining Agricultural Parcels: Exploiting the Land Parcel Identification System , 2019, IEEE Access.

[62]  Martin Volk,et al.  The comparison index: A tool for assessing the accuracy of image segmentation , 2007, Int. J. Appl. Earth Obs. Geoinformation.

[63]  Heike Bach,et al.  Assessments on the impact of high-resolution-sensor pixel sizes for common agricultural policy and smart farming services in European regions , 2020, Comput. Electron. Agric..

[64]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .

[65]  Gérard Dedieu,et al.  Near real-time agriculture monitoring at national scale at parcel resolution: Performance assessment of the Sen2-Agri automated system in various cropping systems around the world , 2019, Remote Sensing of Environment.

[66]  Huanjun Liu,et al.  Monthly composites from Sentinel-1 and Sentinel-2 images for regional major crop mapping with Google Earth Engine , 2021, Journal of Integrative Agriculture.

[67]  Clement Atzberger,et al.  Advances in Remote Sensing of Agriculture: Context Description, Existing Operational Monitoring Systems and Major Information Needs , 2013, Remote. Sens..

[68]  M. Mccabe,et al.  Center pivot field delineation and mapping: A satellite-driven object-based image analysis approach for national scale accounting , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.