Automating field boundary delineation with multi-temporal Sentinel-2 imagery

Abstract Knowledge of the extent and location of cultivated fields are critical for agricultural monitoring, food security planning and commodity trading. The increased observational capacity of remotely sensed data, such as Sentinel-2 imagery, constitutes a major advantage over in situ methods, particularly for agricultural applications that require frequent updates. However, the development of fully automated cultivated field delineation methods remains a challenge. In this study an existing object-based image analysis (OBIA) methodology, called Canny edge-detection in conjunction with watershed segmentation (CEWS), was modified to automatically identify and delineate agricultural fields from multi-temporal Sentinel-2 imagery in five diverse agricultural landscapes. The robustness of the technique was evaluated by comparing its outputs to those of standard per-pixel, supervised classifications. Reference field boundaries were manually digitised and used for quantitative accuracy assessments. Area and edge metrics were used to evaluate the accuracy of the extracted boundaries. Results show that, on average, CEWS produced significantly higher field boundary accuracies than the supervised per-pixel approach in terms of both mean absolute error (MAE) (~31 m lower) and overall accuracy (~13.8% higher). The closed field boundaries produced by CEWS, as well as its capability to operate without any a priori knowledge, was found to be its main strengths for integration into operational workflows. However, in complex landscapes (e.g. Swartland and Mooketsi) it was found that some fields had weak boundaries due to the homogeneity between adjacent fields, making edge detection problematic. The incorporation of higher resolution imagery into the edge detection process is proposed, particularly in agricultural areas with very small and irregularly shaped fields. Despite these challenges, it was concluded that the multi-temporal CEWS approach will perform well in most agricultural areas and is suitable for operational implementation.

[1]  Soe W. Myint,et al.  A support vector machine to identify irrigated crop types using time-series Landsat NDVI data , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[2]  Pierre Defourny,et al.  National-scale cropland mapping based on spectral-temporal features and outdated land cover information , 2017, PloS one.

[3]  Yang Yang,et al.  Remote Sensing of Irrigated Agriculture: Opportunities and Challenges , 2010, Remote. Sens..

[4]  Gérard Dedieu,et al.  Assessment of an Operational System for Crop Type Map Production Using High Temporal and Spatial Resolution Satellite Optical Imagery , 2015, Remote. Sens..

[5]  R. Lucas,et al.  Rule-based classification of multi-temporal satellite imagery for habitat and agricultural land cover mapping , 2007 .

[6]  J. Strobl,et al.  Object-Oriented Image Processing in an Integrated GIS/Remote Sensing Environment and Perspectives for Environmental Applications , 2000 .

[7]  Jianping Fan,et al.  Automatic image segmentation by integrating color-edge extraction and seeded region growing , 2001, IEEE Trans. Image Process..

[8]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[9]  Gérard Dedieu,et al.  Building a Data Set over 12 Globally Distributed Sites to Support the Development of Agriculture Monitoring Applications with Sentinel-2 , 2015, Remote. Sens..

[10]  Christopher Conrad,et al.  Multiscale Remote Sensing to Map the Spatial Distribution and Extent of Cropland in the Sudanian Savanna of West Africa , 2017, Remote. Sens..

[11]  A. Huete.  A soil-adjusted vegetation index (SAVI) , 1988 .

[12]  D. Roy,et al.  Conterminous United States crop field size quantification from multi-temporal Landsat data , 2015 .

[13]  J. Tollefson.  Seven billion and counting , 2011, Nature.

[14]  Christopher O. Justice,et al.  Estimating Global Cropland Extent with Multi-year MODIS Data , 2010, Remote. Sens..

[15]  Bo Chen,et al.  Image Segmentation Based on Constrained Spectral Variance Difference and Edge Penalty , 2015, Remote. Sens..

[16]  Stéphane Dupuy,et al.  A Combined Random Forest and OBIA Classification Scheme for Mapping Smallholder Agriculture at Different Nomenclature Levels Using Multisource Data (Simulated Sentinel-2 Time Series, VHRS and DEM) , 2017, Remote. Sens..

[17]  Marina Mueller,et al.  Edge- and region-based segmentation technique for the extraction of large, man-made objects in high-resolution satellite imagery , 2004, Pattern Recognit..

[18]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[19]  Pedro Antonio Gutiérrez,et al.  Object-Based Image Classification of Summer Crops with Machine Learning Methods , 2014, Remote. Sens..

[20]  Rick Mueller,et al.  Mapping global cropland and field size , 2015, Global change biology.

[21]  Clement Atzberger,et al.  Self-Guided Segmentation and Classification of Multi-Temporal Landsat 8 Images for Crop Type Mapping in Southeastern Brazil , 2015, Remote. Sens..

[22]  Marie-Julie Lambert,et al.  Cropland Mapping over Sahelian and Sudanian Agrosystems: A Knowledge-Based Approach Using PROBA-V Time Series at 100-m , 2016, Remote. Sens..

[23]  Wenzhong Shi,et al.  Quality assessment for geo‐spatial objects derived from remotely sensed data , 2005 .

[24]  Xianhong Xie,et al.  Land cover classification of finer resolution remote sensing data integrating temporal features from time series coarser resolution data , 2014 .

[25]  Uwe Weidner,et al.  Contribution to the Assessment of Segmentation Quality for Remote Sensing Applications , 2008 .

[26]  Clement Atzberger,et al.  Single- and Multi-Date Crop Identification Using PROBA-V 100 and 300 m S1 Products on Zlatia Test Site, Bulgaria , 2015, Remote. Sens..

[27]  Clement Atzberger,et al.  First Experience with Sentinel-2 Data for Crop and Tree Species Classifications in Central Europe , 2016, Remote. Sens..

[28]  Mustafa Türker,et al.  Field-based sub-boundary extraction from remote sensing imagery using perceptual grouping , 2013 .

[29]  Prasad S. Thenkabail,et al.  An Automated Cropland Classification Algorithm (ACCA) for Tajikistan by Combining Landsat, MODIS, and Secondary Data , 2012, Remote. Sens..

[30]  Richard Geoffrey White,et al.  Comparing the performance of SAR image segmentation algorithms , 1992 .

[31]  Pierre Defourny,et al.  A conceptual framework to define the spatial resolution requirements for agricultural monitoring using remote sensing , 2010 .

[32]  Mariana Belgiu,et al.  Sentinel-2 cropland mapping using pixel-based and object-based time-weighted dynamic time warping analysis , 2018 .

[33]  P. Gong,et al.  Accuracy Assessment Measures for Object-based Image Segmentation Goodness , 2010 .

[34]  Yang Shao,et al.  Monitoring agricultural cropping patterns across the Laurentian Great Lakes Basin using MODIS-NDVI data , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[35]  Clement Atzberger,et al.  Advances in Remote Sensing of Agriculture: Context Description, Existing Operational Monitoring Systems and Major Information Needs , 2013, Remote. Sens..

[36]  Gérard Dedieu,et al.  Production of a Dynamic Cropland Mask by Processing Remote Sensing Image Series at High Temporal and Spatial Resolutions , 2016, Remote. Sens..

[37]  S. Weise,et al.  Effectiveness of agro-ecological intensification practices in managing pests in smallholder banana systems in East and Central Africa , 2013 .

[38]  David Morin,et al.  An Automated Method for Annual Cropland Mapping along the Season for Various Globally-Distributed Agrosystems Using High Spatial and Temporal Resolution Time Series , 2015, Remote. Sens..

[39]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[40]  Martin Volk,et al.  The comparison index: A tool for assessing the accuracy of image segmentation , 2007, Int. J. Appl. Earth Obs. Geoinformation.

[41]  B. Poornima,et al.  SEGMENTATION AND OBJECT RECOGNITION USING EDGE DETECTION TECHNIQUES , 2010 .

[42]  Yun Zhang,et al.  Region based segmentation of QuickBird multispectral imagery through band ratios and fuzzy comparison , 2009 .