DESTIN: A new method for delineating the boundaries of crop fields by fusing spatial and temporal information from WorldView and Planet satellite imagery

Abstract The digital boundaries of crop fields represent a prerequisite for designing parcel-based crop management platforms, implementing online site-specific agronomic practices and monitoring crop growth per field. Previous approaches on field boundary delineation were mostly developed with medium resolution imagery (e.g., Landsat) for the regions or countries with intensive agriculture and large-sized crop fields. However, suitable delineation methods are scarce for the regions in developing countries where the majority of arable land is cultivated by smallholder farmers and distributed in small and fragmented crop fields. This study proposed a comprehensive method, delineation by fusing spatial and temporal information (DESTIN), to derive the boundaries of crop fields from sub-meter WorldView-2/3 and 3-m Planet imagery. After extraction of spatial objects from very high resolution (VHR) WorldView imagery, this method performed recognition of crop field objects using high resolution (HR) Planet-derived temporal features specifically concerning soil preparation and harvesting stages for summer crops. The performance of DESTIN in crop field boundary delineation was evaluated with the reference polygons (0.4–1.0 ha in area on average) over four subset areas in eastern China’s Jiangsu province, and further compared with a benchmark objection extraction approach. The results demonstrated that the integration of WorldView and Planet imagery as demanded by DESTIN yielded accurate recognition of crop fields with the classification overall accuracy (OA) ranging from 94.98% to 98.84%, which was remarkably improved over the use of WorldView or Planet imagery alone with increases in OA from 12% to 17%. The majority of crop field boudaries were successfully delineated with both methods, but DESTIN produced cleaner polygons than the benchmark appraoch and closer matches of field boundaries to the reference. DESTIN also yielded better one-to-one matches between delineations and reference (77% as opposed to 54%) and fewer one-to-many matches (1% as opposed to 33%) as a reflection of being less prone to over-segmentation. The DESTIN method does not need subjective parameterization for image segmentation, and could be applicable to the areas with availability of bi-temporal VHR imagery over the soil preparation and harvesting stages and HR imagery over the peak growth stage of summer crops. It has great potential for delineating the crop field boundaries in smallholder farming systems with VHR imagery acquired from satellite, airborne or unmanned aerial vehicle platforms.

[1]  D. Pairman,et al.  Boundary Delineation of Agricultural Fields in Multitemporal Satellite Imagery , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Jessica L. McCarty,et al.  Smallholder crop area mapped with wall-to-wall WorldView sub-meter panchromatic image texture: A test case for Tigray, Ethiopia , 2018, Remote Sensing of Environment.

[3]  Roland Geerken,et al.  An algorithm to classify and monitor seasonal variations in vegetation phenologies and their inter-annual change , 2009 .

[4]  J. Six,et al.  Object-based crop identification using multiple vegetation indices, textural features and crop phenology , 2011 .

[5]  Nektarios Chrysoulakis,et al.  Landsat 8 vs. Landsat 5: A comparison based on urban and peri-urban land cover mapping , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[6]  Xuan Zhu,et al.  Sowing date detection at the field scale using CubeSats remote sensing , 2019, Comput. Electron. Agric..

[7]  Ning Jin,et al.  The Effect of NDVI Time Series Density Derived from Spatiotemporal Fusion of Multisource Remote Sensing Data on Crop Classification Accuracy , 2019, ISPRS Int. J. Geo Inf..

[8]  Wei Zhang,et al.  An Enhanced Spatial and Temporal Data Fusion Model for Fusing Landsat and MODIS Surface Reflectance to Generate High Temporal Landsat-Like Data , 2013, Remote. Sens..

[9]  Xueliang Zhang,et al.  Segmentation quality evaluation using region-based precision and recall measures for remote sensing images , 2015 .

[10]  P. Raju,et al.  Use of high‐resolution satellite data for the structural and agricultural inventory of tank irrigation systems , 2009 .

[11]  Chunhua Zhang,et al.  The application of small unmanned aerial systems for precision agriculture: a review , 2012, Precision Agriculture.

[12]  François Waldner,et al.  Automated annual cropland mapping using knowledge-based temporal features , 2015 .

[13]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[14]  Changsheng Li,et al.  Mapping paddy rice agriculture in southern China using multi-temporal MODIS images , 2005 .

[15]  Christian Esposito,et al.  Advanced services for efficient management of smart farms , 2018, J. Parallel Distributed Comput..

[16]  Xiaolin Zhu,et al.  An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions , 2010 .

[17]  Steffen Fritz,et al.  Estimating the global distribution of field size using crowdsourcing , 2018, Global change biology.

[18]  Jinwei Dong,et al.  Mapping paddy rice planting area in cold temperate climate region through analysis of time series Landsat 8 (OLI), Landsat 7 (ETM+) and MODIS imagery. , 2015, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[19]  Christopher Conrad,et al.  Per-Field Irrigated Crop Classification in Arid Central Asia Using SPOT and ASTER Data , 2010, Remote. Sens..

[20]  Yun Shi,et al.  eFarm: A Tool for Better Observing Agricultural Land Systems , 2017, Sensors.

[21]  Gregory S. Biging,et al.  Automated mapping of soybean and corn using phenology , 2016 .

[22]  Lin Yan,et al.  Automated crop field extraction from multi-temporal Web Enabled Landsat Data , 2014 .

[23]  Christian Heipke,et al.  Semi-automatic verification of cropland and grassland using very high resolution mono-temporal satellite images , 2014 .

[24]  Gunilla Borgefors,et al.  Integrated method for boundary delineation of agricultural fields in multispectral satellite images , 2000, IEEE Trans. Geosci. Remote. Sens..

[25]  Peijun Li,et al.  A Multilevel Hierarchical Image Segmentation Method for Urban Impervious Surface Mapping Using Very High Resolution Imagery , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Brian G. Wolff,et al.  Forecasting Agriculturally Driven Global Environmental Change , 2001, Science.

[27]  Rick Mueller,et al.  Mapping global cropland and field size , 2015, Global change biology.

[28]  Brian McConkey,et al.  Agriculture field characterization using aerial photograph and satellite imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[29]  Adriaan Van Niekerk,et al.  A comparison of object-based image analysis approaches for field boundary delineation using multi-temporal Sentinel-2 imagery , 2019, Comput. Electron. Agric..

[30]  Jun Wang,et al.  Road network extraction: a neural-dynamic framework based on deep learning and a finite state machine , 2015 .

[31]  J. L. Moigne,et al.  Refining image segmentation by integration of edge and region data , 1992, IEEE Trans. Geosci. Remote. Sens..

[32]  M. Jeuffroy,et al.  Diagnosis tool for plant and crop N status in vegetative stage Theory and practices for crop N management , 2008 .

[33]  Xianhong Xie,et al.  Land cover classification of finer resolution remote sensing data integrating temporal features from time series coarser resolution data , 2014 .

[34]  Maria Luisa Paracchini,et al.  A new view on EU agricultural landscapes: Quantifying patchiness to assess farmland heterogeneity , 2016 .

[35]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..

[36]  C. Ji Delineating agricultural field boundaries from TM imagery using dyadic wavelet transforms , 1996 .

[37]  P. Gong,et al.  Efficient corn and soybean mapping with temporal extendability: A multi-year experiment using Landsat imagery , 2014 .

[38]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[39]  Shawn C. Kefauver,et al.  Remote Sensing for Precision Agriculture: Sentinel-2 Improved Features and Applications , 2020, Agronomy.

[40]  Mustafa Türker,et al.  Field-based sub-boundary extraction from remote sensing imagery using perceptual grouping , 2013 .

[41]  Wei Wu,et al.  Geo-Parcel Based Crop Identification by Integrating High Spatial-Temporal Resolution Imagery from Multi-Source Satellite Data , 2017, Remote. Sens..

[42]  Jian Yang,et al.  A discrepancy measure for segmentation evaluation from the perspective of object recognition , 2015 .

[43]  Bo Chen,et al.  Image Segmentation Based on Constrained Spectral Variance Difference and Edge Penalty , 2015, Remote. Sens..

[44]  Marina Mueller,et al.  Edge- and region-based segmentation technique for the extraction of large, man-made objects in high-resolution satellite imagery , 2004, Pattern Recognit..

[45]  C. A. Rishikeshan,et al.  An automated mathematical morphology driven algorithm for water body extraction from remotely sensed images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[46]  R. Congalton,et al.  Automated cropland mapping of continental Africa using Google Earth Engine cloud computing , 2017 .

[47]  Yasser Mostafa,et al.  A new shape descriptor for road network separation from parking lots and intersection detection on VHR remote sensing images , 2020, International Journal of Remote Sensing.

[48]  John Ray Bergado,et al.  Delineation of agricultural fields in smallholder farms from satellite images using fully convolutional networks and combinatorial grouping , 2019, Remote sensing of environment.

[49]  Jordan Graesser,et al.  Detection of cropland field parcels from Landsat imagery , 2017 .

[50]  Dongmei Chen,et al.  Segmentation for Object-Based Image Analysis (OBIA): A review of algorithms and challenges from remote sensing perspective , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[51]  Weixing Cao,et al.  Development of critical nitrogen dilution curve of Japonica rice in Yangtze River Reaches , 2013 .

[52]  Lester R. Brown,et al.  Who Will Feed China?: Wake-Up Call for a Small Planet , 1995 .

[53]  Krištof Oštir,et al.  Extraction of Visible Boundaries for Cadastral Mapping Based on UAV Imagery , 2019, Remote. Sens..

[54]  Roland Wilson,et al.  Multiresolution Image Segmentation Combining Region and Boundary Information , 1990 .

[55]  C. Chandrasekar,et al.  A Comparison of various Edge Detection Techniques used in Image Processing , 2012 .

[56]  Jinwei Dong,et al.  Mapping paddy rice planting area in northeastern Asia with Landsat 8 images, phenology-based algorithm and Google Earth Engine. , 2016, Remote sensing of environment.

[57]  Thomas J. Fuchs,et al.  A generalized computer vision approach to mapping crop fields in heterogeneous agricultural landscapes , 2016 .

[58]  John R. Miller,et al.  Quantitative characterization of the vegetation red edge reflectance 1. An inverted-Gaussian reflectance model , 1990 .

[59]  D. Roy,et al.  Conterminous United States crop field size quantification from multi-temporal Landsat data , 2015 .

[60]  Ying Wang,et al.  Generating Red-Edge Images at 3 M Spatial Resolution by Fusing Sentinel-2 and Planet Satellite Products , 2019, Remote. Sens..

[61]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[62]  Yun Zhang,et al.  Region based segmentation of QuickBird multispectral imagery through band ratios and fuzzy comparison , 2009 .

[63]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Matthew F. McCabe,et al.  High-Resolution NDVI from Planet's Constellation of Earth Observing Nano-Satellites: A New Data Source for Precision Agriculture , 2016, Remote. Sens..

[65]  L. Joshua Leon,et al.  Watershed-Based Segmentation and Region Merging , 2000, Comput. Vis. Image Underst..

[66]  Kadim Tasdemir,et al.  Automatic Detection and Segmentation of Orchards Using Very High Resolution Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.