Unlocking large-scale crop field delineation in smallholder farming systems with transfer learning and weak supervision

Crop field boundaries aid in mapping crop types, predicting yields, and delivering field-scale analytics to farmers. Recent years have seen the successful application of deep learning to delineating field boundaries in industrial agricultural systems, but field boundary datasets remain missing in smallholder systems due to (1) small fields that require high resolution satellite imagery to delineate and (2) a lack of ground labels for model training and validation. In this work, we combine transfer learning and weak supervision to overcome these challenges, and we demonstrate the methods’ success in India where we efficiently generated 10,000 new field labels. Our best model uses 1.5m resolution Airbus SPOT imagery as input, pre-trains a state-of-the-art neural network on France field boundaries, and fine-tunes on India labels to achieve a median Intersection over Union (IoU) of 0.86 in India. If using 4.8m resolution PlanetScope imagery instead, the best model achieves a median IoU of 0.72. Experiments also show that pre-training in France reduces the number of India field labels needed to achieve a given performance level by as much as 20× when datasets are small. These findings suggest our method is a scalable approach for delineating crop fields in regions of the world that currently lack field boundary datasets. We publicly release the 10,000 labels and delineation model to facilitate the creation of field boundary maps and new methods by the community. Preprint submitted to journal January 14, 2022 ar X iv :2 20 1. 04 77 1v 1 [ cs .C V ] 1 3 Ja n 20 22

[1]  David B. Lobell,et al.  Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery , 2020, Remote. Sens..

[2]  A. Gamero,et al.  Bringing diversity back to agriculture: Smaller fields and non-crop elements enhance biodiversity in intensively managed arable farmlands , 2018, Ecological Indicators.

[3]  John Ray Bergado,et al.  Delineation of agricultural fields in smallholder farms from satellite images using fully convolutional networks and combinatorial grouping , 2019, Remote sensing of environment.

[4]  Lin Yan,et al.  Automated crop field extraction from multi-temporal Web Enabled Landsat Data , 2014 .

[5]  G. Fitzgerald,et al.  'I. , 2019, Australian journal of primary health.

[6]  Scott Mitchell,et al.  Farmlands with smaller crop fields have higher within-field biodiversity , 2015 .

[7]  M. Carter IDENTIFICATION OF THE INVERSE RELATIONSHIP BETWEEN FARM SIZE AND PRODUCTIVITY: AN EMPIRICAL ANALYSIS OF PEASANT AGRICULTURAL PRODUCTION , 1984 .

[8]  A. Schaafsma,et al.  Effect of previous crop, tillage, field size, adjacent crop, and sampling direction on airborne propagules of Gibberella zeae/Fusarium graminearum, fusarium head blight severity, and deoxynivalenol accumulation in winter wheat , 2005 .

[9]  Michael Melone Detect , 2021, Designing Secure Systems.

[10]  A. Kayad,et al.  Prediction of Potato Crop Yield Using Precision Agriculture Techniques , 2016, PloS one.

[11]  François Waldner,et al.  Deep learning on edge: extracting field boundaries from satellite images with a convolutional neural network , 2019, ArXiv.

[12]  Jinfei Wang,et al.  Delineation of Crop Field Areas and Boundaries from UAS Imagery Using PBIA and GEOBIA with Random Forest Classification , 2020, Remote. Sens..

[13]  P. Alam,et al.  R , 1823, The Herodotus Encyclopedia.

[14]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Aruna Singh,et al.  Farm Size and Productivity: Understanding the Strengths of Smallholders and Improving Their Livelihoods , 2011 .

[16]  Shaowen Wang,et al.  A high-performance and in-season classification system of field-level crop types using time-series Landsat data and a machine learning approach , 2018, Remote Sensing of Environment.

[17]  Adriaan Van Niekerk,et al.  A comparison of object-based image analysis approaches for field boundary delineation using multi-temporal Sentinel-2 imagery , 2019, Comput. Electron. Agric..

[18]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[19]  David B. Lobell,et al.  Crop type mapping without field-level labels: Random forest transfer and unsupervised clustering techniques , 2019, Remote Sensing of Environment.

[20]  R. G. V. Bramley,et al.  Farmer attitudes to the use of sensors and automation in fertilizer decision-making: nitrogen fertilization in the Australian grains sector , 2018, Precision Agriculture.

[21]  Peter Caccetta,et al.  Looking for change? Roll the Dice and demand Attention , 2021, Remote. Sens..

[22]  A. J. W. De Wit,et al.  Efficiency and accuracy of per-field classification for operational crop mapping , 2004 .

[23]  D. Lobell,et al.  A scalable satellite-based crop yield mapper , 2015 .

[24]  D. Chicco,et al.  The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation , 2020, BMC Genomics.

[25]  Chen Zhang,et al.  Crop Field Boundary Delineation using Historical Crop Rotation Pattern , 2019, 2019 8th International Conference on Agro-Geoinformatics (Agro-Geoinformatics).

[26]  Bruno Basso,et al.  Predicting spatial patterns of within-field crop yield variability , 2018 .

[27]  D. Roy,et al.  Conterminous United States crop field size quantification from multi-temporal Landsat data , 2015 .

[28]  Claudio Persello,et al.  Delineation of Agricultural Field Boundaries from Sentinel-2 Images Using a Novel Super-Resolution Contour Detector Based on Fully Convolutional Networks , 2019, Remote. Sens..

[29]  Gunilla Borgefors,et al.  Integrated method for boundary delineation of agricultural fields in multispectral satellite images , 2000, IEEE Trans. Geosci. Remote. Sens..

[30]  Xavier Blaes,et al.  Estimating smallholder crops production at village level from Sentinel-2 time series in Mali's cotton belt , 2018, Remote Sensing of Environment.

[31]  Rick Mueller,et al.  Mapping global cropland and field size , 2015, Global change biology.

[32]  Nicholas E. Rada,et al.  New perspectives on farm size and productivity , 2019, Food Policy.

[33]  I. Ciampitti,et al.  Satellite-based soybean yield forecast: Integrating machine learning and weather data for improving crop yield prediction in southern Brazil , 2020 .

[34]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[35]  D. Pairman,et al.  Boundary Delineation of Agricultural Fields in Multitemporal Satellite Imagery , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Thomas de Quincey [C] , 2000, The Works of Thomas De Quincey, Vol. 1: Writings, 1799–1820.

[37]  Peter Caccetta,et al.  ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[38]  Benjamin Perret,et al.  Playing with Kruskal: Algorithms for Morphological Trees in Edge-Weighted Graphs , 2013, ISMM.

[39]  Jiali Shang,et al.  Automated delineation of agricultural field boundaries from Sentinel-2 images using recurrent residual U-Net , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[40]  J. Rosenheim,et al.  Should increasing the field size of monocultural crops be expected to exacerbate pest damage , 2012 .

[41]  Stefano Ermon,et al.  Farm Parcel Delineation Using Spatio-temporal Convolutional Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[42]  François Waldner,et al.  Detect, Consolidate, Delineate: Scalable Mapping of Field Boundaries Using Satellite Images , 2021, Remote. Sens..

[43]  Yanghui Kang,et al.  Field-level crop yield mapping with Landsat using a hierarchical data assimilation approach , 2019, Remote Sensing of Environment.