Farm Parcel Delineation Using Spatio-temporal Convolutional Networks

Farm parcel delineation (delineation of boundaries of farmland parcels/segmentation of farmland areas) provides cadastral data that is important in developing and managing climate change policies. Specifically, farm parcel delineation informs applications in downstream governmental policies of land allocation, irrigation, fertilization, green-house gases (GHG's), etc. This data can also be useful for the agricultural insurance sector for assessing compensations following damages associated with extreme weather events - a growing trend related to climate change [4]. Using satellite imaging can be a scalable and cost-effective manner to perform the task of farm parcel delineation to collect this valuable data. In this paper, we break down this task using satellite imaging into two approaches: 1) Segmentation of parcel boundaries, and 2) Segmentation of parcel areas. We implemented variations of U-Nets, one of which takes into account temporal information, which achieved the best results on our dataset on farm parcels in France in 2017.

[1]  Anne Puissant,et al.  Towards a Multi-Temporal Deep Learning Approach for Mapping Urban Fabric Using Sentinel 2 Images , 2020, Remote. Sens..

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Matthew J. Hoffman,et al.  Aerial Vehicle Tracking by Adaptive Fusion of Hyperspectral Likelihood Maps , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[5]  Stefano Ermon,et al.  Efficient Object Detection in Large Images Using Deep Reinforcement Learning , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[6]  Konstantinos Karantzalos,et al.  A Novel Object-Based Deep Learning Framework for Semantic Segmentation of Very High-Resolution Remote Sensing Data: Comparison with Convolutional and Fully Convolutional Networks , 2019, Remote. Sens..

[7]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[8]  P. van der Molen.  Property rights, land registration and cadastre in the European union , 2002 .

[9]  Keisuke Nemoto,et al.  Effective Use of Dilated Convolutions for Segmenting Small Object Instances in Remote Sensing Imagery , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Alexander Rakhlin,et al.  Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning , 2018, bioRxiv.

[12]  Stefano Ermon,et al.  Learning to Interpret Satellite Images in Global Scale Using Wikipedia , 2019, ArXiv.

[13]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[14]  Ming Wu,et al.  D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Consuelo Gonzalo-Martin,et al.  A machine learning approach for agricultural parcel delineation through agglomerative segmentation , 2017 .

[16]  Burak Uzkent,et al.  EnKCF: Ensemble of Kernelized Correlation Filters for High-Speed Object Tracking , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[17]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[18]  Consuelo Gonzalo-Martín,et al.  Deep Learning for Automatic Outlining Agricultural Parcels: Exploiting the Land Parcel Identification System , 2019, IEEE Access.

[19]  Michael Felsberg,et al.  The Visual Object Tracking VOT2017 Challenge Results , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[22]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[23]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Stefano Ermon,et al.  Cloud Removal from Satellite Images using Spatiotemporal Generator Networks , 2020 .

[25]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[28]  Stefano Ermon,et al.  Learning to Interpret Satellite Images Using Wikipedia , 2018, IJCAI.

[29]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[30]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Adriaan Van Niekerk,et al.  Pre-harvest classification of crop types using a Sentinel-2 time-series and machine learning , 2020, Comput. Electron. Agric..

[32]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[33]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Stefano Ermon,et al.  Predicting Economic Development using Geolocated Wikipedia Articles , 2019, KDD.

[35]  Eduard Ayguadé,et al.  On the Behavior of Convolutional Nets for Feature Extraction , 2017, J. Artif. Intell. Res..

[36]  Gideon Mutua Musyoka.  AUTOMATIC DELINEATION OF SMALL HOLDER AGRICULTURAL FIELD BOUNDARIES USING FULLY CONVOLUTIONAL NETWORKS , 2018 .