Weed detection in canola fields using maximum likelihood classification and deep convolutional neural network

Abstract Herbicide use is rising globally to enhance food production, causing harm to environment and the ecosystem. Precision agriculture suggests variable-rate herbicide application based on weed densities to mitigate adverse effects of herbicides. Accurate weed density estimation using advanced computer vision techniques like deep learning requires large labelled agriculture data. Labelling large agriculture data at pixel level is a time-consuming and tedious job. In this paper, a methodology is developed to accelerate manual labelling of pixels using a two-step procedure. In the first step, the background and foreground are segmented using maximum likelihood classification, and in the second step, the weed pixels are manually labelled. Such labelled data is used to train semantic segmentation models, which classify crop and background pixels as one class, and all other vegetation as the second class. This paper evaluates the proposed methodology on high-resolution colour images of canola fields and makes performance comparison of deep learning meta-architectures like SegNet and UNET and encoder blocks like VGG16 and ResNet-50. ResNet-50 based SegNet model has shown the best results with mean intersection over union value of 0.8288 and frequency weighted intersection over union value of 0.9869.

[1]  Gonzalo Pajares,et al.  Crop rows and weeds detection in maize fields applying a computer vision system based on geometry , 2017, Comput. Electron. Agric..

[2]  Yu Liu,et al.  A review of semantic segmentation using deep neural networks , 2017, International Journal of Multimedia Information Retrieval.

[3]  Xuewen Wu,et al.  A Detection Method of Weed in Wheat Field on Machine Vision , 2011 .

[4]  Laura N. Vandenberg,et al.  Concerns over use of glyphosate-based herbicides and risks associated with exposures: a consensus statement , 2016, Environmental Health.

[5]  Angel Rodas-Jordá,et al.  Automatic corn (Zea mays) kernel inspection system using novelty detection based on principal component analysis , 2014 .

[6]  Alexander Wendel,et al.  Self-supervised weed detection in vegetable crops using ground based hyperspectral imaging , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Xavier Maldague,et al.  Bayesian classification and unsupervised learning for isolating weeds in row crops , 2014, Pattern Analysis and Applications.

[8]  R. Plant,et al.  Precision agriculture can increase profits and limit environmental impacts , 2000 .

[9]  C. Benbrook Trends in glyphosate herbicide use in the United States and globally , 2016, Environmental Sciences Europe.

[10]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[11]  Jörn Ostermann,et al.  Plant classification system for crop /weed discrimination without segmentation , 2014, IEEE Winter Conference on Applications of Computer Vision.

[12]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[13]  L. Plümer,et al.  Sequential support vector machine classification for small-grain weed species discrimination with special regard to Cirsium arvense and Galium aparine , 2012 .

[14]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Asmala Ahmad,et al.  Analysis of Maximum Likelihood Classificationon Multispectral Data , 2012 .

[16]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Daniele Nardi,et al.  Fast and Accurate Crop and Weed Identification with Summarized Train Sets for Precision Agriculture , 2016, IAS.

[19]  Hiroshi Okamoto,et al.  Plant classification for weed detection using hyperspectral imaging with wavelet analysis , 2007 .

[20]  Long Qi,et al.  Fully convolutional network for rice seedling and weed image segmentation at the seedling stage in paddy fields , 2019, PloS one.

[21]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[23]  J. Fernandez-Cornejo,et al.  Herbicide Use Trends: A Backgrounder , 2016 .

[24]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Patrizia Busato,et al.  Machine Learning in Agriculture: A Review , 2018, Sensors.

[27]  J. Hemming,et al.  PA—Precision Agriculture: Computer-Vision-based Weed Identification under Field Conditions using Controlled Lighting , 2001 .

[28]  Mostafa Rahimi Azghadi,et al.  DeepWeeds: A Multiclass Weed Species Image Dataset for Deep Learning , 2018, Scientific Reports.

[29]  Dimitrios Moshou,et al.  Active learning system for weed species recognition based on hyperspectral sensing , 2016 .

[30]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[31]  E. Oerke Crop losses to pests , 2005, The Journal of Agricultural Science.

[32]  David C. Slaughter,et al.  Autonomous robotic weed control systems: A review , 2008 .

[33]  Gonzalo Pajares,et al.  On-line crop/weed discrimination through the Mahalanobis distance from images in maize fields , 2018 .

[34]  Adel Hafiane,et al.  Deep Learning with Unsupervised Data Labeling for Weed Detection in Line Crops in UAV Images , 2018, Remote. Sens..