Wheat Diseases Classification and Localization Using Convolutional Neural Networks and GradCAM Visualization

The world has been witnessing a population boom that has several implications including food security. Wheat is one of the world’s most important crops in terms of production and consumption, and demand for it is increasing. On the other hand, diseases can damage the abundance and the quality of the crop, so this needs to be revealed through advanced methods. In recent years, along with the various technological developments, using Convolutional Neural Networks (CNN) has proved to be showing great results in many image classification tasks. However, deep learning models are generally considered as black boxes and it is difficult to understand what the model has learned. The purpose of this article is to detect diseases from wheat images using CNNs and to use visualization methods to understand what these models have learned. For this reason, a wheat database has been collected by CRA-W (Walloon Agricultural Research Center), which contains 1163 images and is classified into two groups namely sick and healthy. Moreover, we propose to use the mask R-CNN for segmentation and extraction of wheat spikes from the background. Furthermore, a visualization and interpretation method, namely Gradient-weighted Class Activation Mapping (GradCAM), is used to locate the disease on the wheat spikes in a non-supervised way. GradCAM is actually used generally to highlight the most important regions from the CNN model’s viewpoint that are used to perform the classification.

[1]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Stephen Gould,et al.  Decomposing a scene into geometric and semantically consistent regions , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Abdelouahab Moussaoui,et al.  Deep Learning for Plant Diseases: Detection and Saliency Map Visualisation , 2018, Human and Machine Learning.

[6]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[7]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[8]  P. St-Charles,et al.  Convolutional Neural Networks for the Automatic Identification of Plant Diseases , 2019, Front. Plant Sci..

[9]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[13]  Darko Stefanovic,et al.  Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification , 2016, Comput. Intell. Neurosci..

[14]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[15]  Abdelouahab Moussaoui,et al.  Deep Learning for Tomato Diseases: Classification and Symptoms Visualization , 2017, Appl. Artif. Intell..

[16]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[18]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[21]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[22]  DEEP RESIDUAL LEARNING FOR TOMATO PLANT LEAF DISEASE IDENTIFICATION , 2017 .