Deep Learning for Plant Diseases: Detection and Saliency Map Visualisation

Recently, many researchers have been inspired by the success of deep learning in computer vision to improve the performance of detection systems for plant diseases. Unfortunately, most of these studies did not leverage recent deep architectures and were based essentially on AlexNet, GoogleNet or similar architectures. Moreover, the research did not take advantage of deep learning visualisation methods which qualifies these deep classifiers as black boxes as they are not transparent. In this chapter, we have tested multiple state-of-the-art Convolutional Neural Network (CNN) architectures using three learning strategies on a public dataset for plant diseases classification. These new architectures outperform the state-of-the-art results of plant diseases classification with an accuracy reaching 99.76%. Furthermore, we have proposed the use of saliency maps as a visualisation method to understand and interpret the CNN classification mechanism. This visualisation method increases the transparency of deep learning models and gives more insight into the symptoms of plant diseases.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  M. Lapidot,et al.  Major tomato viruses in the Mediterranean basin. , 2012, Advances in virus research.

[3]  Shoab Ahmad Khan,et al.  Automated Plant Disease Analysis (APDA): Performance Comparison of Machine Learning Techniques , 2013, 2013 11th International Conference on Frontiers of Information Technology.

[5]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[6]  Nassir Navab,et al.  AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[7]  Abdelouahab Moussaoui,et al.  Deep Learning for Tomato Diseases: Classification and Symptoms Visualization , 2017, Appl. Artif. Intell..

[8]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[9]  Mohamed F. Tolba,et al.  SVM-Based Detection of Tomato Leaves Diseases , 2014, IEEE Conf. on Intelligent Systems.

[10]  Hyun-Woo Lee,et al.  Deep neural networks for wild fire detection with unmanned aerial vehicle , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[11]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[12]  Michel C. Desmarais,et al.  Performance Comparison of Recent Imputation Methods for Classification Tasks over Binary Data , 2017, Appl. Artif. Intell..

[13]  J. Yosinski,et al.  Automated Identification of Northern Leaf Blight-Infected Maize Plants from Field Imagery Using Deep Learning. , 2017, Phytopathology.

[14]  Marcel Salathé,et al.  An open access repository of images on plant health to enable the development of mobile disease diagnostics through machine learning and crowdsourcing , 2015, ArXiv.

[15]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[16]  Takashi Shinozaki.  Semi-supervised Learning for Convolutional Neural Networks Using Mild Supervisory Signals , 2016, ICONIP.

[17]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  S. Koike,et al.  Vegetable Diseases: A Colour Handbook , 2006 .

[22]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[23]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[24]  Malik Braik,et al.  Fast and Accurate Detection and Classification of Plant Diseases , 2011 .

[25]  Hitoshi Iyatomi,et al.  Basic Study of Automated Diagnosis of Viral Plant Diseases Using Convolutional Neural Networks , 2015, ISVC.

[26]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Ricardo Matsumura de Araújo,et al.  Classification of Apple Tree Disorders Using Convolutional Neural Networks , 2016, 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI).

[28]  Darko Stefanovic,et al.  Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification , 2016, Comput. Intell. Neurosci..

[29]  George Papandreou,et al.  Weakly-and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  Sabeen Survery,et al.  Increased Permeability of the Aquaporin SoPIP2;1 by Mercury and Mutations in Loop A , 2016, Front. Plant Sci..

[31]  Lovekesh Vig,et al.  Crowdsourcing for Chromosome Segmentation and Deep Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Stephen Gould,et al.  Decomposing a scene into geometric and semantically consistent regions , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[33]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Dominique Blancard,et al.  Diagnosis of Parasitic and Nonparasitic Diseases , 2012 .

[35]  Fabio A. González,et al.  Training Deep Convolutional Neural Networks with Active Learning for Exudate Classification in Eye Fundus Images , 2017, CVII-STENT/LABELS@MICCAI.

[36]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[37]  Yogesh H. Dandawate,et al.  An automated approach for classification of plant diseases towards development of futuristic Decision Support System in Indian perspective , 2015, 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[38]  Ruimao Zhang,et al.  Cost-Effective Active Learning for Deep Image Classification , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Liborio Cavaleri,et al.  Prediction of the Fundamental Period of Infilled RC Frame Structures Using Artificial Neural Networks , 2015, Comput. Intell. Neurosci..

[40]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[41]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Hitoshi Iyatomi,et al.  Basic Investigation on a Robust and Practical Plant Diagnostic System , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).