New perspectives on plant disease characterization based on deep learning

The control of plant diseases is a major challenge to ensure global food security and sustainable agriculture. Several recent studies have proposed to improve existing procedures for early detection of plant diseases through modern automatic image recognition systems based on deep learning. In this article, we study these methods in detail, especially those based on convolutional neural networks. We first examine whether it is more relevant to fine-tune a pre-trained model on a plant identification task rather than a general object recognition task. In particular, we show, through visualization techniques, that the characteristics learned differ according to the approach adopted and that they do not necessarily focus on the part affected by the disease. Therefore, we introduce a more intuitive method that considers diseases independently of crops, and we show that it is more effective than the classic crop-disease pair approach, especially when dealing with disease involving crops that are not illustrated in the training database. This finding therefore encourages future research to rethink the current de facto paradigm of crop disease categorization.

[1]  Artzai Picón,et al.  Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case , 2017, Comput. Electron. Agric..

[2]  Zahid Iqbal,et al.  An automated detection and classification of citrus plant diseases using image processing techniques: A review , 2018, Comput. Electron. Agric..

[3]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[4]  Alexei A. Efros,et al.  Unbiased look at dataset bias , 2011, CVPR 2011.

[5]  Fumio Okura,et al.  How Convolutional Neural Networks Diagnose Plant Disease , 2019, Plant phenomics.

[6]  Dong Sun Park,et al.  High-Performance Deep Neural Network-Based Tomato Plant Diseases and Pests Diagnosis System With Refinement Filter Bank , 2018, Front. Plant Sci..

[7]  Alexei A. Efros,et al.  What makes ImageNet good for transfer learning? , 2016, ArXiv.

[8]  Murvet Kirci,et al.  Disease detection on the leaves of the tomato plants by using deep learning , 2017, 2017 6th International Conference on Agro-Geoinformatics.

[9]  Jayme Garcia Arnal Barbedo,et al.  A review on the main challenges in automatic plant disease identification based on visible range images , 2016 .

[10]  Marcel Salathé,et al.  An open access repository of images on plant health to enable the development of mobile disease diagnostics through machine learning and crowdsourcing , 2015, ArXiv.

[11]  Jayme Garcia Arnal Barbedo,et al.  Factors influencing the use of deep learning for plant disease recognition , 2018, Biosystems Engineering.

[12]  Guy Shani,et al.  Potato Disease Classification Using Convolution Neural Networks , 2017 .

[13]  Hod Lipson,et al.  Image set for deep learning: field images of maize annotated with disease symptoms , 2018, BMC Research Notes.

[14]  Hod Lipson,et al.  Understanding Neural Networks Through Deep Visualization , 2015, ArXiv.

[15]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[16]  Kaiming He,et al.  Rethinking ImageNet Pre-Training , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[19]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[20]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[21]  David Hughes,et al.  Deep Learning for Image-Based Cassava Disease Detection , 2017, Front. Plant Sci..

[22]  Thomas G. Dietterich.  Adaptive computation and machine learning , 1998 .

[23]  S. Prospero,et al.  Effects of Host Variability on the Spread of Invasive Forest Diseases , 2017 .

[24]  Darko Stefanovic,et al.  Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification , 2016, Comput. Intell. Neurosci..

[25]  Graham W. Taylor,et al.  Adaptive deconvolutional networks for mid and high level feature learning , 2011, 2011 International Conference on Computer Vision.

[26]  Yun Zhang,et al.  Identification of Apple Leaf Diseases Based on Deep Convolutional Neural Networks , 2017, Symmetry.

[27]  Artzai Picón,et al.  Deep convolutional neural networks for mobile capture device-based crop disease classification in the wild , 2019, Comput. Electron. Agric..

[28]  Jayme Garcia Arnal Barbedo,et al.  Annotated Plant Pathology Databases for Image-Based Detection and Recognition of Diseases , 2018, IEEE Latin America Transactions.

[29]  Li Yujian,et al.  A comparative study of fine-tuning deep learning models for plant disease identification , 2019, Comput. Electron. Agric..

[30]  Sang Cheol Kim,et al.  A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition , 2017, Sensors.

[31]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[32]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Jayme G. A. Barbedo,et al.  Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification , 2018, Comput. Electron. Agric..

[34]  Paolo Remagnino,et al.  How deep learning extracts and learns leaf features for plant classification , 2017, Pattern Recognit..

[35]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[36]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).