Identifying plant diseases using deep transfer learning and enhanced lightweight network

Plant diseases can cause significant reductions in both the quality and quantity of agricultural products, and they have a disastrous impact on the safety of food production. In severe cases, plant diseases may even lead to no grain harvest completely. Therefore, seeking fast, automatic, less expensive and accurate methods to detect plant diseases is of great realistic significance. In this paper, we studied the transfer learning for the deep CNNs and modified the network structure to enhance the learning ability of the tiny lesion symptoms. The pre-trained MobileNet-V2 was extended with the classification activation map (CAM), which was used for visualization as well as plant lesion positioning, and both were selected in our approach. Particularly, the transfer learning was performed twice in model training: the first phase only inferred the weights from scratch for new extended layers while the bottom convolution layers were frozen with the parameters trained from ImageNet; the second phase retrained the weights using the target dataset by loading the model trained in the first phase. Then, the yielded optimum model was used for identifying plant diseases. Experimental results demonstrate the validity of the proposed approach. It achieves an average recognition accuracy of 99.85% on the public dataset. Even under multiple classes and complex background conditions, the average accuracy reaches 99.11% on the collected plant disease images. Thus, the proposed approach efficiently accomplished plant disease identification and presented a superior performance relative to other state-of-the-art methods.

[1]  Jayme Garcia Arnal Barbedo,et al.  Factors influencing the use of deep learning for plant disease recognition , 2018, Biosystems Engineering.

[2]  Tariq Umer,et al.  Diagnosis and recognition of grape leaf diseases: An automated system based on a novel saliency approach and canonical correlation analysis based multiple features fusion , 2019, Sustain. Comput. Informatics Syst..

[3]  MOHD ADZHAR ABDUL KAHAR,et al.  Early Detection and Classification of Paddy Diseases with Neural Networks and Fuzzy Logic , 2015 .

[4]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[5]  Abdelouahab Moussaoui,et al.  Deep Learning for Tomato Diseases: Classification and Symptoms Visualization , 2017, Appl. Artif. Intell..

[6]  Khursheed Aurangzeb,et al.  Advanced Machine Learning Algorithm Based System for Crops Leaf Diseases Recognition , 2020, 2020 6th Conference on Data Science and Machine Learning Applications (CDMA).

[7]  J. Hemming,et al.  PA—Precision Agriculture: Computer-Vision-based Weed Identification under Field Conditions using Controlled Lighting , 2001 .

[8]  Mingyang Wu,et al.  Depthwise separable convolution architectures for plant disease classification , 2019, Comput. Electron. Agric..

[9]  Prabira Kumar Sethy,et al.  Deep feature based rice leaf disease identification using support vector machine , 2020, Comput. Electron. Agric..

[10]  Zahid Iqbal,et al.  Detection and classification of citrus diseases in agriculture based on optimized weighted segmentation and feature selection , 2018, Comput. Electron. Agric..

[11]  Abdullah M. Iliyasu,et al.  A Multidimensional Hyperjerk Oscillator: Dynamics Analysis, Analogue and Embedded Systems Implementation, and Its Application as a Cryptosystem , 2019, Sensors.

[12]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[14]  Stéphane Mallat,et al.  Rigid-Motion Scattering for Texture Classification , 2014, ArXiv.

[15]  Murvet Kirci,et al.  Disease detection on the leaves of the tomato plants by using deep learning , 2017, 2017 6th International Conference on Agro-Geoinformatics.

[16]  Tanzila Saba,et al.  Entropy‐controlled deep features selection framework for grape leaf diseases recognition , 2020, Expert Syst. J. Knowl. Eng..

[17]  Marcel Salathé,et al.  An open access repository of images on plant health to enable the development of mobile disease diagnostics through machine learning and crowdsourcing , 2015, ArXiv.

[18]  Guomin Zhou,et al.  Automatic Detection of Rice Disease Using Near Infrared Spectra Technologies , 2016, Journal of the Indian Society of Remote Sensing.

[19]  Tania Stathaki,et al.  Recent Developments in Deep Learning for Engineering Applications , 2018, Comput. Intell. Neurosci..

[20]  Muhammad Sharif,et al.  Intelligent microscopic approach for identification and recognition of citrus deformities , 2019, Microscopy research and technique.

[21]  Mingming Zhang,et al.  Identification of Maize Leaf Diseases Using Improved Deep Convolutional Neural Networks , 2018, IEEE Access.

[22]  Raja Purushothaman,et al.  Tomato crop disease classification using pre-trained deep learning algorithm , 2018 .

[23]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[25]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[26]  Mostafa Mehdipour-Ghazi,et al.  Plant identification using deep neural networks via optimization of transfer learning parameters , 2017, Neurocomputing.

[27]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[28]  Khursheed Aurangzeb,et al.  An Optimized Method for Segmentation and Classification of Apple Diseases Based on Strong Correlation and Genetic Algorithm Based Feature Selection , 2019, IEEE Access.

[29]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Khan Muhammad,et al.  A Novel Deep Transfer Learning Method for Detection of Myocardial Infarction , 2019, ArXiv.

[31]  N. Wickramarachchi,et al.  An image recognition system for crop disease identification of paddy fields in Sri Lanka , 2009, 2009 International Conference on Industrial and Information Systems (ICIIS).

[32]  Alsayed Algergawy,et al.  A Deep Learning-based Approach for Banana Leaf Diseases Classification , 2017, BTW.

[33]  Li Yujian,et al.  A comparative study of fine-tuning deep learning models for plant disease identification , 2019, Comput. Electron. Agric..

[34]  Chris Chatwin,et al.  AUTOMATIC PLANT PEST DETECTION AND RECOGNITION USING k-MEANS CLUSTERING ALGORITHM AND CORRESPONDENCE FILTERS , 2013 .

[35]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[36]  Tanzila Saba,et al.  An automated system for cucumber leaf diseased spot detection and classification using improved saliency method and deep features selection , 2020, Multimedia Tools and Applications.

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[39]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Ana Heryana,et al.  Machine Learning-based for Automatic Detection of Corn-Plant Diseases Using Image Processing , 2018, 2018 International Conference on Computer, Control, Informatics and its Applications (IC3INA).

[41]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[42]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Darko Stefanovic,et al.  Solving Current Limitations of Deep Learning Based Approaches for Plant Disease Detection , 2019, Symmetry.

[44]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Saeid Nahavandi,et al.  A Classifier Graph Based Recurring Concept Detection and Prediction Approach , 2018, Comput. Intell. Neurosci..