Using deep transfer learning for image-based plant disease identification

Abstract Plant diseases have a disastrous impact on the safety of food production, and they can cause a significant reduction in both the quality and quantity of agricultural products. In severe cases, plant diseases may even cause no grain harvest entirely. Thus, the automatic identification and diagnosis of plant diseases are highly desired in the field of agricultural information. Many methods have been proposed for solving this task, where deep learning is becoming the preferred method due to the impressive performance. In this work, we study transfer learning of the deep convolutional neural networks for the identification of plant leaf diseases and consider using the pre-trained model learned from the typical massive datasets, and then transfer to the specific task trained by our own data. The VGGNet pre-trained on ImageNet and Inception module are selected in our approach. Instead of starting the training from scratch by randomly initializing the weights, we initialize the weights using the pre-trained networks on the large labeled dataset, ImageNet. The proposed approach presents a substantial performance improvement with respect to other state-of-the-art methods; it achieves a validation accuracy of no less than 91.83% on the public dataset. Even under complex background conditions, the average accuracy of the proposed approach reaches 92.00% for the class prediction of rice plant images. Experimental results demonstrate the validity of the proposed approach, and it is accomplished efficiently for plant disease detection.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Trevor Hastie,et al.  Regularized linear discriminant analysis and its application in microarrays. , 2007, Biostatistics.

[3]  Hitoshi Iyatomi,et al.  Basic Study of Automated Diagnosis of Viral Plant Diseases Using Convolutional Neural Networks , 2015, ISVC.

[4]  Malik Braik,et al.  Fast and Accurate Detection and Classification of Plant Diseases , 2011 .

[5]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[8]  Lingxian Zhang,et al.  A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network , 2018, Comput. Electron. Agric..

[9]  Loris Nanni,et al.  Deep learning and transfer learning features for plankton classification , 2019, Ecol. Informatics.

[10]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[11]  Anne-Sophie Capelle-Laizé,et al.  Blind image steganalysis based on evidential K-Nearest Neighbors , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[12]  Tomislav Lipic,et al.  Fine-tuning Convolutional Neural Networks for fine art classification , 2018, Expert Syst. Appl..

[13]  Yun Shi,et al.  Cucumber leaf disease identification with global pooling dilated convolutional neural network , 2019, Comput. Electron. Agric..

[14]  Saeid Minaei,et al.  Vision-based pest detection based on SVM classification method , 2017, Comput. Electron. Agric..

[15]  Mansour Sheikhan,et al.  Improved contourlet-based steganalysis using binary particle swarm optimization and radial basis neural networks , 2011, Neural Computing and Applications.

[16]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[17]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[19]  Joel J. P. C. Rodrigues,et al.  A novel deep learning based framework for the detection and classification of breast cancer using transfer learning , 2019, Pattern Recognit. Lett..

[20]  Jason C. Hung,et al.  Recognizing learning emotion based on convolutional neural networks and transfer learning , 2019, Appl. Soft Comput..

[21]  Zhen Wang,et al.  Cucumber disease recognition based on Global-Local Singular value decomposition , 2016, Neurocomputing.

[22]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[23]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Jayme Garcia Arnal Barbedo,et al.  Factors influencing the use of deep learning for plant disease recognition , 2018, Biosystems Engineering.

[25]  Henrik Skov Midtiby,et al.  Plant species classification using deep convolutional neural network , 2016 .

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Chris Chatwin,et al.  AUTOMATIC PLANT PEST DETECTION AND RECOGNITION USING k-MEANS CLUSTERING ALGORITHM AND CORRESPONDENCE FILTERS , 2013 .

[28]  Zhiguo Cao,et al.  Rice heading stage automatic observation by multi-classifier cascade based rice spike detection method , 2018, Agricultural and Forest Meteorology.

[29]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Zhu-Hong You,et al.  Leaf image based cucumber disease recognition using sparse representation classification , 2017, Comput. Electron. Agric..

[31]  S Deepa,et al.  Steganalysis on Images using SVM with Selected Hybrid Features of Gini Index Feature Selection Algorithm , 2017 .

[32]  Yousri Kessentini,et al.  A two-stage deep neural network for multi-norm license plate detection and recognition , 2019, Expert Syst. Appl..

[33]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).