Semi-Supervised Noisy Student Pre-training on EfficientNet Architectures for Plant Pathology Classification

In recent years, deep learning has vastly improved the identification and diagnosis of various diseases in plants. In this report, we investigate the problem of pathology classification using images of a single leaf. We explore the use of standard benchmark models such as VGG16, ResNet101, and DenseNet 161 to achieve a 0.945 score on the task. Furthermore, we explore the use of the newer EfficientNet model, improving the accuracy to 0.962. Finally, we introduce the state-of-the-art idea of semi-supervised Noisy Student training to the EfficientNet, resulting in significant improvements in both accuracy and convergence rate. The final ensembled Noisy Student model performs very well on the task, achieving a test score of 0.982.

[1]  Fumio Okura,et al.  How Convolutional Neural Networks Diagnose Plant Disease , 2019, Plant phenomics.

[3]  Aniket Gharat,et al.  Leaf Disease Detection Using Image Processing , 2017 .

[4]  L. Plümer,et al.  Original paper: Early detection and classification of plant diseases with Support Vector Machines based on hyperspectral reflectance , 2010 .

[5]  Sonajharia Minz,et al.  RICE PLANT DISEASE CLASSIFICATION USING TRANSFER LEARNING OF DEEP CONVOLUTION NEURAL NETWORK , 2019, ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  A. B. Patil,et al.  Plant Disease Detection Using Image Processing , 2015, 2015 International Conference on Computing Communication Control and Automation.

[8]  Chen Sun,et al.  Revisiting Unreasonable Effectiveness of Data in Deep Learning Era , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[13]  Kilian Q. Weinberger,et al.  Deep Networks with Stochastic Depth , 2016, ECCV.

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  P. Raja,et al.  Automated disease classification in (Selected) agricultural crops using transfer learning , 2020, Automatika.

[16]  Sanket Biswas,et al.  Fault Area Detection in Leaf Diseases Using K-Means Clustering , 2018, 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI).

[17]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Noah Snavely,et al.  The Plant Pathology 2020 challenge dataset to classify foliar disease of apples , 2020, ArXiv.

[19]  Ch. Usha Kumari,et al.  Leaf Disease Detection: Feature Extraction with K-means clustering and Classification with ANN , 2019, 2019 3rd International Conference on Computing Methodologies and Communication (ICCMC).

[20]  Quoc V. Le,et al.  Self-Training With Noisy Student Improves ImageNet Classification , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  A. K. Misra,et al.  Detection of plant leaf diseases using image segmentation and soft computing techniques , 2017 .

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[24]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.