A Data Augmentation Method Based on Generative Adversarial Networks for Grape Leaf Disease Identification

The identification of grape leaf diseases based on deep learning is critical to controlling the spread of diseases and ensuring the healthy development of the grape industry. Focusing on the lack of training images of grape leaf diseases, this paper proposes a novel model named Leaf GAN, which is based on generative adversarial networks (GANs), to generate images of four different grape leaf diseases for training identification models. A generator model with degressive channels is first designed to generate grape leaf disease images; then, the dense connectivity strategy and instance normalization are fused into an efficient discriminator to identify real and fake disease images by utilizing their excellent feature extraction capability on grape leaf lesions. Finally, the deep regret gradient penalty method is applied to stabilize the training process of the model. Using a total of 4,062 grape leaf disease images, the Leaf GAN model ultimately generates 8,124 grape leaf disease images. The generated grape leaf disease images based on Leaf GAN model can obtain better performance than DCGAN and WGAN in terms of the Fréchet inception distance. The experimental results show that the proposed Leaf GAN model generates sufficient grape leaf disease images with prominent lesions, providing a feasible solution for the data augmentation of grape leaf disease images. For the eight prevailing classification models with the expanded dataset, the identification performance based on CNNs indicated higher accuracies, whereby all the accuracies were better than those of the initial dataset with other data augmentation methods. Among them, Xception achieves a recognition accuracy of 98.70% on the testing set. The results demonstrate that the proposed data augmentation method represents a new approach to overcoming the overfitting problem in disease identification and can effectively improve the identification accuracy.

[1]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[2]  Ning Ye,et al.  TA-CNN: Two-way attention models in deep convolutional neural network for plant recognition , 2019, Neurocomputing.

[3]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[4]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[6]  Zhedong Zheng,et al.  Joint Discriminative and Generative Learning for Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[8]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[9]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[10]  Yi Yang,et al.  Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Whoi-Yul Kim,et al.  Nighttime Data Augmentation Using GAN for Improving Blind-Spot Detection , 2020, IEEE Access.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[14]  Bernt Schiele,et al.  F-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Bin Wu,et al.  Network Intrusion Detection Based on Supervised Adversarial Variational Auto-Encoder With Regularization , 2020, IEEE Access.

[16]  Hong Zhang,et al.  Rice Blast Disease Recognition Using a Deep Convolutional Neural Network , 2019, Scientific Reports.

[17]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[18]  Peter McCloskey,et al.  A Mobile-Based Deep Learning Model for Cassava Disease Diagnosis , 2019, Front. Plant Sci..

[19]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[20]  Yanyun Qu,et al.  Enhanced Pix2pix Dehazing Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Zhiwen Yu,et al.  Enhancing TripleGAN for Semi-Supervised Conditional Instance Synthesis and Classification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Guo-Jun Qi,et al.  Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities , 2017, International Journal of Computer Vision.

[23]  Kushtrim Bresilla,et al.  Single-Shot Convolution Neural Networks for Real-Time Fruit Detection Within the Tree , 2019, Front. Plant Sci..

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[25]  Jacob Abernethy,et al.  On Convergence and Stability of GANs , 2018 .

[26]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[28]  Wenzhun Huang,et al.  Three-channel convolutional neural networks for vegetable leaf disease recognition , 2019, Cognitive Systems Research.

[29]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[30]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[31]  P. St-Charles,et al.  Convolutional Neural Networks for the Automatic Identification of Plant Diseases , 2019, Front. Plant Sci..

[32]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[33]  Dimitris N. Metaxas,et al.  StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  Peng Jiang,et al.  Real-Time Detection of Apple Leaf Diseases Using Deep Learning Approach Based on Improved Convolutional Neural Networks , 2019, IEEE Access.

[35]  Johan Potgieter,et al.  Plant Disease Detection and Classification by Deep Learning , 2019, Plants.

[36]  Yun Zhang,et al.  Identification of Apple Leaf Diseases Based on Deep Convolutional Neural Networks , 2017, Symmetry.

[37]  Guy Shani,et al.  Using Deep Learning for Image-Based Potato Tuber Disease Detection. , 2019, Phytopathology.

[38]  R. GeethaRamani,et al.  Identification of plant leaf diseases using a nine-layer deep convolutional neural network , 2019, Comput. Electr. Eng..

[39]  Sang Cheol Kim,et al.  A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition , 2017, Sensors.

[40]  Gerrit Polder,et al.  Potato Virus Y Detection in Seed Potatoes Using Deep Learning on Hyperspectral Images , 2019, Front. Plant Sci..

[41]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[42]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[43]  Jie Yang,et al.  Enlarged Training Dataset by Pairwise GANs for Molecular-Based Brain Tumor Classification , 2020, IEEE Access.

[44]  Yuanyuan Pu,et al.  Image Recognition of Coal and Coal Gangue Using a Convolutional Neural Network and Transfer Learning , 2019, Energies.

[45]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.

[47]  Hongyi Zhang,et al.  mixup: Beyond Empirical Risk Minimization , 2017, ICLR.

[48]  Muhammad Awais,et al.  CCDF: Automatic system for segmentation and recognition of fruit crops diseases based on correlation coefficient and deep CNN features , 2018, Comput. Electron. Agric..

[49]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.

[50]  Yun Shi,et al.  Cucumber leaf disease identification with global pooling dilated convolutional neural network , 2019, Comput. Electron. Agric..

[51]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[52]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[53]  Eyad Elyan,et al.  MFC-GAN: Class-imbalanced dataset classification using Multiple Fake Class Generative Adversarial Network , 2019, Neurocomputing.

[54]  Ole Winther,et al.  Autoencoding beyond pixels using a learned similarity metric , 2015, ICML.

[55]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).