An Improved EfficientNetV2 Model Based on Visual Attention Mechanism: Application to Identification of Cassava Disease

With the characteristic of high recognition rate and strong network robustness, convolutional neural network has now become the most mainstream method in the field of crop disease recognition. Aiming at the problems with insufficient numbers of labeled samples, complex backgrounds of sample images, and difficult extraction of useful feature information, a novel algorithm is proposed in this study based on attention mechanisms and convolutional neural networks for cassava leaf recognition. Specifically, a combined data augmentation strategy for datasets is used to prevent single distribution of image datasets, and then the PDRNet (plant disease recognition network) combining channel attention mechanism and spatial attention mechanism is proposed. The algorithm is designed as follows. Firstly, an attention module embedded in the network layer is deployed to establish remote dependence on each feature layer, strengthen the key feature information, and suppress the interference feature information, such as background noise. Secondly, a stochastic depth learning strategy is formulated to accelerate the training and inference of the network. And finally, a transfer learning method is adopted to load the pretrained weights into the model proposed in this study, with the recognition accuracy of the model enhanced by means of detailed parameter adjustments and dynamic changes in the learning rate. A large number of comparative experiments demonstrate that the proposed algorithm can deliver a recognition accuracy of 99.56% on the cassava disease image dataset, reaching the state-of-the-art level among CNN-based methods in terms of accuracy.

[1]  S. Garg,et al.  Lightweight Convolutional Neural Network Model for Human Face Detection in Risk Situations , 2022, IEEE Transactions on Industrial Informatics.

[2]  Yutian Cui,et al.  An Improved Crop Disease Identification Method Based on Lightweight Convolutional Neural Network , 2022, J. Electr. Comput. Eng..

[3]  N. Saranya,et al.  Cassava Leaf Disease Identification and Detection Using Deep Learning Approach , 2022, Int. J. Comput. Commun. Control.

[4]  A. L. Imoize,et al.  Enhanced Convolutional Neural Network Model for Cassava Leaf Disease Identification and Classification , 2022, Mathematics.

[5]  Trinh Tan Dat,et al.  Leaf Recognition Based on Joint Learning Multiloss of Multimodel Convolutional Neural Networks: A Testing for Vietnamese Herb , 2021, Comput. Intell. Neurosci..

[6]  Marcin Wozniak,et al.  IoT and Interpretable Machine Learning Based Framework for Disease Prediction in Pearl Millet , 2021, Sensors.

[7]  Chinmay Chakraborty,et al.  Grape Disease Detection Network Based on Multi-Task Learning and Attention Features , 2021, IEEE Sensors Journal.

[8]  Kemal Akyol,et al.  Plant leaf disease classification using EfficientNet deep learning model , 2021, Ecol. Informatics.

[9]  Muhammad Ali Qureshi,et al.  Use of deep learning techniques for identification of plant leaf stresses: A review , 2020, Sustain. Comput. Informatics Syst..

[10]  Arief Setyanto,et al.  Data augmentation for automated pest classification in Mango farms , 2020, Comput. Electron. Agric..

[11]  Kaiming He,et al.  Designing Network Design Spaces , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  R. Karthik,et al.  Attention embedded residual CNN for disease detection in tomato leaves , 2020, Appl. Soft Comput..

[13]  Guan Wang,et al.  Deep Learning with Taxonomic Loss for Plant Identification , 2019, Comput. Intell. Neurosci..

[14]  R. GeethaRamani,et al.  Identification of plant leaf diseases using a nine-layer deep convolutional neural network , 2019, Comput. Electr. Eng..

[15]  Li Yujian,et al.  A comparative study of fine-tuning deep learning models for plant disease identification , 2019, Comput. Electron. Agric..

[16]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[17]  Jayme Garcia Arnal Barbedo,et al.  Plant disease identification from individual lesions and spots using deep learning , 2019, Biosystems Engineering.

[18]  Guiling Sun,et al.  Plant Diseases Recognition Based on Image Processing Technology , 2018, J. Electr. Comput. Eng..

[19]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[20]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  David Hughes,et al.  Deep Learning for Image-Based Cassava Disease Detection , 2017, Front. Plant Sci..

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Xinting Yang,et al.  Recognizing pests in field-based images by Combining spatial and channel attention mechanism , 2021, IEEE Access.

[25]  Xuyu Xiang,et al.  Image Recognition of Citrus Diseases Based on Deep Learning , 2020 .