An Efficient Insect Pest Classification Using Multiple Convolutional Neural Network Based Models

Accurate insect pest recognition is significant to protect the crop or take the early treatment on the infected yield, and it helps reduce the loss for the agriculture economy. Design an automatic pest recognition system is necessary because manual recognition is slow, time-consuming, and expensive. The Image-based pest classifier using the traditional computer vision method is not efficient due to the complexity. Insect pest classification is a difficult task because of various kinds, scales, shapes, complex backgrounds in the field, and high appearance similarity among insect species. With the rapid development of deep learning technology, the CNN-based method is the best way to develop a fast and accurate insect pest classifier. We present different convolutional neural network-based models in this work, including attention, feature pyramid, and fine-grained models. We evaluate our methods on two public datasets: the large-scale insect pest dataset, the IP102 benchmark dataset, and a smaller dataset, namely D0 in terms of the macro-average precision (MPre), the macro-average recall (MRec), the macro-average F1score (MF1), the accuracy (Acc), and the geometric mean (GM). The experimental results show that combining these convolutional neural network-based models can better perform than the state-of-the-art methods on these two datasets. For instance, the highest accuracy we obtained on IP102 and D0 is 74.13% and 99.78%, respectively, bypassing the corresponding state-of-the-art accuracy: Hieu T. Ung Vietnam National University in Ho Chi Minh City University of Science, Vietnam Huy Q. Ung Tokyo University of Agriculture and Technology, Japan Binh T. Nguyen (Corresponding Author) Vietnam National University in Ho Chi Minh City University of Science, Vietnam E-mail: ngtbinh@hcmus.edu.vn ar X iv :2 10 7. 12 18 9v 1 [ cs .C V ] 2 6 Ju l 2 02 1 2 Hieu T. Ung et al. 67.1% (IP102) and 98.8% (D0). We also publish our codes for contributing to the current research related to the insect pest classification problem.

[1]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Duc-Tien Dang-Nguyen,et al.  A Deep Learning based Food Recognition System for Lifelog Images , 2018, ICPRAM.

[3]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[4]  Ming-Ming Cheng,et al.  IP102: A Large-Scale Benchmark Dataset for Insect Pest Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Leif E. Peterson K-nearest neighbor , 2009, Scholarpedia.

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Fuji Ren,et al.  Feature Reuse Residual Networks for Insect Pest Recognition , 2019, IEEE Access.

[9]  Huan Zhang,et al.  Localization and Classification of Paddy Field Pests using a Saliency Map and Deep Convolutional Neural Network , 2016, Scientific Reports.

[10]  Fatih Varcin,et al.  Crop pest classification with a genetic algorithm-based weighted ensemble of deep convolutional neural networks , 2020, Comput. Electron. Agric..

[11]  Yu Jian,et al.  A Crop Pests Image Classification Algorithm Based on Deep Convolutional Neural Network , 2017 .

[12]  Binh T. Nguyen,et al.  3D-Brain Segmentation Using Deep Neural Network and Gaussian Mixture Model , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[13]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[14]  Candace Moore,et al.  Support vector machine (machine learning) , 2018, Radiopaedia.org.

[15]  Tao Mei,et al.  Destruction and Construction Learning for Fine-Grained Image Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Ramprasaath R. Selvaraju,et al.  Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization , 2016 .

[17]  Binh T. Nguyen,et al.  Vietnamese Food Recognition System Using Convolutional Neural Networks Based Features , 2020, ICCCI.

[18]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  G. Zhai,et al.  Three-branch and Mutil-scale learning for Fine-grained Image Recognition (TBMSL-Net) , 2020, ArXiv.

[20]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[21]  U. Srinivasulu Reddy,et al.  Crop pest classification based on deep convolutional neural network and transfer learning , 2019, Comput. Electron. Agric..

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Wenjie Liu,et al.  Deep Multibranch Fusion Residual Network for Insect Pest Recognition , 2021, IEEE Transactions on Cognitive and Developmental Systems.

[24]  Loris Nanni,et al.  Research on insect pest image detection and recognition based on bio-inspired methods , 2019, Ecol. Informatics.

[25]  Xi Cheng,et al.  Pest identification via deep residual learning in complex background , 2017, Comput. Electron. Agric..

[26]  Jiebo Luo,et al.  Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-Grained Image Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[28]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[29]  Rui Li,et al.  Multi-level learning features for automatic classification of field crop pests , 2018, Comput. Electron. Agric..

[30]  William Stafford Noble,et al.  Support vector machine , 2013 .