A Smartphone-Based Application for Scale Pest Detection Using Multiple-Object Detection Methods

Taiwan’s economy mainly relies on the export of agricultural products. If even the suspicion of a pest is found in the crop products after they are exported, not only are the agricultural products returned but the whole batch of crops is destroyed, resulting in extreme crop losses. The species of mealybugs, Coccidae, and Diaspididae, which are the primary pests of the scale insect in Taiwan, can not only lead to serious damage to the plants but also severely affect agricultural production. Hence, to recognize the scale pests is an important task in Taiwan’s agricultural field. In this study, we propose an AI-based pest detection system for solving the specific issue of detection of scale pests based on pictures. Deep-learning-based object detection models, such as faster region-based convolutional networks (Faster R-CNNs), single-shot multibox detectors (SSDs), and You Only Look Once v4 (YOLO v4), are employed to detect and localize scale pests in the picture. The experimental results show that YOLO v4 achieved the highest classification accuracy among the algorithms, with 100% in mealybugs, 89% in Coccidae, and 97% in Diaspididae. Meanwhile, the computational performance of YOLO v4 has indicated that it is suitable for real-time application. Moreover, the inference results of the YOLO v4 model further help the end user. A mobile application using the trained scale pest recognition model has been developed to facilitate pest identification in farms, which is helpful in applying appropriate pesticides to reduce crop losses.

[1]  Anjali A. Yadav,et al.  SVM classifier based grape leaf disease detection , 2016, 2016 Conference on Advances in Signal Processing (CASP).

[2]  Jun-Wei Hsieh,et al.  CSPNet: A New Backbone that can Enhance Learning Capability of CNN , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[4]  P. Javier Herrera,et al.  A Novel Approach for Weed Type Classification Based on Shape Descriptors and a Fuzzy Decision-Making Method , 2014, Sensors.

[5]  Glauco de Souza Rolim,et al.  Machine learning algorithms for forecasting the incidence of Coffea arabica pests and diseases , 2020, International Journal of Biometeorology.

[6]  Abdolabbas Jafari,et al.  Evaluation of support vector machine and artificial neural networks in weed detection using shape features , 2018, Comput. Electron. Agric..

[7]  Sang Cheol Kim,et al.  A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition , 2017, Sensors.

[8]  Yao Zhou,et al.  A Vision-Based Counting and Recognition System for Flying Insects in Intelligent Agriculture , 2018, Sensors.

[9]  Xin Yang,et al.  Machine learning in plant disease research , 2017 .

[10]  Daniel P. W. Ellis,et al.  Applying Machine Learning and Audio Analysis Techniques to Insect Recognition in Intelligent Traps , 2013, 2013 12th International Conference on Machine Learning and Applications.

[11]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[12]  B K Raghavendra,et al.  A Review on Machine Learning Classification Techniques for Plant Disease Detection , 2019, 2019 5th International Conference on Advanced Computing & Communication Systems (ICACCS).

[13]  Faisal Ahmed,et al.  Classification of crops and weeds from digital images: A support vector machine approach , 2012 .

[14]  Fangyuan Wang,et al.  A Recognition Method for Rice Plant Diseases and Pests Video Detection Based on Deep Convolutional Neural Network , 2020, Sensors.

[15]  Juan Du,et al.  Understanding of Object Detection Based on CNN Family and YOLO , 2018 .

[16]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[17]  Ernest Mwebaze,et al.  Machine Learning for Plant Disease Incidence and Severity Measurements from Leaf Images , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[18]  Chengjun Xie,et al.  AF-RCNN: An anchor-free convolutional neural network for multi-categories agricultural pest detection , 2020, Comput. Electron. Agric..

[19]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Shima Ramesh Maniyath,et al.  Plant Disease Detection Using Machine Learning , 2018, 2018 International Conference on Design Innovations for 3Cs Compute Communicate Control (ICDI3C).

[21]  Austin Hanson,et al.  Development of Enhanced Weed Detection System with Adaptive Thresholding and Support Vector Machine , 2016, RACS.

[22]  Saeid Minaei,et al.  Vision-based pest detection based on SVM classification method , 2017, Comput. Electron. Agric..

[23]  Sung Wook Baik,et al.  Crop Pests Prediction Method Using Regression and Machine Learning Technology: Survey☆ , 2014 .

[24]  T. Kondo,et al.  Coccidology. The study of scale insects (Hemiptera: Sternorrhyncha: Coccoidea) , 2009 .

[25]  Eric T. Matson,et al.  A Feature-Based Machine Learning Agent for Automatic Rice and Weed Discrimination , 2015, ICAISC.