Pest24: A large-scale very small object data set of agricultural pests for multi-target detection

Abstract Precision agriculture poses new challenges for real-time monitoring pest population in field based on new-generation AI technology. In order to provide a big data resource for training pest detection deep learning models, this paper establishes a large-scale multi-target standardized data set of agricultural pests, named Pest24. Specifically, the data set currently consists of 25,378 field pest annotated images collected from our automatic pest trap & imaging device. Totally, 24 categories of typical pests are involved in Pest24, which dominantly destroy field crops in China every year. We apply several state-of-the-art deep learning detection methods, Faster RCNN, SSD, YOLOv3, Cascade R-CNN to detect the pests in the data set, and obtain encouraging results for real-time monitoring field crop pests. To explore the factors that affect the detection accuracy of pests, we analyze the data set in a variety of aspects, finding that three factors, i.e. relative scale, number of instances and object adhesion, mainly influence the pest detection performance. Overall, Pest24 is featured typically with large scale multi-pest image data, very small object scales, high object similarity and dense pest distribution. We hope that Pest24 promotes accurate multi-pest monitoring for precision agriculture and also benefits the machine vision community by providing a new specialized object detection benchmark.

[1]  Zhang Hongtao,et al.  Hardware design of an intelligent detection system for stored-grain pests based on machine vision , 2003 .

[2]  Jacques Istas,et al.  Precision of systematic sampling and transitive methods , 1999 .

[3]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[4]  Browne,et al.  Cross-Validation Methods. , 2000, Journal of mathematical psychology.

[5]  Tae-Soo Chon,et al.  Automatic identification of whiteflies, aphids and thrips in greenhouse based on image analysis , 2007 .

[6]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Yao Zhou,et al.  A Vision-Based Counting and Recognition System for Flying Insects in Intelligent Agriculture , 2018, Sensors.

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Huan Zhang,et al.  Localization and Classification of Paddy Field Pests using a Saliency Map and Deep Convolutional Neural Network , 2016, Scientific Reports.

[10]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[13]  D. Burra,et al.  Caught off guard: folk knowledge proves deficient when addressing invasive pests in Asian cassava systems , 2018, Environment, Development and Sustainability.

[14]  Bing Wang,et al.  Automatic Localization and Count of Agricultural Crop Pests Based on an Improved Deep Learning Pipeline , 2019, Scientific Reports.

[15]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[17]  Elena Deza,et al.  Encyclopedia of Distances , 2014 .

[18]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Eldert J. van Henten,et al.  Improved vegetation segmentation with ground shadow removal using an HDR camera , 2018, Precision Agriculture.

[21]  D. Dong,et al.  Monitoring the number and size of pests based on modulated infrared beam sensing technology , 2018, Precision Agriculture.

[22]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[23]  Lishan Lv,et al.  An early warning model for vegetable pests based on multidimensional data , 2019, Comput. Electron. Agric..

[24]  Bangjun Lei,et al.  Classification, Parameter Estimation and State Estimation: An Engineering Approach Using MATLAB, 2nd Edition , 2017 .

[25]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[26]  Rodrigo Castañeda-Miranda,et al.  Original paper: Scale invariant feature approach for insect monitoring , 2011 .

[27]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[28]  M. Luo,et al.  The development of the CIE 2000 Colour Difference Formula , 2001 .

[29]  Tae-Soo Chon,et al.  Automatic identification and counting of small size pests in greenhouse conditions with low computational cost , 2015, Ecol. Informatics.

[30]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.