Moth Detection from Pheromone Trap Images Using Deep Learning Object Detectors

Diverse pheromones and pheromone-based traps, as well as images acquired from insects captured by pheromone-based traps, have been studied and developed to monitor the presence and abundance of pests and to protect plants. The purpose of this study is to construct models that detect three species of pest moths in pheromone trap images using deep learning object detection methods and compare their speed and accuracy. Moth images in pheromone traps were collected for training and evaluation of deep learning detectors. Collected images were then subjected to a labeling process that defines the ground truths of target objects for their box locations and classes. Because there were a few negative objects in the dataset, non-target insects were labeled as unknown class and images of non-target insects were added to the dataset. Moreover, data augmentation methods were applied to the training process, and parameters of detectors that were pre-trained with the COCO dataset were used as initial parameter values. Seven detectors—Faster R-CNN ResNet 101, Faster R-CNN ResNet 50, Faster R-CNN Inception v.2, R-FCN ResNet 101, Retinanet ResNet 50, Retinanet Mobile v.2, and SSD Inception v.2 were trained and evaluated. Faster R-CNN ResNet 101 detector exhibited the highest accuracy (mAP as 90.25), and seven different detector types showed different accuracy and speed. Furthermore, when unexpected insects were included in the collected images, a four-class detector with an unknown class (non-target insect) showed lower detection error than a three-class detector.

[1]  Vincent Martin,et al.  A cognitive vision approach to early pest detection in greenhouse crops , 2008 .

[2]  Tae-Soo Chon,et al.  Automatic identification and counting of small size pests in greenhouse conditions with low computational cost , 2015, Ecol. Informatics.

[3]  Naif Alajlan,et al.  Deep Learning Approach for Car Detection in UAV Imagery , 2017, Remote. Sens..

[4]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[5]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[6]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Haoxiang Wang,et al.  Plant diseased leaf segmentation and recognition by fusion of superpixel, K-means and PHOG , 2018 .

[8]  Rodrigo Castañeda-Miranda,et al.  Original paper: Scale invariant feature approach for insect monitoring , 2011 .

[9]  Philipp Kirsch,et al.  Sex Pheromones and Their Impact on Pest Management , 2010, Journal of Chemical Ecology.

[10]  Hatem A. Rashwan,et al.  Automatic detection of individual and touching moths from trap images by combining contour-based and region-based segmentation , 2018, IET Comput. Vis..

[11]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[12]  Yu Sun,et al.  Automatic in-trap pest detection using deep learning for pheromone-based Dendroctonus valens monitoring , 2018, Biosystems Engineering.

[13]  Jiangning Wang,et al.  A new automatic identification system of insect images at the order level , 2012, Knowl. Based Syst..

[14]  Chenglu Wen,et al.  Local feature-based identification and classification for orchard insects , 2009 .

[15]  Xiaoli Hao,et al.  Multispectral pedestrian detection based on deep convolutional neural networks , 2018 .

[16]  Sang Cheol Kim,et al.  A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition , 2017, Sensors.

[17]  Jang-myung Lee,et al.  Detection of small-sized insect pest in greenhouses based on multifractal analysis , 2015 .

[18]  Sang-Yeon Kim,et al.  Application of Deep-Learning Methods to Bird Detection Using Unmanned Aerial Vehicle Imagery , 2019, Sensors.

[19]  Christopher Brewster,et al.  IoT in Agriculture: Designing a Europe-Wide Large-Scale Pilot , 2017, IEEE Communications Magazine.

[20]  Nancy Alonistioti,et al.  Farm management systems and the Future Internet era , 2012 .

[21]  Jirapond Muangprathub,et al.  IoT and agriculture data analysis for smart farm , 2019, Comput. Electron. Agric..