A Motor-Driven and Computer Vision-Based Intelligent E-Trap for Monitoring Citrus Flies

Citrus flies are important quarantine pests in citrus plantations. Electronic traps (e-traps) based on computer vision are the most popular types of equipment for monitoring them. However, most current e-traps are inefficient and unreliable due to requiring manual operations and lack of reliable detection and identification algorithms of citrus fly images. To address these problems, this paper presents a monitoring scheme based on automatic e-traps and novel recognition algorithms. In this scheme, the prototype of an automatic motor-driven e-trap is firstly designed based on a yellow sticky trap. A motor autocontrol algorithm based on Local Binary Pattern (LBP) image analysis is proposed to automatically replace attractants in the e-trap for long-acting work. Furthermore, for efficient and reliable statistics of captured citrus flies, based on the differences between two successive sampling images of the e-trap, a simple and effective detection algorithm is presented to continuously detect the newly captured citrus flies from the collected images of the e-trap. Moreover, a Multi-Attention and Multi-Part convolutional neural Network (MAMPNet) is proposed to exploit discriminative local features of citrus fly images to recognize the citrus flies in the images. Finally, extensive simulation experiments validate the feasibility and efficiency of the designed e-trap prototype and its autocontrol algorithm, as well as the reliability and effectiveness of the proposed detection and recognition algorithms for citrus flies.

[1]  Savvas A. Chatzichristofis,et al.  Remote monitoring of the Bactrocera oleae (Gmelin) (Diptera: Tephritidae) population using an automated McPhail trap , 2017, Comput. Electron. Agric..

[2]  Yu Sun,et al.  Automatic in-trap pest detection using deep learning for pheromone-based Dendroctonus valens monitoring , 2018, Biosystems Engineering.

[3]  Mohammed Eunus Ali,et al.  Identification and recognition of rice diseases and pests using convolutional neural networks , 2018, Biosystems Engineering.

[4]  Luc Vincent,et al.  Morphological transformations of binary images with arbitrary structuring elements , 1991, Signal Process..

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  J. Sivinski,et al.  Field comparison of chemical attractants and traps for Caribbean fruit fly (Diptera: Tephritidae) in Florida citrus. , 2005, Journal of economic entomology.

[8]  B. Dominiak,et al.  Area-Wide Management of Fruit Flies in Australia , 2007 .

[9]  Dong Soo Lee,et al.  Moth Detection from Pheromone Trap Images Using Deep Learning Object Detectors , 2020, Agriculture.

[10]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  M. R. Tabilio,et al.  Electronic traps for detection and population monitoring of adult fruit flies (Diptera: Tephritidae) , 2018 .

[12]  G. Steyskal History and Use of the McPhail Trap , 1977 .

[13]  Jong-Sen Lee,et al.  Digital image smoothing and the sigma filter , 1983, Comput. Vis. Graph. Image Process..

[14]  F. Verheggen,et al.  Insect pest monitoring with camera-equipped traps: strengths and limitations , 2020, Journal of Pest Science.

[15]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Chao-Dong Zhu,et al.  Construction, implementation and testing of an image identification system using computer vision methods for fruit flies with economic importance (Diptera: Tephritidae). , 2017, Pest management science.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  D. Hall An Assessment of Yellow Sticky Card Traps as Indicators of the Abundance of Adult Diaphorina citri (Hemiptera: Psyllidae) in Citrus , 2009, Journal of economic entomology.

[19]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[20]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Danny Crookes,et al.  Social Behavioral Phenotyping of Drosophila With a 2D–3D Hybrid CNN Framework , 2019, IEEE Access.

[22]  Constantino Valero,et al.  Automatic Detection and Monitoring of Insect Pests—A Review , 2020, Agriculture.

[23]  Hyeonjoon Moon,et al.  Crop pest recognition in natural scenes using convolutional neural networks , 2020, Comput. Electron. Agric..

[24]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[25]  Anderson Rocha,et al.  Automatic identification of fruit flies (Diptera: Tephritidae) , 2014, J. Vis. Commun. Image Represent..

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Markos Avlonitis,et al.  DIRT: The Dacus Image Recognition Toolkit , 2018, J. Imaging.

[28]  Errui Ding,et al.  Multi-Attention Multi-Class Constraint for Fine-grained Image Recognition , 2018, ECCV.

[29]  Ming-Ming Cheng,et al.  IP102: A Large-Scale Benchmark Dataset for Insect Pest Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Luc Van Gool,et al.  Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  R. Kopittke,et al.  Area-wide management of fruit flies (Diptera: Tephritidae) in the Central Burnett district of Queensland, Australia , 2010 .

[32]  Romain Raveaux,et al.  A survey on image-based insect classification , 2017, Pattern Recognit..

[33]  Nikhil Ketkar,et al.  Introduction to PyTorch , 2021, Deep Learning with Python.

[34]  Gong Cheng,et al.  P-CNN: Part-Based Convolutional Neural Networks for Fine-Grained Visual Categorization , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  S. Y. Chen,et al.  Kalman Filter for Robot Vision: A Survey , 2012, IEEE Transactions on Industrial Electronics.

[36]  Mohamed Cheriet,et al.  AdOtsu: An adaptive and parameterless generalization of Otsu's method for document image binarization , 2012, Pattern Recognit..

[37]  Xiu-Shen Wei,et al.  Deep Learning for Fine-Grained Image Analysis: A Survey , 2019, ArXiv.

[38]  Vimal K. Shrivastava,et al.  Transfer Learning-Based Framework for Classification of Pest in Tomato Plants , 2020, Appl. Artif. Intell..

[39]  Yinglong Wang,et al.  FB-CNN: Feature Fusion-Based Bilinear CNN for Classification of Fruit Fly Image , 2020, IEEE Access.

[40]  Graham W. Taylor,et al.  Automatic moth detection from trap images for pest management , 2016, Comput. Electron. Agric..

[41]  C. Niu,et al.  Field Evaluation of Attractive Lures for the Fruit Fly Bactrocera minax (Diptera: Tephritidae) and Their Potential use in Spot Sprays in Hubei Province (China) , 2012, Journal of economic entomology.

[42]  Deqin Xiao,et al.  A multi-target trapping and tracking algorithm for Bactrocera Dorsalis based on cost model , 2016, Comput. Electron. Agric..