Automatic moth detection from trap images for pest management

We propose a convolutional neural network-based automatic moth detection pipeline.We describe a set of methods for preprocessing raw moth trap images.Our method shows promising performance on a codling moth dataset from images collected in the field.Our species-agnostic method can be easily adapted to different pests and/or environments. Monitoring the number of insect pests is a crucial component in pheromone-based pest management systems. In this paper, we propose an automatic detection pipeline based on deep learning for identifying and counting pests in images taken inside field traps. Applied to a commercial codling moth dataset, our method shows promising performance both qualitatively and quantitatively. Compared to previous attempts at pest detection, our approach uses no pest-specific engineering which enables it to adapt to other species and environments with minimal human effort. It is amenable to implementation on parallel hardware and therefore capable of deployment in settings where real-time performance is required.

[1]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Yilmaz Kaya,et al.  Application of artificial neural network for automatic detection of butterfly species using color and texture features , 2013, The Visual Computer.

[3]  Lakhmi C. Jain,et al.  An insect classification analysis based on shape features using quality threshold ARTMAP and moment invariant , 2011, Applied Intelligence.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Stefan Schröder,et al.  Biodiversity Informatics in Action: Identification and Monitoring of Bee Species using ABIS , 2001 .

[6]  Chenglu Wen,et al.  Local feature-based identification and classification for orchard insects , 2009 .

[7]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[8]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[9]  Thomas G. Dietterich,et al.  Dictionary-free categorization of very similar objects via stacked evidence trees , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Xin Zhang,et al.  Object class detection: A survey , 2013, CSUR.

[11]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[12]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Xiaolin Chen,et al.  Insect species recognition using discriminative local soft coding , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[15]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  L. Bottou,et al.  Deep Convolutional Networks for Scene Parsing , 2009 .

[17]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[21]  Chenglu Wen,et al.  Image-based orchard insect automated identification and classification method , 2012 .

[22]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[23]  Sang-Hee Lee,et al.  Identification of butterfly based on their shapes when viewed from different angles using an artificial neural network , 2014 .

[24]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Thomas G. Dietterich,et al.  Segmentation of touching insects based on optical flow and NCuts , 2013 .

[26]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  P. W. Flinn,et al.  DETECTION OF INSECTS IN BULK WHEAT SAMPLES WITH MACHINE VISION , 1998 .

[28]  Jasper Snoek,et al.  Multi-Task Bayesian Optimization , 2013, NIPS.

[29]  Kevin J. Gaston,et al.  Automating insect identification: exploring the limitations of a prototype system , 1999 .

[30]  Jun Lv,et al.  An Insect Imaging System to Automate Rice Light-Trap Pest Identification , 2012 .

[31]  Saleh M. Ashaghathra Identification of Pecan Weevils through image processing , 2008 .

[32]  Tae-Soo Chon,et al.  Automatic identification of whiteflies, aphids and thrips in greenhouse based on image analysis , 2007 .

[33]  Philipp Kirsch,et al.  Sex Pheromones and Their Impact on Pest Management , 2010, Journal of Chemical Ecology.

[34]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[35]  Jiangning Wang,et al.  A new automatic identification system of insect images at the order level , 2012, Knowl. Based Syst..

[36]  Thomas G. Dietterich,et al.  Automated processing and identification of benthic invertebrate samples , 2010, Journal of the North American Benthological Society.

[37]  J. Havel,et al.  Thrips (Thysanoptera) identification using artificial neural networks , 2008, Bulletin of Entomological Research.

[38]  Zhen Zhang,et al.  Auto-classification of insect images based on color histogram and GLCM , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[39]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[40]  Michael Mayo,et al.  Automatic species identification of live moths , 2006, Knowl. Based Syst..

[42]  Thomas G. Dietterich,et al.  Dictionary-free categorization of very similar objects via stacked evidence trees , 2009, CVPR.

[43]  E. R. Davies,et al.  AE—Automation and Emerging Technologies: Rapid Machine Vision Method for the Detection of Insects and other Particulate Bio-contaminants of Bulk Grain in Transit , 2002 .

[44]  Thomas G. Dietterich,et al.  Automated insect identification through concatenated histograms of local appearance features: feature vector generation and region detection for deformable objects , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[45]  Claus Nebauer,et al.  Evaluation of convolutional neural networks for visual recognition , 1998, IEEE Trans. Neural Networks.

[46]  Seung-Ho Kang,et al.  Identification of butterfly species with a single neural network system , 2012 .

[47]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[48]  Thomas G. Dietterich,et al.  Stacked spatial-pyramid kernel: An object-class recognition method to combine scores from random trees , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[49]  Thomas G. Dietterich,et al.  Haar Random Forest Features and SVM Spatial Matching Kernel for Stonefly Species Identification , 2010, 2010 20th International Conference on Pattern Recognition.

[50]  Adam Tofilski,et al.  DrawWing, a program for numerical description of insect wings. , 2004 .

[51]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[52]  Michael A. Wirth,et al.  Applicability of White-Balancing Algorithms to Restoring Faded Colour Slides: An Empirical Evaluation , 2008, J. Multim..

[53]  John K. Tsotsos,et al.  50 Years of object recognition: Directions forward , 2013, Comput. Vis. Image Underst..

[54]  Ring T. Cardé,et al.  CONTROL OF MOTH PESTS BY MATING DISRUPTION: Successes and Constraints , 1995 .

[55]  Ming-Quan Zhou,et al.  KNN-Spectral Regression LDA for Insect Recognition , 2009, 2009 First International Conference on Information Science and Engineering.