Flying Insect Classification with Inexpensive Sensors

The ability to use inexpensive, noninvasive sensors to accurately classify flying insects would have significant implications for entomological research, and allow for the development of many useful applications in vector control for both medical and agricultural entomology. Given this, the last sixty years have seen many research efforts on this task. To date, however, none of this research has had a lasting impact. In this work, we explain this lack of progress. We attribute the stagnation on this problem to several factors, including the use of acoustic sensing devices, the overreliance on the single feature of wingbeat frequency, and the attempts to learn complex models with relatively little data. In contrast, we show that pseudo-acoustic optical sensors can produce vastly superior data, that we can exploit additional features, both intrinsic and extrinsic to the insect’s flight behavior, and that a Bayesian classification approach allows us to efficiently learn classification models that are very robust to overfitting. We demonstrate our findings with large scale experiments, as measured both by the number of insects and the number of species considered.

[1]  D. M. Unwin,et al.  An Optical Tachometer for Measurement of the Wing-Beat Frequency of Free-Flying Insects , 1979 .

[2]  Ronald N. Bracewell,et al.  The Fourier Transform and Its Applications , 1966 .

[3]  L. Prechelt,et al.  A quantitative study of experimental neural network learning algorithm evaluation practices , 1995 .

[4]  Steven W Lindsay,et al.  Importance of Eaves to House Entry by Anopheline, But Not Culicine, Mosquitoes , 2009, Journal of medical entomology.

[5]  Ralph P. Grimaldi Discrete and Combinatoral Mathematics: An Applied Introduction 2nd Ed. , 1989 .

[6]  Eamonn J. Keogh,et al.  Flying insect detection and classification with inexpensive sensors. , 2014, Journal of visualized experiments : JoVE.

[7]  L E Chadwick,et al.  Frequency of Wing-Beat as a Character for Separating Species Races and Geographic Varieties of Drosophila. , 1942, Genetics.

[8]  M C Kahn,et al.  RECORDING OF SOUNDS PRODUCED BY CERTAIN DISEASE-CARRYING MOSQUITOES. , 1945, Science.

[9]  Jingcheng Sun,et al.  Preliminary Analysis of Several Attractants and Spatial Repellents for the Mosquito, Aedes albopictus using an Olfactometer , 2012, Journal of insect science.

[10]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[11]  Xu Zhou,et al.  A LVQ-based neural network anti-spam email approach , 2005, OPSR.

[12]  A. V. Van Dam,et al.  The effect of predatory fish exudates on the ovipostional behaviour of three mosquito species: Culex quinquefasciatus, Aedes aegypti and Culex tarsalis , 2008, Medical and veterinary entomology.

[13]  Aubrey Moore,et al.  Automated Identification of Optically Sensed Aphid (Homoptera: Aphidae) Wingbeat Waveforms , 2002 .

[14]  M S Mulla,et al.  Studies on the bioecological aspects of adult mosquitoes in the Prado Basin of southern California. , 1990, Journal of the American Mosquito Control Association.

[15]  M. Rosenblatt Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[16]  Aubrey Moore,et al.  Artificial neural network trained to identify mosquitoes in flight , 1991, Journal of Insect Behavior.

[17]  G. W. Schaefer,et al.  An infra-red remote sensing system for the active detection and automatic determination of insect flight trajectories (IRADIT) , 1984 .

[18]  Vladimir Vapnik,et al.  Chervonenkis: On the uniform convergence of relative frequencies of events to their probabilities , 1971 .

[19]  Eamonn J. Keogh,et al.  Learning augmented Bayesian classifiers: A comparison of distribution-based and classification-based approaches , 1999, AISTATS.

[20]  Mark Q Benedict,et al.  The first releases of transgenic mosquitoes: an argument for the sterile insect technique. , 2003, Trends in parasitology.

[21]  Charles Elkan,et al.  The Foundations of Cost-Sensitive Learning , 2001, IJCAI.

[22]  Mark Rowland,et al.  The circadian flight activity of Aedes aegypti parasitized with the filarial nematode Brugia pahangi , 1986 .

[23]  Michele Banko,et al.  Mitigating the Paucity-of-Data Problem: Exploring the Effect of Training Corpus Size on Classifier Performance for Natural Language Processing , 2001, HLT.

[24]  Peter Norvig,et al.  The Unreasonable Effectiveness of Data , 2009, IEEE Intelligent Systems.

[25]  G. Duffield,et al.  Strain- and sex-specific differences in daily flight activity and the circadian clock of Anopheles gambiae mosquitoes. , 2012, Journal of insect physiology.

[26]  M. D. Jones,et al.  The circadian rhythm of flight activity in the mosquito Aedes aegypti (L.). The phase-setting effects of light-on and light-off. , 1969, The Journal of experimental biology.

[27]  M. Deakin Formulae for Insect Wingbeat Frequency , 2010, Journal of insect science.

[28]  Lu Xianliang,et al.  A LVQ-based neural network anti-spam email approach , 2005 .

[29]  Joel Cummings Encyclopedia of Entomology , 2013 .

[30]  P. Papathanos,et al.  Sex separation strategies: past experience and new approaches , 2009, Malaria Journal.

[31]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[32]  Eamonn Keogh,et al.  Monitoring and Mining Animal Sounds in Visual Space , 2012, Journal of Insect Behavior.

[33]  Miriam F. Cooperband,et al.  Landing Surface Color Preferences of Spathius agrili (Hymenoptera: Braconidae), a Parasitoid of Emerald Ash Borer, Agrilus planipennis (Coleoptera: Buprestidae) , 2013, Journal of Insect Behavior.

[34]  Zuorui Shen,et al.  Automated Identification of Mosquito (Diptera: Culicidae) Wingbeat Waveform by Artificial Neural Network , 2005, AIAI.

[35]  B. TAYLOR,et al.  Geographical Range and Circadian Rhythms , 1969, Nature.

[36]  D. R. Raman,et al.  Detecting Insect Flight Sounds in the Field: Implications for Acoustical Counting of Mosquitoes , 2007 .

[37]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[38]  G. Georghiou,et al.  Influence of Exposure to Single versus Multiple Toxins of Bacillus thuringiensis subsp. israelensis on Development of Resistance in the Mosquito Culex quinquefasciatus (Diptera: Culicidae) , 1997, Applied and environmental microbiology.

[39]  P. Mermelstein,et al.  Distance measures for speech recognition, psychological and instrumental , 1976 .

[40]  M C KAHN,et al.  The identification of certain West African mosquitoes by sound. , 1949, The American journal of tropical medicine and hygiene.

[41]  Agenor Mafra-Neto,et al.  SIGKDD demo: sensors and software to allow computational entomology, an emerging application of data mining , 2011, KDD.

[42]  S. Boll,et al.  Suppression of acoustic noise in speech using spectral subtraction , 1979 .

[43]  Christopher Melton,et al.  Optical detection of honeybees by use of wing-beat modulation of scattered laser light for locating explosives and land mines. , 2006, Applied optics.

[44]  Peter Belton,et al.  FLIGHT SOUNDS OF THE FEMALES OF SOME MOSQUITOES OF WESTERN CANADA , 1979 .

[45]  Gerhard Widmer,et al.  Learning in the Presence of Concept Drift and Hidden Contexts , 1996, Machine Learning.

[46]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[47]  Alexey Tsymbal,et al.  The problem of concept drift: definitions and related work , 2004 .

[48]  W. L. Bidlingmayer,et al.  Effect of wind velocity on suction trap catches of some Florida mosquitoes. , 1995, Journal of the American Mosquito Control Association.

[49]  Eamonn J. Keogh,et al.  DTW-D: time series semi-supervised learning from a single example , 2013, KDD.

[50]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[51]  Sten Wahlström Parornix atripalpella n.sp. from SE Sweden (Lepidoptera: Gracillariidae) , 1979 .

[52]  Douglas W. Tallamy,et al.  Density And Diversity Of Nontarget Insects Killed By Suburban Electric Insect Traps , 1996 .

[53]  R. Jones,et al.  Field testing of a Prototype Acoustic d evice for d etection of Mediterranean Fruit Flies Flying into a trap , 2008 .

[54]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[55]  Olavi Sotavalta,et al.  The flight-tone (wing-stroke frequency) of insects (Contributions to the problem of insect flight 1.) , 1947 .

[56]  Ephraim Speech enhancement using a minimum mean square error short-time spectral amplitude estimator , 1984 .

[57]  Stuart H. Gage,et al.  Automated Identification of Flying Insects by Analysis of Wingbeat Frequencies , 1986 .

[58]  Lutz Prechelt A quantitative study of neural network learning algorithm evaluation practices , 1995 .

[59]  M. Rosenblatt,et al.  Multivariate k-nearest neighbor density estimates , 1979 .

[60]  P. Armbruster,et al.  Inbreeding depression affects life-history traits but not infection by Plasmodium gallinaceum in the Asian tiger mosquito, Aedes albopictus. , 2010, Infection, genetics and evolution : journal of molecular epidemiology and evolutionary genetics in infectious diseases.