Mosquito Detection with Neural Networks: The Buzz of Deep Learning

Many real-world time-series analysis problems are characterised by scarce data. Solutions typically rely on hand-crafted features extracted from the time or frequency domain allied with classification or regression engines which condition on this (often low-dimensional) feature vector. The huge advances enjoyed by many application domains in recent years have been fuelled by the use of deep learning architectures trained on large data sets. This paper presents an application of deep learning for acoustic event detection in a challenging, data-scarce, real-world problem. Our candidate challenge is to accurately detect the presence of a mosquito from its acoustic signature. We develop convolutional neural networks (CNNs) operating on wavelet transformations of audio recordings. Furthermore, we interrogate the network's predictive power by visualising statistics of network-excitatory samples. These visualisations offer a deep insight into the relative informativeness of components in the detection problem. We include comparisons with conventional classifiers, conditioned on both hand-tuned and generic features, to stress the strength of automatic deep feature learning. Detection is achieved with performance metrics significantly surpassing those of existing algorithmic methods, as well as marginally exceeding those attained by individual human experts.

[1]  Stuart H. Gage,et al.  Automated Identification of Flying Insects by Analysis of Wingbeat Frequencies , 1986 .

[2]  Theodoros Giannakopoulos pyAudioAnalysis: An Open-Source Python Library for Audio Signal Analysis , 2015, PloS one.

[3]  Ishwar K. Sethi,et al.  Classification of general audio data for content-based retrieval , 2001, Pattern Recognit. Lett..

[4]  Ilyas Potamitis,et al.  Classifying insects on the fly , 2014, Ecol. Informatics.

[5]  C. Lengeler Insecticide-treated nets for malaria control: real gains. , 2004, Bulletin of the World Health Organization.

[6]  Grzegorz Gwardys,et al.  Deep Image Features in Music Information Retrieval , 2014 .

[7]  Hervé Glotin,et al.  LifeCLEF 2016: Multimedia Life Species Identification Challenges , 2016, CLEF.

[8]  Honglak Lee,et al.  Unsupervised feature learning for audio classification using convolutional deep belief networks , 2009, NIPS.

[9]  U. Dalrymple,et al.  The effect of malaria control on Plasmodium falciparum in Africa between 2000 and 2015 , 2015, Nature.

[10]  P. Basu,et al.  The Southern House Mosquito, Culex quinquefasciatus: profile of a smart vector , 2016 .

[11]  G. Clark,et al.  Sterile-insect methods for control of mosquito-borne diseases: an analysis. , 2010, Vector borne and zoonotic diseases.

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[14]  Yann LeCun,et al.  Feature learning and deep architectures: new directions for music informatics , 2013, Journal of Intelligent Information Systems.

[15]  Organização Mundial de Saúde,et al.  World malaria report 2011 , 2011 .

[16]  I. Daubechies,et al.  Synchrosqueezed wavelet transforms: An empirical mode decomposition-like tool , 2011 .

[17]  Jay Barlow,et al.  ACOUSTIC IDENTIFICATION OF NINE DELPHINID SPECIES IN THE EASTERN TROPICAL PACIFIC OCEAN , 2000 .

[18]  Haripriya Mukundarajan,et al.  Using Mobile Phones as Acoustic Sensors for High-throughput Surveillance of Mosquito Ecology , 2017 .

[19]  Andrzej Cichocki,et al.  Bump time-frequency toolbox: a toolbox for time-frequency oscillatory bursts extraction in electrophysiological signals , 2009, BMC Neuroscience.

[20]  Ilyas Potamitis,et al.  Deep learning for detection of bird vocalisations , 2016, ArXiv.

[21]  A. Medl,et al.  Time Frequency and Wavelets in Biomedical Signal Processing , 1998, IEEE Engineering in Medicine and Biology Magazine.

[22]  Geoff V. Merrett,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence A Hidden Markov Model-Based Acoustic Cicada Detector for , 2022 .

[23]  Daniel P. W. Ellis,et al.  Applying Machine Learning and Audio Analysis Techniques to Insect Recognition in Intelligent Traps , 2013, 2013 12th International Conference on Machine Learning and Applications.

[24]  Tara N. Sainath,et al.  Deep Convolutional Neural Networks for Large-scale Speech Tasks , 2015, Neural Networks.

[25]  Michael T. Johnson,et al.  AUTOMATIC TYPE CLASSIFICATION AND SPEAKER IDENTIFICATION OF AFRICAN ELEPHANT VOCALIZATIONS , 2002 .

[26]  Jacob Goldberger,et al.  Automatic acoustic detection of the red palm weevil , 2008 .

[27]  Eamonn J. Keogh,et al.  Flying Insect Classification with Inexpensive Sensors , 2014, Journal of Insect Behavior.

[28]  Andreas Rauber,et al.  LifeCLEF Bird Identification Task 2017 , 2017, CLEF.

[29]  E. D. Chesmore,et al.  Automated identification of field-recorded songs of four British grasshoppers using bioacoustic signal recognition , 2004, Bulletin of Entomological Research.

[30]  S. Parsons,et al.  Acoustic identification of twelve species of echolocating bat by discriminant function analysis and artificial neural networks. , 2000, The Journal of experimental biology.

[31]  Sazali Yaacob,et al.  Classification of speech dysfluencies with MFCC and LPCC features , 2012, Expert Syst. Appl..

[32]  Aixia Guo,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2014 .

[33]  Zhang Zhen,et al.  Insect Sound Recognition Based on SBC and HMM , 2010, 2010 International Conference on Intelligent Computation Technology and Automation.

[34]  Nikos Fakotakis,et al.  Automatic acoustic identification of crickets and cicadas , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.