Parsing Birdsong with Deep Audio Embeddings

Monitoring of bird populations has played a vital role in conservation efforts and in understanding biodiversity loss. The automation of this process has been facilitated by both sensing technologies, such as passive acoustic monitoring, and accompanying analytical tools, such as deep learning. However, machine learning models frequently have difficulty generalizing to examples not encountered in the training data. In our work, we present a semisupervised approach to identify characteristic calls and environmental noise. We utilize several methods to learn a latent representation of audio samples, including a convolutional autoencoder and two pre-trained networks, and group the resulting embeddings for a domain expert to identify cluster labels. We show that our approach can improve classification precision and provide insight into the latent structure of environmental acoustic datasets.

[1]  N. Pettorelli,et al.  Satellite remote sensing for applied ecologists: opportunities and challenges , 2014 .

[2]  M Donn,et al.  Listen and learn. , 1990, The Health service journal.

[3]  Aren Jansen,et al.  CNN architectures for large-scale audio classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[5]  Lucy Rosenbloom arXiv , 2019, The Charleston Advisor.

[6]  Connor M Wood,et al.  Acoustic monitoring reveals a diverse forest owl community, illustrating its potential for basic and applied ecology. , 2019, Ecology.

[7]  J. Andrew Royle,et al.  Scaling-up camera traps: monitoring the planet's biodiversity with networks of remote sensors , 2017 .

[8]  C. Carbone,et al.  Surveys using camera traps: are we looking to a brighter future? , 2008 .

[9]  Andreas M. Ali,et al.  Acoustic monitoring in terrestrial environments using microphone arrays: applications, technological considerations and prospectus , 2011 .

[10]  Tim Sainburg,et al.  Finding, visualizing, and quantifying latent structure across diverse animal vocal repertoires , 2020, PLoS Comput. Biol..

[11]  Hugo F. Posada-Quintero,et al.  Uniform Manifold Approximation and Projection for Clustering Taxa through Vocalizations in a Neotropical Passerine (Rough-Legged Tyrannulet, Phyllomyias burmeisteri) , 2020, Animals : an open access journal from MDPI.

[12]  Characterising soundscapes across diverse ecosystems using a universal acoustic feature- , 2020 .

[13]  Lorenzo Picinali,et al.  Characterizing soundscapes across diverse ecosystems using a universal acoustic feature set , 2020, Proceedings of the National Academy of Sciences.

[14]  Justin Salamon,et al.  Look, Listen, and Learn More: Design Choices for Deep Audio Embeddings , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Stefan Kahl,et al.  BirdNET: A deep learning solution for avian diversity monitoring , 2021, Ecol. Informatics.

[16]  Mark D. Plumbley,et al.  PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition , 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[17]  S. Stanbury Visualizing , 2019, A New Companion to Chaucer.

[18]  Dena J. Clink,et al.  Unsupervised acoustic classification of individual gibbon females and the implications for passive acoustic monitoring , 2020, Methods in Ecology and Evolution.

[19]  Luc Van Gool,et al.  European conference on computer vision (ECCV) , 2006, eccv 2006.

[20]  A. F. O'connell,et al.  Camera traps in animal ecology : methods and analyses , 2011 .

[21]  R. Freckleton,et al.  Methods in Ecology and Evolution , 2010 .

[22]  Thomas Hofmann,et al.  Audio Based Bird Species Identification using Deep Learning Techniques , 2016, CLEF.

[23]  Aren Jansen,et al.  Audio Set: An ontology and human-labeled dataset for audio events , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Margarita Mulero-Pázmány,et al.  Drones for Conservation in Protected Areas: Present and Future , 2019, Drones.

[25]  Jessica C. Stanton,et al.  Decline of the North American avifauna , 2019, Science.

[26]  S. Wich,et al.  Dawn of Drone Ecology: Low-Cost Autonomous Aerial Vehicles for Conservation , 2012 .

[27]  Zejun Ma,et al.  Contrastive Unsupervised Learning for Audio Fingerprinting , 2020, ArXiv.

[28]  Diego Llusia,et al.  Terrestrial Passive Acoustic Monitoring: Review and Perspectives , 2018, BioScience.

[29]  Antonio Torralba,et al.  SoundNet: Learning Sound Representations from Unlabeled Video , 2016, NIPS.