Emerging opportunities and challenges for passive acoustics in ecological assessment and monitoring

1. High-throughput environmental sensing technologies are increasingly central to global monitoring of the ecological impacts of human activities. In particular, the recent boom in passive acoustic sensors has provided efficient, noninvasive, and taxonomically broad means to study wildlife populations and communities, and monitor their responses to environmental change. However, until recently, tech-nological costs and constraints have largely confined research in passive acoustic monitoring (PAM) to a handful of taxonomic groups (e.g., bats, cetaceans, birds), often in relatively small-scale, proof-of-concept studies.2. The arrival of low-cost, open-source sensors is now rapidly expanding access to PAM technologies, making it vital to evaluate where these tools can contribute to broader efforts in ecology and biodiversity research. Here, we synthesise and critically assess the current emerging opportunities and challenges for PAM for ecological assessment and monitoring of both species populations and communities.3. We show that terrestrial and marine PAM applications are advancing rapidly, fa-cilitated by emerging sensor hardware, the application of machine learning inno-vations to automated wildlife call identification, and work towards developing acoustic biodiversity indicators. However, the broader scope of PAM research remains constrained by limited availability of reference sound libraries and open-source audio processing tools, especially for the tropics, and lack of clarity around the accuracy, transferability and limitations of many analytical methods.4. In order to improve possibilities for PAM globally, we emphasise the need for col-laborative work to develop standardised survey and analysis protocols, publicly archived sound libraries, multiyear audio datasets, and a more robust theoretical and analytical framework for monitoring vocalising animal communities.

[1]  V. Janik,et al.  Vocal copying of individually distinctive signature whistles in bottlenose dolphins , 2013, Proceedings of the Royal Society B: Biological Sciences.

[2]  Tereza Petrusková,et al.  Repertoire‐based individual acoustic monitoring of a migratory passerine bird with complex song as an efficient tool for tracking territorial dynamics and annual return rates , 2016 .

[3]  S. Newson,et al.  A novel citizen science approach for large-scale standardised monitoring of bat activity and distribution, evaluated in eastern England , 2015 .

[4]  Wilson J. Wright,et al.  Improving geographically extensive acoustic survey designs for modeling species occurrence with imperfect detection and misidentification , 2018, Ecology and evolution.

[5]  Haripriya Mukundarajan,et al.  Using mobile phones as acoustic sensors for high-throughput mosquito surveillance , 2017, eLife.

[6]  Nick S. Jones,et al.  Robust, real-time and autonomous monitoring of ecosystems with an open, low-cost, networked device , 2017, bioRxiv.

[7]  Jonathan Krause,et al.  The Unreasonable Effectiveness of Noisy Data for Fine-Grained Recognition , 2015, ECCV.

[8]  David B. Roy,et al.  Statistics for citizen science: extracting signals of change from noisy ecological data , 2014 .

[9]  Dan Stowell,et al.  Automatic large-scale classification of bird sounds is strongly improved by unsupervised feature learning , 2014, PeerJ.

[10]  Mark Girolami,et al.  Bat Detective - Deep Learning Tools for Bat Acoustic Signal Detection , 2017 .

[11]  Ilse van Opzeeland,et al.  Management and research applications of real-time and archival passive acoustic sensors over varying temporal and spatial scales , 2009 .

[12]  Bharath Hariharan,et al.  Low-Shot Visual Recognition by Shrinking and Hallucinating Features , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Lars Bejder,et al.  Studying cetacean behaviour: new technological approaches and conservation applications , 2016, Animal Behaviour.

[14]  P. Tyack,et al.  Estimating animal population density using passive acoustics , 2012, Biological reviews of the Cambridge Philosophical Society.

[15]  Michael Towsey,et al.  A practical comparison of manual and autonomous methods for acoustic monitoring , 2013 .

[16]  Andreas M. Ali,et al.  Acoustic monitoring in terrestrial environments using microphone arrays: applications, technological considerations and prospectus , 2011 .

[17]  D. Macdonald,et al.  Passive acoustic monitoring as a law enforcement tool for Afrotropical rainforests , 2017 .

[18]  Heiko Balzter,et al.  Connecting Earth observation to high-throughput biodiversity data , 2017, Nature Ecology &Evolution.

[19]  Oliver Durr,et al.  Speaker identification and clustering using convolutional neural networks , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[20]  R. McCauley,et al.  Settlement-stage coral reef fish prefer the higher-frequency invertebrate-generated audible component of reef noise , 2008, Animal Behaviour.

[21]  Peter L. Tyack,et al.  A digital acoustic recording tag for measuring the response of wild marine mammals to sound , 2003 .

[22]  Christopher W. Clark,et al.  Long-term passive acoustic recordings track the changing distribution of North Atlantic right whales (Eubalaena glacialis) from 2004 to 2014 , 2017, Scientific Reports.

[23]  F. Fischer,et al.  QUANTITATIVE ASSESSMENT OF GRASSLAND QUALITY: ACOUSTIC DETERMINATION OF POPULATION SIZES OF ORTHOPTERAN INDICATOR SPECIES , 1997 .

[24]  Michael A. Casey,et al.  A New Method for Ecoacoustics? Toward the Extraction and Evaluation of Ecologically-Meaningful Sound Objects using Sparse Coding Methods , 2016, PeerJ Prepr..

[25]  Y. Yovel,et al.  Everyday bat vocalizations contain information about emitter, addressee, context, and behavior , 2016, Scientific Reports.

[26]  Martin Šálek,et al.  The assessment of biases in the acoustic discrimination of individuals , 2017, PloS one.

[27]  Jack W. Bradbury,et al.  Principles of Animal Communication , 1998 .

[28]  Justin Salamon,et al.  Unsupervised feature learning for urban sound classification , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Sandrine Pavoine,et al.  Acoustic indices for biodiversity assessments: Analyses of bias based on simulated bird assemblages and recommendations for field surveys , 2015 .

[30]  Hjalmar S. Kühl,et al.  Assessing the performance of a semi‐automated acoustic monitoring system for primates , 2015 .

[31]  Hjalmar S. Kühl,et al.  Towards the automated detection and occupancy estimation of primates using passive acoustic monitoring , 2015 .

[32]  Julie N. Oswald,et al.  A review and inventory of fixed autonomous recorders for passive acoustic monitoring of marine mammals: 2013 state-of-the-industry , 2013, 2013 IEEE/OES Acoustics in Underwater Geosciences Symposium.

[33]  Mya E. Thompson,et al.  Heard but not seen: an acoustic survey of the African forest elephant population at Kakum Conservation Area, Ghana , 2010 .

[34]  Peter L. Tyack,et al.  The Watkins Marine Mammal Sound Database: An online, freely accessible resource , 2016 .

[35]  Nathan D. Merchant,et al.  Underwater noise modelling for environmental impact assessment , 2016 .

[36]  Ramon Ferrer-i-Cancho,et al.  Acoustic sequences in non‐human animals: a tutorial review and prospectus , 2016, Biological reviews of the Cambridge Philosophical Society.

[37]  Fahrurrozi,et al.  Measuring sound detection spaces for acoustic animal sampling and monitoring , 2016 .

[38]  Alex Rogers,et al.  AudioMoth: Evaluation of a smart open acoustic device for monitoring biodiversity and the environment , 2018 .

[39]  Nick T. Shears,et al.  Ecoacoustic indices as proxies for biodiversity on temperate reefs , 2016 .

[40]  Mark F Baumgartner,et al.  A generalized baleen whale call detection and classification system. , 2011, The Journal of the Acoustical Society of America.

[41]  Richard D. Gregory,et al.  Bird census and survey techniques , 2004 .

[42]  C. Kerbiriou,et al.  Use of Large‐Scale Acoustic Monitoring to Assess Anthropogenic Pressures on Orthoptera Communities , 2013, Conservation biology : the journal of the Society for Conservation Biology.

[43]  Kate E. Jones,et al.  CityNet—Deep learning tools for urban ecoacoustic assessment , 2018, Methods in Ecology and Evolution.

[44]  Eric P. Kasten,et al.  The remote environmental assessment laboratory's acoustic library: An archive for studying soundscape ecology , 2012, Ecol. Informatics.

[45]  Hervé Glotin,et al.  LifeCLEF Bird Identification Task 2016: The arrival of Deep learning , 2016, CLEF.

[46]  Len Thomas,et al.  Passive acoustic monitoring of the decline of Mexico's critically endangered vaquita , 2017, Conservation biology : the journal of the Society for Conservation Biology.

[47]  Holger Klinck,et al.  NEPAN: A U. S. Northeast Passive Acoustic Sensing Network for Monitoring, Reducing Threats and the Conservation of Marine Animals , 2015 .

[48]  Abeer Alwan,et al.  A robust automatic birdsong phrase classification: A template-based approach. , 2016, The Journal of the Acoustical Society of America.

[49]  Dena J. Clink,et al.  Investigating Individual Vocal Signatures and Small-Scale Patterns of Geographic Variation in Female Bornean Gibbon (Hylobates muelleri) Great Calls , 2017, International Journal of Primatology.

[50]  Kate E. Jones,et al.  A generalised random encounter model for estimating animal density with remote sensor data , 2015, Methods in ecology and evolution.

[51]  Kate E. Jones,et al.  Acoustic identification of Mexican bats based on taxonomic and ecological constraints on call design , 2016 .

[52]  G. Daily,et al.  Biodiversity loss and its impact on humanity , 2012, Nature.

[53]  Hervé Glotin,et al.  Automatic acoustic detection of birds through deep learning: The first Bird Audio Detection challenge , 2018, Methods in Ecology and Evolution.

[54]  S. Newson,et al.  Potential for coupling the monitoring of bush‐crickets with established large‐scale acoustic monitoring of bats , 2017 .

[55]  A. Thode,et al.  PAMGUARD : SEMIAUTOMATED , OPEN SOURCE SOFTWARE FOR REAL-TIME ACOUSTIC DETECTION AND LOCALISATION OF CETACEANS , 2008 .

[56]  Anthony D. Hawkins,et al.  A comparison of inshore marine soundscapes , 2013 .

[57]  Len Thomas,et al.  Passive acoustic density estimation of sperm whales in the Tongue of the Ocean, Bahamas , 2012 .

[58]  Mark Johnson,et al.  Real-time reporting of baleen whale passive acoustic detections from ocean gliders. , 2013, The Journal of the Acoustical Society of America.

[59]  J. Gordon,et al.  Acoustic monitoring to document the spatial distribution and hotspots of blast fishing in Tanzania. , 2017, Marine pollution bulletin.

[60]  Almo Farina,et al.  The acoustic communities: Definition, description and ecological role , 2016, Biosyst..

[61]  J. Honrado,et al.  Fostering integration between biodiversity monitoring and modelling , 2016 .

[62]  James Christie,et al.  Solo: an open source, customizable and inexpensive audio recorder for bioacoustic research , 2017 .

[63]  Christopher W. Clark,et al.  MobySound: A reference archive for studying automatic recognition of marine mammal sounds , 2006 .

[64]  Yves Bas,et al.  Tadarida: A Toolbox for Animal Detection on Acoustic Recordings , 2017 .

[65]  Kate E. Jones,et al.  Challenges of Using Bioacoustics to Globally Monitor Bats , 2013 .

[66]  Kate E. Jones,et al.  Indicator bats program: A system for the global acoustic monitoring of bats , 2013 .

[67]  I. Elamvazuthi,et al.  Voice Recognition Algorithms using Mel Frequency Cepstral Coefficient (MFCC) and Dynamic Time Warping (DTW) Techniques , 2010, ArXiv.

[68]  Margaret Kosmala,et al.  Automatically identifying wild animals in camera trap images with deep learning , 2017, ArXiv.

[69]  Alec J. Duncan,et al.  A review of current marine mammal detection and classification algorithms for use in automated passive acoustic monitoring , 2013 .

[70]  Nadia Pieretti,et al.  Acoustic Indices for Biodiversity Assessment and Landscape Investigation , 2014 .

[71]  Christian Dietz,et al.  A continental-scale tool for acoustic identification of European bats , 2012 .

[72]  K. Frommolt,et al.  Baseline data for automated acoustic monitoring of Orthoptera in a Mediterranean landscape, the Hymettos, Greece , 2014, Journal of Insect Conservation.

[73]  Klaus Riede,et al.  Monitoring Biodiversity: Analysis of Amazonian Rainforest Sounds , 2016 .

[74]  Helena Titheridge,et al.  Biases of acoustic indices measuring biodiversity in urban areas , 2017 .

[75]  Marie A. Roch,et al.  Management of acoustic metadata for bioacoustics , 2016, Ecol. Informatics.

[76]  Peter H. Wrege,et al.  Acoustic monitoring for conservation in tropical forests: examples from forest elephants , 2017 .

[77]  David L. Borchers,et al.  A general framework for animal density estimation from acoustic detections across a fixed microphone array , 2015 .

[78]  Lk Gentle,et al.  Identifying individual wild Eastern grey wolves (Canis lupus lycaon) using fundamental frequency and amplitude of howls , 2014 .

[79]  Evan H. Campbell Grant,et al.  Uncertainty in biological monitoring: a framework for data collection and analysis to account for multiple sources of sampling bias , 2016 .

[80]  M. Girolami,et al.  Bat echolocation call identification for biodiversity monitoring: a probabilistic approach , 2018 .

[81]  Rachel T. Buxton,et al.  Noise pollution is pervasive in U.S. protected areas , 2017, Science.

[82]  C. Erbe,et al.  Patterns of biophonic periodicity on coral reefs in the Great Barrier Reef , 2017, Scientific Reports.

[83]  K. Bollmann,et al.  Optimizing passive acoustic sampling of bats in forests , 2014, Ecology and evolution.

[84]  S. Brandl,et al.  Bioacoustic measurements complement visual biodiversity surveys: preliminary evidence from four shallow marine habitats , 2017 .

[85]  Mark A. Girolami,et al.  Putting the Scientist in the Loop -- Accelerating Scientific Progress with Interactive Machine Learning , 2014, 2014 22nd International Conference on Pattern Recognition.

[86]  Sandrine Pavoine,et al.  Assessing biodiversity with sound: Do acoustic diversity indices reflect phylogenetic and functional diversities of bird communities? , 2013 .

[87]  Almo Farina,et al.  A new methodology to infer the singing activity of an avian community: The Acoustic Complexity Index (ACI) , 2011 .

[88]  Christopher B Sturdy,et al.  Anthropogenic noise decreases urban songbird diversity and may contribute to homogenization , 2013, Global change biology.

[89]  R. McCleery,et al.  Mobile acoustic transects miss rare bat species: implications of survey method and spatio-temporal sampling for monitoring bats , 2017, PeerJ.

[90]  Sarah L. Dumyahn,et al.  What is soundscape ecology? An introduction and overview of an emerging new science , 2011, Landscape Ecology.

[91]  Sandrine Pavoine,et al.  Rapid Acoustic Survey for Biodiversity Appraisal , 2008, PloS one.

[92]  M. Holderied,et al.  Soundscapes and living communities in coral reefs: Temporal and spatial variation , 2015 .

[93]  Nathan D. Merchant,et al.  Quantifying the effect of boat disturbance on bottlenose dolphin foraging activity , 2015 .

[94]  Hervé Glotin,et al.  Bird detection in audio: A survey and a challenge , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[95]  Amanda M. Adams,et al.  Do you hear what I hear? Implications of detector selection for acoustic monitoring of bats , 2012 .

[96]  Kimberly Maute,et al.  HETEROSPECIFIC FACILITATION OF FOREST-BOUNDARY CROSSING BY MOBBING UNDERSTORY BIRDS IN NORTH-CENTRAL FLORIDA , 2004 .

[97]  Robert Planqué,et al.  Species interactions and the structure of complex communication networks , 2014, Proceedings of the National Academy of Sciences.

[98]  Justin Salamon,et al.  Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification , 2016, IEEE Signal Processing Letters.

[99]  Peter L Tyack,et al.  Measuring acoustic habitats , 2015, Methods in ecology and evolution.

[100]  F. Jiguet,et al.  Monitoring temporal change of bird communities with dissimilarity acoustic indices , 2014 .

[101]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[102]  S. Newson,et al.  Predicting the likely impact of urbanisation on bat populations using citizen science data, a case study for Norfolk, UK , 2017 .

[103]  T. Mitchell Aide,et al.  Real-time bioacoustics monitoring and automated species identification , 2013, PeerJ.

[104]  Jeffrey J. Buler,et al.  Management and research applications of long-range surveillance radar data for birds, bats, and flying insects , 2008 .

[105]  M. Willig,et al.  Bird biodiversity assessments in temperate forest: the value of point count versus acoustic monitoring protocols , 2015, PeerJ.

[106]  Geoff V. Merrett,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence A Hidden Markov Model-Based Acoustic Cicada Detector for , 2022 .

[107]  T. Mitchell Aide,et al.  Improving distribution data of threatened species by combining acoustic monitoring and occupancy modelling , 2016 .