Combining machine learning and a universal acoustic feature-set yields efficient automated monitoring of ecosystems

Natural habitats are being impacted by human pressures at an alarming rate. Monitoring these ecosystem-level changes often requires labour-intensive surveys that are unable to detect rapid or unanticipated environmental changes. Here we developed a generalisable, data-driven solution to this challenge using eco-acoustic data. We exploited a convolutional neural network to embed ecosystem soundscapes from a wide variety of biomes into a common acoustic space. In both supervised and unsupervised modes, this allowed us to accurately quantify variation in habitat quality across space and in biodiversity through time. On the scale of seconds, we learned a typical soundscape model that allowed automatic identification of anomalous sounds in playback experiments, paving the way for real-time detection of irregular environmental behaviour including illegal activity. Our highly generalisable approach, and the common set of features, will enable scientists to unlock previously hidden insights from eco-acoustic data and offers promise as a backbone technology for global collaborative autonomous ecosystem monitoring efforts.

[1]  Shunlin Liang,et al.  Advances in Land Remote Sensing : System, Modeling, Inversion and Application , 2019 .

[2]  Andreas Wilting,et al.  Risky business or simple solution – Relative abundance indices from camera-trapping , 2013 .

[3]  Aren Jansen,et al.  Audio Set: An ontology and human-labeled dataset for audio events , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  P. Vitousek Beyond Global Warming: Ecology and Global Change , 1994 .

[5]  David J. Rapport,et al.  What Constitutes Ecosystem Health? , 1989 .

[6]  Kate E. Jones,et al.  Emerging opportunities and challenges for passive acoustics in ecological assessment and monitoring , 2018, Methods in Ecology and Evolution.

[7]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[8]  Almo Farina,et al.  A new methodology to infer the singing activity of an avian community: The Acoustic Complexity Index (ACI) , 2011 .

[9]  Ray Lyman Wilbur A survey and a challenge. , 1931 .

[10]  Nancy Chinchor,et al.  MUC-4 evaluation metrics , 1992, MUC.

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  Patrice Guyot,et al.  Sounding out ecoacoustic metrics: Avian species richness is predicted by acoustic indices in temperate but not tropical habitats , 2018, Ecological Indicators.

[13]  C. D. Kurth,et al.  Accuracy of acoustic respiration rate monitoring in pediatric patients , 2013, Paediatric anaesthesia.

[14]  Bryan C. Pijanowski,et al.  A primer of acoustic analysis for landscape ecologists , 2011, Landscape Ecology.

[15]  Eben Goodale,et al.  Do acoustic indices correlate with bird diversity? Insights from two biodiverse regions in Yunnan Province, south China , 2017 .

[16]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction , 2018, ArXiv.

[17]  Paul Roe,et al.  A toolbox for animal call recognition , 2012 .

[18]  A. Budden,et al.  Big data and the future of ecology , 2013 .

[19]  Jérôme Sueur Indices for Ecoacoustics , 2018 .

[20]  T. Mitchell Aide,et al.  Real-time bioacoustics monitoring and automated species identification , 2013, PeerJ.

[21]  Nick S. Jones,et al.  Robust, real‐time and autonomous monitoring of ecosystems with an open, low‐cost, networked device , 2018 .

[22]  Aren Jansen,et al.  CNN architectures for large-scale audio classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  F. Baret,et al.  Estimating Canopy Characteristics from Remote Sensing Observations: Review of Methods and Associated Problems , 2008 .

[24]  Luis J. Villanueva-Rivera,et al.  Soundscape Ecology: The Science of Sound in the Landscape , 2011 .

[25]  Patricia A. Soranno,et al.  Macrosystems ecology: big data, big ecology , 2014 .

[26]  Gary D. Bernard,et al.  Applications of time-frequency analysis to signals from manufacturing and machine monitoring sensors , 1996, Proc. IEEE.

[27]  J Elliott,et al.  Continuous acoustic monitoring of grouted post-tensioned concrete bridges , 2001 .

[28]  Sandrine Pavoine,et al.  Rapid Acoustic Survey for Biodiversity Appraisal , 2008, PloS one.

[29]  O. Hoegh‐Guldberg,et al.  Ecological responses to recent climate change , 2002, Nature.

[30]  Jennifer N Solomon,et al.  Measuring and Monitoring Illegal Use of Natural Resources , 2010, Conservation biology : the journal of the Society for Conservation Biology.

[31]  T. Mitchell Aide,et al.  Forest recovery in abandoned tropical pastures in Puerto Rico , 1995 .

[32]  Robert C. Maher,et al.  Acoustical Characterization of Gunshots , 2007 .

[33]  Alex Rogers,et al.  AudioMoth: Evaluation of a smart open acoustic device for monitoring biodiversity and the environment , 2018 .

[34]  Jozef Papán,et al.  WSN for forest monitoring to prevent illegal logging , 2012, 2012 Federated Conference on Computer Science and Information Systems (FedCSIS).

[35]  T. Mitchell Aide,et al.  Species-specific audio detection: a comparison of three template-based detection algorithms using random forests , 2017, PeerJ Comput. Sci..

[36]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[37]  R. B. Jackson,et al.  Global biodiversity scenarios for the year 2100. , 2000, Science.

[38]  Stuart H. Gage,et al.  Connecting soundscape to landscape: Which acoustic index best describes landscape configuration? , 2015 .

[39]  Nils Bunnefeld,et al.  Guidelines for the use of acoustic indices in environmental research , 2019, Methods in Ecology and Evolution.

[40]  A. McMichael,et al.  Assessing ecosystem health. , 1998, Trends in ecology & evolution.

[41]  E. García‐Berthou,et al.  Invasive species are a leading cause of animal extinctions. , 2005, Trends in ecology & evolution.

[42]  Lenore Fahrig,et al.  A large-scale forest fragmentation experiment: the Stability of Altered Forest Ecosystems Project , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Janto Skowronek,et al.  Automatic surveillance of the acoustic activity in our living environment , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[44]  Milan Sigmund,et al.  Acoustical detection of gunshots , 2015, 2015 25th International Conference Radioelektronika (RADIOELEKTRONIKA).

[45]  DelWayne R. Bohnenstiehl,et al.  Investigating the utility of ecoacoustic metrics in marine soundscapes , 2018 .

[46]  V. Lefebvre,et al.  Deadwood biomass: an underestimated carbon stock in degraded tropical forests? , 2015 .

[47]  Aaron M Ellison,et al.  Observer bias and the detection of low-density populations. , 2009, Ecological applications : a publication of the Ecological Society of America.

[48]  William J Sutherland,et al.  Seasonal matching of habitat quality and fitness in a migratory bird , 2005, Proceedings of the Royal Society B: Biological Sciences.