Visualizing five decades of environmental acoustic data

Monitoring the environment with acoustic sensors is now practical; sensors are sold as commercial devices, storage is cheap, and the field of ecoacoustics is recognized as an effective way to scale monitoring of the environment. However, a pressing challenge faced in many eScience projects is how to manage, analyze, and visualize very large data so that scientists can benefit, with ecoacoustic data presenting its own particular challenges. This paper presents a new zoomable interactive visualization interface for the exploration of environmental audio data. The interface is a new tool in the Acoustic Workbench, an ecoacoustics software platform built for managing environmental audio data. This Google Maps like interface for audio data, enables zooming in and out of audio data by incorporating specialized, multiresolution, visual representations of audio data into the workbench website. The ‘zooming’ visualization allows scientists to surface the structure, detail, and patterns in content that would otherwise be opaque to them, from scales of seconds through to weeks of data. The Ecosounds instance of the Acoustic Workbench contains 52 years (108 TB) of audio data, from 1016 locations, which results in a 180 million-tile, 8.3 terapixel visualization. The design and implementation of this novel big audio data visualization is presented along with some design considerations for storing visualization tiles.

[1]  Paul Roe,et al.  The Navigation and Visualisation of Environmental Audio Using Zooming Spectrograms , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[2]  Sarah L. Dumyahn,et al.  What is soundscape ecology? An introduction and overview of an emerging new science , 2011, Landscape Ecology.

[3]  Michael Towsey The calculation of acoustic indices to characterise acoustic recordings of the environment , 2012 .

[4]  Almo Farina,et al.  The Role of Sound in Terrestrial Ecosystems: Three Case Examples from Michigan, USA , 2017 .

[5]  Bryan C. Pijanowski,et al.  Pumilio: A Web‐Based Management System for Ecological Recordings , 2012 .

[6]  Luigi Piccioli,et al.  Avian soundscapes and cognitive landscapes: theory, application and ecological perspectives , 2011, Landscape Ecology.

[7]  Margot Brereton,et al.  An Investigation into Acoustic Analysis Methods for Endangered Species Monitoring: A Case of Monitoring the Critically Endangered White-Bellied Heron in Bhutan , 2017, 2017 IEEE 13th International Conference on e-Science (e-Science).

[8]  Klaus Riede,et al.  Automatic bird sound detection in long real-field recordings: Applications and tools , 2014 .

[9]  Jonathan Foote,et al.  An overview of audio information retrieval , 1999, Multimedia Systems.

[10]  Sandrine Pavoine,et al.  Rapid Acoustic Survey for Biodiversity Appraisal , 2008, PloS one.

[11]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[12]  Paul Roe,et al.  Practical Analysis of Big Acoustic Sensor Data for Environmental Monitoring , 2014, 2014 IEEE Fourth International Conference on Big Data and Cloud Computing.

[13]  Peter Z. Kunszt,et al.  The SDSS skyserver: public access to the sloan digital sky server data , 2001, SIGMOD '02.

[14]  Sandrine Pavoine,et al.  Assessing biodiversity with sound: Do acoustic diversity indices reflect phylogenetic and functional diversities of bird communities? , 2013 .

[15]  Almo Farina,et al.  A new methodology to infer the singing activity of an avian community: The Acoustic Complexity Index (ACI) , 2011 .

[16]  Margot Brereton,et al.  Collaborative Exploration and Sensemaking of Big Environmental Sound Data , 2017, Computer Supported Cooperative Work (CSCW).

[17]  Nadia Pieretti,et al.  Acoustic Indices for Biodiversity Assessment and Landscape Investigation , 2014 .

[18]  Thomas S. Huang,et al.  Improving faster-than-real-time human acoustic event detection by saliency-maximized audio visualization , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Michael Friendly,et al.  A Brief History of Data Visualization , 2008 .

[20]  Russ Rew,et al.  NetCDF: an interface for scientific data access , 1990, IEEE Computer Graphics and Applications.

[21]  Michael W. Towsey,et al.  Visualization of Long-duration Acoustic Recordings of the Environment , 2014, ICCS.

[22]  T. Mitchell Aide,et al.  Real-time bioacoustics monitoring and automated species identification , 2013, PeerJ.

[23]  Paul Roe,et al.  Long-duration, false-colour spectrograms for detecting species in large audio data-sets , 2018 .

[24]  Paul Roe,et al.  Analysing environmental acoustic data through collaboration and automation , 2013, Future Gener. Comput. Syst..

[25]  Almo Farina,et al.  Ecoacoustics: the Ecological Investigation and Interpretation of Environmental Sound , 2015, Biosemiotics.

[26]  Martin Thomson,et al.  Hypertext Transfer Protocol Version 2 (HTTP/2) , 2015, RFC.

[27]  Paul Roe,et al.  Revealing the ecological content of long-duration audio-recordings of the environment through clustering and visualisation , 2018, PloS one.

[28]  Alex Rogers,et al.  AudioMoth: Evaluation of a smart open acoustic device for monitoring biodiversity and the environment , 2018 .

[29]  Eric P. Kasten,et al.  The remote environmental assessment laboratory's acoustic library: An archive for studying soundscape ecology , 2012, Ecol. Informatics.