An FPGA-Based WASN for Remote Real-Time Monitoring of Endangered Species: A Case Study on the Birdsong Recognition of Botaurus stellaris

Fast environmental variations due to climate change can cause mass decline or even extinctions of species, having a dramatic impact on the future of biodiversity. During the last decade, different approaches have been proposed to track and monitor endangered species, generally based on costly semi-automatic systems that require human supervision adding limitations in coverage and time. However, the recent emergence of Wireless Acoustic Sensor Networks (WASN) has allowed non-intrusive remote monitoring of endangered species in real time through the automatic identification of the sound they emit. In this work, an FPGA-based WASN centralized architecture is proposed and validated on a simulated operation environment. The feasibility of the architecture is evaluated in a case study designed to detect the threatened Botaurus stellaris among other 19 cohabiting birds species in The Parc Natural dels Aiguamolls de l’Empordà, showing an averaged recognition accuracy of 91% over 2h 55’ of representative data. The FPGA-based feature extraction implementation allows the system to process data from 30 acoustic sensors in real time with an affordable cost. Finally, several open questions derived from this research are discussed to be considered for future works.

[1]  Joan Claudi Socoró,et al.  Analysis and automatic detection of anomalous noise events in real recordings of road traffic noise for the LIFE DYNAMAP project , 2016 .

[2]  Chang-Hsing Lee,et al.  Automatic Recognition of Bird Songs Using Cepstral Coefficients , 2006 .

[3]  Panu Somervuo,et al.  Parametric Representations of Bird Sounds for Automatic Species Recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  Thomas Hofmann,et al.  Audio Based Bird Species Identification using Deep Learning Techniques , 2016, CLEF.

[5]  Mohammed Bahoura,et al.  FPGA Implementation of Blue Whale Calls Classifier Using High-Level Programming Tool , 2016 .

[6]  Eduardo de la Torre,et al.  Using SRAM Based FPGAs for Power-Aware High Performance Wireless Sensor Networks , 2012, Sensors.

[7]  Khaled Ben Letaief,et al.  Mobile Edge Computing: Survey and Research Outlook , 2017, ArXiv.

[8]  T. Mitchell Aide,et al.  Real-time bioacoustics monitoring and automated species identification , 2013, PeerJ.

[9]  Charles E Taylor,et al.  Automated species recognition of antbirds in a Mexican rainforest using hidden Markov models. , 2008, The Journal of the Acoustical Society of America.

[10]  Dan Stowell,et al.  Automatic large-scale classification of bird sounds is strongly improved by unsupervised feature learning , 2014, PeerJ.

[11]  Peter Jancovic,et al.  Automatic Detection and Recognition of Tonal Bird Sounds in Noisy Environments , 2011, EURASIP J. Adv. Signal Process..

[12]  Hervé Glotin,et al.  LifeCLEF Bird Identification Task 2016: The arrival of Deep learning , 2016, CLEF.

[13]  Sumei Liang,et al.  Audio Content Classification Method Research Based on Two-step Strategy , 2014 .

[14]  Frank Kurth,et al.  Detecting bird sounds in a complex acoustic environment and application to bioacoustic monitoring , 2010, Pattern Recognit. Lett..

[15]  Michael Towsey,et al.  A practical comparison of manual and autonomous methods for acoustic monitoring , 2013 .

[16]  Justin Salamon,et al.  Unsupervised feature learning for urban sound classification , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Klaus Riede,et al.  Automatic bird sound detection in long real-field recordings: Applications and tools , 2014 .

[18]  Joan Claudi Socoró,et al.  A Review of Physical and Perceptual Feature Extraction Techniques for Speech, Music and Environmental Sounds , 2016 .

[19]  Ragunathan Rajkumar,et al.  Critical power slope: understanding the runtime effects of frequency scaling , 2002, ICS '02.

[20]  Robert Planqué,et al.  The Xeno-canto Collection and its Relation to Sound Recognition and Classification , 2015, CLEF.

[21]  Todor Ganchev,et al.  Audio parameterization with robust frame selection for improved bird identification , 2015, Expert Syst. Appl..

[22]  Bálint Tóth,et al.  Convolutional Neural Networks for Large-Scale Bird Song Classification in Noisy Environment , 2016, CLEF.

[23]  Peter Arzberger,et al.  New Eyes on the World: Advanced Sensors for Ecology , 2009 .

[24]  Ilyas Potamitis,et al.  Deep learning for detection of bird vocalisations , 2016, ArXiv.

[25]  Steve Kelling,et al.  Towards the Automatic Classification of Avian Flight Calls for Bioacoustic Monitoring , 2016, PloS one.

[26]  Theodore A. Parker,et al.  On the Use of Tape Recorders in Avifaunal Surveys , 1991 .

[27]  Deborah Estrin,et al.  Preprocessing in a Tiered Sensor Network for Habitat Monitoring , 2003, EURASIP J. Adv. Signal Process..

[28]  M. C. Urban.  Accelerating extinction risk from climate change , 2015, Science.

[29]  Neil W. Bergmann,et al.  An FPGA softcore based implementation of a bird call recognition system for sensor networks , 2010, 2010 Conference on Design and Architectures for Signal and Image Processing (DASIP).

[30]  Lewis Girod,et al.  Automated Wildlife Monitoring Using Self-Configuring Sensor Networks Deployed in Natural Habitats , 2007 .

[31]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[32]  P. Mermelstein,et al.  Distance measures for speech recognition, psychological and instrumental , 1976 .

[33]  Seppo Ilmari Fagerlund,et al.  Bird Species Recognition Using Support Vector Machines , 2007, EURASIP J. Adv. Signal Process..

[34]  An Braeken,et al.  Sensor Systems Based on FPGAs and Their Applications: A Survey , 2012, Sensors.

[35]  Jörg Henkel,et al.  Hardware/software co-design for a wireless sensor network platform , 2014, 2014 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[36]  Nicolas Vidot,et al.  Wildlife Assessment Using Wireless Sensor Networks , 2010 .

[37]  Abdelmalik Taleb-Ahmed,et al.  Robust acoustic bird recognition for habitat monitoring with wireless sensor networks , 2016, Int. J. Speech Technol..

[38]  Ciira Wa Maina,et al.  Cost Effective Acoustic Monitoring of Bird Species , 2016, INTERSPEECH.

[39]  Alan D. George,et al.  Exploiting Partially Reconfigurable FPGAs for Situation-Based Reconfiguration in Wireless Sensor Networks , 2009, 2009 17th IEEE Symposium on Field Programmable Custom Computing Machines.

[40]  J. Portilla,et al.  Embedded Runtime Reconfigurable Nodes for Wireless Sensor Networks Applications , 2011, IEEE Sensors Journal.

[41]  Irene Y. H. Gu,et al.  Classification of bird species by using key song searching: a comparative study , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[42]  Joan Claudi Socoró,et al.  Description of Anomalous Noise Events for Reliable Dynamic Traffic Noise Mapping in Real-Life Urban and Suburban Soundscapes , 2017 .

[43]  Todor Ganchev,et al.  Automated acoustic detection of Vanellus chilensis lampronotus , 2015, Expert Syst. Appl..

[44]  Hervé Glotin,et al.  Bird detection in audio: A survey and a challenge , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[45]  Miguel Angel Ferrer-Ballester,et al.  Review of Automatic Fault Diagnosis Systems Using Audio and Vibration Signals , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[46]  Martine Collard,et al.  Acoustic scheme to count bird songs with wireless sensor networks , 2011, 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[47]  P. Hanson,et al.  Wireless Sensor Networks for Ecology , 2005 .

[48]  I. Potamitis.  Automatic Classification of a Taxon-Rich Community Recorded in the Wild , 2014, PloS one.