An AIoT System for Bat Species Classification

Bat species are an integral part of our ecosystem and their monitoring can provide important insights into conservation and tracking viruses like Covid-19. Given the difficulty and high cost of manually monitoring bats in their natural habitats, this paper proposes an Artificially Intelligent Internet of Things (AIoT) system that uses audio-based Convolutional Neural Network (CNN) to monitor bat species using their echolocation calls. The system uses Long Range Wide Area Network (LoRaWAN) to send the classified species to an application server in real-time. The paper compared the performance of three different edge devices, Raspberry Pi Model (RPI) 3B+ (RPi), NVIDIA Jetson Nano, and Google Coral and two deep learning frameworks (TensorFlow Lite and TensorRT). Although all edge devices were able to do the real-time inference (< 0.5 seconds/inference for a 3-second audio segment), Google Coral appears to be the best choice because it was the fastest (0.3917 seconds/audio segment) and required the least resources (maximum %CPU Utilization = 29.2%). However, if cost was a concern then even the RPI was more than adequate for the task.

[1]  Leandro A. S. Moreira,et al.  Evaluating a Visual Simultaneous Localization and Mapping Solution on Embedded Platforms , 2020, 2020 IEEE 29th International Symposium on Industrial Electronics (ISIE).

[2]  Bamidele Adebisi,et al.  Low-Power Wide Area Network Technologies for Internet-of-Things: A Comparative Review , 2019, IEEE Internet of Things Journal.

[3]  Vincent Lostanlen,et al.  Robust sound event detection in bioacoustic sensor networks , 2019, PloS one.

[4]  Pilsung Kang,et al.  Benchmarking GPU-Accelerated Edge Devices , 2020, 2020 IEEE International Conference on Big Data and Smart Computing (BigComp).

[5]  M. Mas,et al.  Ecological indices in long-term acoustic bat surveys for assessing and monitoring bats' responses to climatic and land-cover changes , 2020 .

[6]  Mark A. Girolami,et al.  Bat detective—Deep learning tools for bat acoustic signal detection , 2017, bioRxiv.

[7]  Carlo Fischione,et al.  The Internet of Audio Things: State of the Art, Vision, and Challenges , 2020, IEEE Internet of Things Journal.

[8]  David A Hill,et al.  Acoustic Identification of Eight Species of Bat (Mammalia: Chiroptera) Inhabiting Forests of Southern Hokkaido, Japan: Potential for Conservation Monitoring , 2004, Zoological science.

[9]  Tarik Taleb,et al.  Edge Computing for the Internet of Things: A Case Study , 2018, IEEE Internet of Things Journal.

[10]  Margarita N. Favorskaya,et al.  Framework for Intelligent Wildlife Monitoring , 2020, KES-IDT.

[11]  Xinwei Wang,et al.  Internet of Things to network smart devices for ecosystem monitoring. , 2019, Science bulletin.

[12]  J. Epstein,et al.  Possibility for reverse zoonotic transmission of SARS-CoV-2 to free-ranging wildlife: A case study of bats , 2020, PLoS pathogens.

[13]  F. Boray Tek,et al.  Animal Sound Classification Using A Convolutional Neural Network , 2018, 2018 3rd International Conference on Computer Science and Engineering (UBMK).

[14]  Aren Jansen,et al.  CNN architectures for large-scale audio classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Zachary J. Ruff,et al.  Automated identification of avian vocalizations with deep convolutional neural networks , 2019, Remote Sensing in Ecology and Conservation.

[16]  Andreas M. Ali,et al.  Acoustic monitoring in terrestrial environments using microphone arrays: applications, technological considerations and prospectus , 2011 .

[17]  Abed Ellatif Samhat,et al.  Internet of Mobile Things: Overview of LoRaWAN, DASH7, and NB-IoT in LPWANs Standards and Supported Mobility , 2019, IEEE Communications Surveys & Tutorials.

[18]  Alessandro Montanari,et al.  Resource Characterisation of Personal-Scale Sensing Models on Edge Accelerators , 2019, Proceedings of the First International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things.

[19]  Nirvana Meratnia,et al.  An Asynchronous Dual Radio Opportunistic Beacon Network Protocol for Wildlife Monitoring System , 2019, 2019 10th IFIP International Conference on New Technologies, Mobility and Security (NTMS).

[20]  Mohsen Guizani,et al.  Deep Learning for IoT Big Data and Streaming Analytics: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[21]  Paul Roe,et al.  Active learning for classifying long‐duration audio recordings of the environment , 2018, Methods in Ecology and Evolution.

[22]  Sara Bumrungsri,et al.  Using Echolocation Calls to Identify Thai Bat Species: Vespertilionidae, Emballonuridae, Nycteridae and Megadermatidae , 2011 .

[23]  Xiaobai Liu,et al.  Learning Deep Models from Synthetic Data for Extracting Dolphin Whistle Contours , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[24]  Hanseok Ko,et al.  Convolutional Feature Vectors and Support Vector Machine for Animal Sound Classification , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[25]  Lamia Chaari,et al.  A Comparative Study of LoRaWAN, SigFox, and NB-IoT for Smart Water Grid , 2019, 2019 Global Information Infrastructure and Networking Symposium (GIIS).

[26]  Tara N. Sainath,et al.  Deep Learning for Audio Signal Processing , 2019, IEEE Journal of Selected Topics in Signal Processing.

[27]  Qin Zhang,et al.  Edge Computing in IoT-Based Manufacturing , 2018, IEEE Communications Magazine.

[28]  B. A. Cooper,et al.  Comparisons of radar and audio-visual counts of marbled murrelets during inland forest surveys , 2002 .

[29]  Colin Raffel,et al.  librosa: Audio and Music Signal Analysis in Python , 2015, SciPy.

[30]  Michele Magno,et al.  Experimental Evaluation on NB-IoT and LoRaWAN for Industrial and IoT Applications , 2019, 2019 IEEE 17th International Conference on Industrial Informatics (INDIN).

[31]  Kazuhiro Nakadai,et al.  HARK-Bird-Box: A Portable Real-time Bird Song Scene Analysis System , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[32]  Tiago M. Fernández-Caramés,et al.  Design and Empirical Validation of a LoRaWAN IoT Smart Irrigation System , 2020, Proceedings.

[33]  Elmar Nöth,et al.  ORCA-SPOT: An Automatic Killer Whale Sound Detection Toolkit Using Deep Learning , 2019, Scientific Reports.

[34]  Jianlong Li,et al.  Study on Echo Features and Classification Methods of Fish Species , 2018, 2018 10th International Conference on Wireless Communications and Signal Processing (WCSP).

[35]  Ilyas Potamitis,et al.  Unsupervised dictionary extraction of bird vocalisations and new tools on assessing and visualising bird activity , 2015, Ecol. Informatics.

[36]  Andrzej Sobecki,et al.  Deep learning in the fog , 2019, Int. J. Distributed Sens. Networks.

[37]  Cathleen Balantic,et al.  Temporally adaptive acoustic sampling to maximize detection across a suite of focal wildlife species , 2019, Ecology and evolution.

[38]  Jianzhong Wang,et al.  Urban noise recognition with convolutional neural network , 2018, Multimedia Tools and Applications.

[39]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[40]  Sérgio Luis da Silva,et al.  Low-Cost LoRaWAN Node for Agro-Intelligence IoT , 2020, Electronics.

[41]  Luca Davoli,et al.  LoRaFarM: A LoRaWAN-Based Smart Farming Modular IoT Architecture , 2020, Sensors.

[42]  René Peinl,et al.  Evaluation of Deep Learning Accelerators for Object Detection at the Edge , 2020, KI.

[43]  Kate E. Jones,et al.  Acoustic identification of Mexican bats based on taxonomic and ecological constraints on call design , 2016 .

[44]  Ilyas Ozer,et al.  Noise robust sound event classification with convolutional neural network , 2018, Neurocomputing.

[45]  Muhammad Nabeel,et al.  Ultra Low-Power Sensor Networks for Next Generation Wildlife Monitoring , 2019, 2019 11th International Conference on Communication Systems & Networks (COMSNETS).

[46]  Charles M. Francis,et al.  Comparison of audio recording system performance for detecting and monitoring songbirds , 2013 .

[47]  P. Woo,et al.  Viruses and Bats , 2019, Viruses.

[48]  Jeremy Kepner,et al.  Survey and Benchmarking of Machine Learning Accelerators , 2019, 2019 IEEE High Performance Extreme Computing Conference (HPEC).

[49]  Yung-Shun Lien,et al.  Evaluating Changes in the Marine Soundscape of an Offshore Wind Farm via the Machine Learning-Based Source Separation , 2019, 2019 IEEE Underwater Technology (UT).

[50]  Eleftheria Katsiri,et al.  A wireless sensor network for underground passages: Remote sensing and wildlife monitoring , 2020, Engineering Reports.