Design and Implementation of Acoustic Source Localization on a Low-Cost IoT Edge Platform

The implementation of algorithms for acoustic source localization on edge platforms for the Internet of Things (IoT) is gaining momentum. Applications based on acoustic monitoring can greatly benefit from efficient implementations of such algorithms, enabling novel services for smart homes and buildings or ambient-assisted living. In this context, this brief proposes extreme low-cost sound source localization system composed of two microphones and the low power microcontroller module ESP32. A Direction-Of-Arrival (DOA) algorithm has been implemented taking into account the specific features of this board, showing excellent performance despite the memory constraints imposed by the platform. We have also adapted off-the-shelf low-cost microphone boards to the input requirements of the ESP32 Analog-to-Digital Converter. The processing has been optimized by leveraging in parallel both cores of the microcontroller to capture and process the audio in real time. Our experiments expose that we can perform real-time localization, with a processing time below 3.3 ms.

[1]  Scott Rickard,et al.  Blind separation of speech mixtures via time-frequency masking , 2004, IEEE Transactions on Signal Processing.

[2]  Jae Wook Jeon,et al.  Real-time Sound Localization Using Generalized Cross Correlation Based on 0.13 ㎛ CMOS Process , 2014 .

[3]  Athanasios Mouchtaris,et al.  Real-Time Multiple Sound Source Localization and Counting Using a Circular Microphone Array , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  Maximo Cobos,et al.  On the performance of multi-GPU-based expert systems for acoustic localization involving massive microphone arrays , 2015, Expert Syst. Appl..

[5]  Tariq Iqbal,et al.  Design and implementation of a low cost web server using ESP32 for real-time photovoltaic system monitoring , 2017, 2017 IEEE Electrical Power and Energy Conference (EPEC).

[6]  G. Carter,et al.  The generalized correlation method for estimation of time delay , 1976 .

[7]  M. Sabarimalai Manikandan,et al.  Real-Time PPG Signal Quality Assessment System for Improving Battery Life and False Alarms , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[8]  Iván V. Meza,et al.  Localization of sound sources in robotics: A review , 2017, Robotics Auton. Syst..

[9]  Mehrdad Dianati,et al.  A Survey of the State-of-the-Art Localization Techniques and Their Potentials for Autonomous Vehicle Applications , 2018, IEEE Internet of Things Journal.

[10]  Maximo Cobos,et al.  Two-microphone multi-speaker localization based on a Laplacian Mixture Model , 2011, Digit. Signal Process..

[11]  Tinoosh Mohsenin,et al.  Embedded Low-Power Processor for Personalized Stress Detection , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[12]  Yuriy Vagapov,et al.  Comparative analysis and practical implementation of the ESP32 microcontroller module for the internet of things , 2017, 2017 Internet Technologies and Applications (ITA).

[13]  Garcillanosa,et al.  Audio-assisted standalone microcontroller-based Braille System Tutor for Grade 1 Braille symbols , 2016, 2016 IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC).