On the performance of a GPU-based SoC in a distributed spatial audio system

Many current system-on-chip (SoC) devices are composed of low-power multicore processors combined with a small graphics accelerator (or GPU) offering a trade-off between computational capacity and low-power consumption. In this context, spatial audio methods such as wave field synthesis (WFS) can benefit from a distributed system composed of several SoCs that collaborate to tackle the high computational cost of rendering virtual sound sources. This paper aims at evaluating important aspects dealing with a distributed WFS implementation that runs over a network of Jetson Nano boards composed of embedded GPU-based SoCs: computational performance, energy efficiency, and synchronization issues. Our results show that the maximum efficiency is obtained when the WFS system operates the GPU frequency at 691.2 MHz, achieving 11 sources-per-Watt. Synchronization experiments using the NTP protocol show that the maximum initial delay of 10 ms between nodes does not prevent us from achieving high spatial sound quality.

[1]  Sascha Spors,et al.  An Approach to Listening Room Compensation with Wave Field Synthesis , 2003 .

[2]  A. J. Berkhout,et al.  A Holographic Approach to Acoustic Control , 1988 .

[3]  Andrew N. Novick,et al.  Time and Frequency Measurements Using the Global Positioning System (GPS) , 2001 .

[4]  Rafael Kuffner dos Anjos,et al.  Augmented Virtual Teleportation for High-Fidelity Telecollaboration , 2020, IEEE Transactions on Visualization and Computer Graphics.

[5]  D. Puccinelli,et al.  Wireless sensor networks: applications and challenges of ubiquitous sensing , 2005, IEEE Circuits and Systems Magazine.

[6]  Maximo Cobos,et al.  An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia , 2020, IEEE Access.

[7]  Enrique S. Quintana-Ortí,et al.  Optimized Fundamental Signal Processing Operations For Energy Minimization on Heterogeneous Mobile Devices , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  David L. Mills,et al.  Internet Engineering Task Force (ietf) Network Time Protocol Version 4: Protocol and Algorithms Specification , 2010 .

[9]  Gao Lei,et al.  The accuracy of IEEE 1588 time synchronization protocol and its improvement , 2015, 2015 12th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[10]  Lui Sha,et al.  Dynamic Clustering for Acoustic Target Tracking in Wireless Sensor Networks , 2004, IEEE Trans. Mob. Comput..

[11]  Sascha Spors,et al.  Efficient Active Listening Room Compensation for Wave Field Synthesis , 2004 .

[12]  Sascha Spors,et al.  Listening room compensation for wave field synthesis , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[13]  V. Cristea,et al.  NTP versus PTP in Com puter Networks Clock Synchronization , 2006, 2006 IEEE International Symposium on Industrial Electronics.

[14]  Kang Lee,et al.  IEEE 1588 standard for a precision clock synchronization protocol for networked measurement and control systems , 2002, 2nd ISA/IEEE Sensors for Industry Conference,.

[15]  Lui Sha,et al.  Dynamic clustering for acoustic target tracking in wireless sensor networks , 2003, IEEE Transactions on Mobile Computing.

[16]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[17]  Vesa Välimäki,et al.  GPU-Based Dynamic Wave Field Synthesis Using Fractional Delay Filters and Room Compensation , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[18]  Georgi Gaydadjiev,et al.  Multi-Core Platforms for Beamforming and Wave Field Synthesis , 2011, IEEE Transactions on Multimedia.

[19]  Enrique S. Quintana-Ortí,et al.  An Integrated Framework for Power-Performance Analysis of Parallel Scientific Workloads , 2013 .

[20]  Maximo Cobos,et al.  Design and Implementation of Acoustic Source Localization on a Low-Cost IoT Edge Platform , 2020, IEEE Transactions on Circuits and Systems II: Express Briefs.

[21]  A. Gonzalez,et al.  Room compensation in wave field synthesis by means of multichannel inversion , 2005, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2005..