An Efficient Method Using the Parameterized HRTFs for 3D Audio Real-Time Rendering on Mobile Devices

3D audio real-time rendering is of great importance for virtual reality (VR) application, especially on mobile devices. However, the limited computational power makes it hard to implement fast generation of spatial sound using head-related transfer function (HRTF). To accelerate the procedure of head-related impulse response (HRIR) convolution, we propose an efficient rendering method using the parameterized HRTF. The HRIRs are preprocessed into the parameterized HRTFs with a delayed parameter, so as to realize the fast convolutions in 3D audio synthesis. We found our method could reduce the calculation time of 3D audio rendering significantly. The results were 0.9 times and 0.68 times on average the play duration of the MPEG standard sequences, with Qualcomm Snapdragon 821 and Samsung Exynos 7420. And the subjective test showed that the real-time rendered sounds had the similar audio quality and location perception to the 3D audio rendered with the raw HRIRs.

[1]  Jose A. Belloch,et al.  Real-time massive convolution for audio applications on GPU , 2011, The Journal of Supercomputing.

[2]  Woon-Seng Gan,et al.  Android Framework Implementation of 3D Audio with Range Control , 2014 .

[3]  Yonghong Yan,et al.  Head-Related Transfer Function Modeling Based on Finite-Impulse Response , 2013, 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[4]  Mariane R. Petraglia,et al.  Low-order modeling of head-related transfer functions using wavelet transforms , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[5]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[6]  Brian F G Katz,et al.  A comparative study of Interaural Time Delay estimation methods. , 2014, The Journal of the Acoustical Society of America.

[7]  Yukio Iwaya,et al.  Virtual Auditory Display on a Smartphone for High-Resolution Acoustic Space by Remote Rendering , 2015, 2015 International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP).

[8]  Fuliang Yin,et al.  A hybrid compression method for head-related transfer functions , 2009 .

[9]  Young-Cheol Park,et al.  Scalable Multiband Binaural Renderer for MPEG-H 3D Audio , 2015, IEEE Journal of Selected Topics in Signal Processing.

[10]  Ravish Mehra,et al.  Efficient HRTF-based Spatial Audio for Area and Volumetric Sources , 2016, IEEE Transactions on Visualization and Computer Graphics.

[11]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[12]  Ee-Leng Tan,et al.  Natural Sound Rendering for Headphones: Integration of signal processing techniques , 2015, IEEE Signal Processing Magazine.

[13]  Dominik Storek,et al.  Rendering moving sound source for headphone-based virtual acoustic reality aspects of signal processing implementation , 2014, 2014 International Conference on Applied Electronics.

[14]  Xiaodong Li,et al.  Distance-Dependent Head-Related Transfer Functions Measured With High Spatial Resolution Using a Spark Gap , 2009, IEEE Transactions on Audio, Speech, and Language Processing.