Fast HRFT measurement system with unconstrained head movements for 3D audio in virtual and augmented reality applications

Binaural audio plays an indispensable role in virtual reality (VR) and augmented reality (AR). Binaural audio recreates the sensation of the three dimensional auditory experience using Head- Related Transfer Functions (HRTFs). HRTFs are as unique as our fingerprint. To achieve an immersive audio experience, HRTFs measured from every particular user is required. Nowadays, the conventional methods for HRTF measurements requires a wellcontrolled environment, hardly any movement of the user, and projecting to the user a high level of unpleasant sound in a rather long duration. Such difficulties have greatly limited the use of individually measurement HRTFs and hinder the authenticity of immersive audio. To solve these problems, we proposed a fast and convenient HRTF measurement system that is an order of magnitude faster and more importantly, it does not place any constraints on the user’s movement. With the help of a head-tracker and advanced adaptive signal processing algorithms, this system is able to achieve satisfactory HRTF measurement accuracy. In this demonstration, we will present a fast real-time HRTF acquisition system and show how the individualized HRTFs improve the audio experience in VR/AR applications.

[1]  Ee-Leng Tan,et al.  On the preprocessing and postprocessing of HRTF individualization based on sparse representation of anthropometric features , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Woon-Seng Gan,et al.  Fast Continuous Acquisition of HRTF for Human Subjects with Unconstrained Random Head Movements in Azimuth and Elevation , 2016 .

[3]  Peter Balazs,et al.  Multiple Exponential Sweep Method for Fast Measurement of Head-Related Transfer Functions , 2007 .

[4]  Griffin D. Romigh Individualized Head-Related Transfer Functions: Efficient Modeling and Estimation from Small Sets of Spatial Samples , 2012 .

[5]  Woon-Seng Gan,et al.  User-defined spectral manipulation of HRTF for improved localisation in 3D sound systems , 1998 .

[6]  Ee-Leng Tan,et al.  Natural Sound Rendering for Headphones: Integration of signal processing techniques , 2015, IEEE Signal Processing Magazine.

[7]  Michael Friis Sørensen,et al.  Head-Related Transfer Functions of Human Subjects , 1995 .

[8]  Larry S. Davis,et al.  HRTF personalization using anthropometric measurements , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[9]  Gerald Enzner,et al.  Trends in Acquisition of Individual Head-Related Transfer Functions , 2013 .

[10]  Woon-Seng Gan,et al.  Fast continuous HRTF acquisition with unconstrained movements of human subjects , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[12]  Woon-Seng Gan,et al.  Natural Listening over Headphones in Augmented Reality Using Adaptive Filtering Techniques , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[13]  Ee-Leng Tan,et al.  Individualization of Binaural Synthesis Using Frontal Projection Headphones , 2013 .

[14]  Ville Pulkki,et al.  HRTF Measurements with a Continuously Moving Loudspeaker and Swept Sines , 2010 .