Personalized HRTF Measurement and 3D Audio Rendering for AR/VR Headsets

This e-Brief describes our recent work in acquiring a fast, personalized head related transfer function (HRTF) and a personalized 3D audio rendering headsets for augmented and virtual reality (AVR) headsets. Binaural signal acquisition and rendering are important tasks in capturing the idiosyncratic acoustics of the pinnae, head and torso, and playback via headphones to the left and right ears. We will highlight a personalized HRTF binaural acquisition cum 3D audio headphone playback system that can take advantage of our individual earhead anthropometry information in 3D sound acquisition and rendering.

[1]  Michael Friis Sørensen,et al.  Head-Related Transfer Functions of Human Subjects , 1995 .

[2]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[3]  Larry S. Davis,et al.  HRTF personalization using anthropometric measurements , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[4]  Ee-Leng Tan,et al.  On the preprocessing and postprocessing of HRTF individualization based on sparse representation of anthropometric features , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Woon-Seng Gan,et al.  Fast continuous HRTF acquisition with unconstrained movements of human subjects , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Woon-Seng Gan,et al.  Natural Listening over Headphones in Augmented Reality Using Adaptive Filtering Techniques , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[7]  Gerald Enzner,et al.  Trends in Acquisition of Individual Head-Related Transfer Functions , 2013 .

[8]  Woon-Seng Gan,et al.  Fast Continuous Acquisition of HRTF for Human Subjects with Unconstrained Random Head Movements in Azimuth and Elevation , 2016 .

[9]  Griffin D. Romigh.  Individualized Head-Related Transfer Functions: Efficient Modeling and Estimation from Small Sets of Spatial Samples , 2012 .

[10]  Woon-Seng Gan,et al.  User-defined spectral manipulation of HRTF for improved localisation in 3D sound systems , 1998 .

[11]  Peter Balazs,et al.  Multiple Exponential Sweep Method for Fast Measurement of Head-Related Transfer Functions , 2007 .

[12]  Ee-Leng Tan,et al.  Individualization of Binaural Synthesis Using Frontal Projection Headphones , 2013 .

[13]  Ville Pulkki,et al.  HRTF Measurements with a Continuously Moving Loudspeaker and Swept Sines , 2010 .

[14]  Ee-Leng Tan,et al.  Natural Sound Rendering for Headphones: Integration of signal processing techniques , 2015, IEEE Signal Processing Magazine.