Assessing the Impact of Head-Related Transfer Function Individualization on Task Performance: Case of a Virtual Reality Shooter Game

This paper presents the results of an extended experiment to assess the impact of individualized binaural rendering on player performance in an ecologically valid use context, specifically that of a VR “shooter game,” as part of a larger project to characterize the impact of binaural rendering quality in various VR type applications. Participants played a simple game in which they were faced with successive targets approaching from random directions on a sphere. While audio-visual cues allowed for general target localization, only sections of the game that relied on audio cues were used for analysis. Two HRTF exposure protocols were used, comprising best and worst-match HRTFs from a “perceptually orthogonal” optimized set of HRTFs, during the course of six game sessions. Two groups performed the game sessions exclusively using either their best or worst-match HRTF. Two additional groups performed the game sessions alternating between best and worst-match HRTFs. Results suggest that HRTF quality had minimal general impact on in-game participant performance and improvement rate. However, performance for extreme elevation target positions was affected by the quality of HRTF matching. In addition, a subgroup of participants showed higher sensitivity to HRTF choice than others.

[1]  Federico Avanzini,et al.  Improving elevation perception with a tool for image-guided head-related transfer function selection , 2017 .

[2]  Brian F. G. Katz,et al.  Impact of HRTF Individualization on Player Performance in a VR Shooter Game I , 2018 .

[3]  Brian F. G. Katz,et al.  The Use of 3D-Audio in a Multi-Modal Teleoperation Platform for Remote Driving/Supervision , 2007 .

[4]  Areti Andreopoulou,et al.  Subjective HRTF evaluations for obtaining global similarity metrics of assessors and assessees , 2016, Journal on Multimodal User Interfaces.

[5]  Gaëtan Parseihian,et al.  Perceptually based head-related transfer function database optimization. , 2012, The Journal of the Acoustical Society of America.

[6]  G. Cumming,et al.  The New Statistics , 2014, Psychological science.

[7]  AlcañizMariano,et al.  Comparison of Oculus Rift and HTC Vive: Feasibility for Virtual Reality-Based Exploration, Navigation, Exergaming, and Rehabilitation. , 2018, Games for health journal.

[8]  Brian F. G. Katz,et al.  The Influence of Head Tracking Latency on Binaural Rendering in Simple and Complex Sound Scenes , 2016 .

[9]  Gavriel Salvendy,et al.  Individualization of Head-Related Transfer Function for Three-Dimensional Virtual Auditory Display: A Review , 2007, HCI.

[10]  Olivier Warusfel,et al.  Measurement of a head-related transfer function database with high spatial resolution , 2014 .

[11]  Hervé Dejardin,et al.  nouvOson website: how a public radio broadcaster makes immersive audio accessible to the general public , 2015 .

[12]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[13]  Brian F. G. Katz,et al.  The Anaglyph Binaural Audio Engine , 2018 .

[14]  François Alouges,et al.  HRTF interpolation and ITD personalization for binaural synthesis using spherical harmonics , 2012 .

[15]  Gregory H. Wakefield,et al.  Introduction to Head-Related Transfer Functions (HRTFs): Representations of HRTFs in Time, Frequency, and Space , 2001 .

[16]  Andreas Silzle Selection and Tuning of HRTFs , 2002 .

[17]  Brian F. G. Katz,et al.  Morphocons: A New Sonification Concept Based on Morphological Earcons , 2012 .

[18]  J. C. Middlebrooks,et al.  Psychophysical customization of directional transfer functions for virtual sound localization. , 2000, The Journal of the Acoustical Society of America.

[19]  WrightMatthew Open Sound Control: an enabling technology for musical networking , 2005 .

[20]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[21]  Areti Andreopoulou,et al.  Investigation on Subjective HRTF Rating Repeatability , 2016 .

[22]  Yukio Iwaya Individualization of head-related transfer functions with tournament-style listening test: Listening with other's ears , 2006 .

[23]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[24]  Stefania Serafin,et al.  The Impact of an Accurate Vertical Localization with HRTFs on Short Explorations of Immersive Virtual Reality Scenarios , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[25]  Mark R. Anderson,et al.  Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source. , 2001, Journal of the Audio Engineering Society. Audio Engineering Society.

[26]  Lorenzo Picinali,et al.  Auditory Accommodation to Poorly Matched Non-Individual Spectral Localization Cues Through Active Learning , 2019, Scientific Reports.

[27]  Ravish Mehra,et al.  Comparison of localization performance with individualized and non-individualized head-related transfer functions for dynamic listeners , 2016 .

[28]  Armin Becher,et al.  Novel Approach to Measure Motion-To-Photon and Mouth-To-Ear Latency in Distributed Virtual Reality Systems , 2018, ArXiv.

[29]  Yukio Iwaya,et al.  Transfer effects on sound localization performances from playing a virtual three-dimensional auditory game , 2007 .

[30]  S. Perrett,et al.  The effect of head rotations on vertical plane sound localization. , 1997, The Journal of the Acoustical Society of America.

[31]  Piotr Majdak,et al.  Effect of long-term training on sound localization performance with spectrally warped and band-limited head-related transfer functions. , 2013, The Journal of the Acoustical Society of America.

[32]  V. Ralph Algazi,et al.  The Use of Head-and-Torso Models for Improved Spatial Sound Synthesis , 2002 .

[33]  Bernhard U. Seeber,et al.  Subjective selection of non-individual head-related transfer functions , 2003 .

[34]  Rozenn Nicol,et al.  Binaural Spatial Reproduction , 2018, Sensory Evaluation of Sound.

[35]  Larry S. Davis,et al.  HRTF personalization using anthropometric measurements , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[36]  Gaëtan Parseihian,et al.  Rapid head-related transfer function adaptation using a virtual auditory environment. , 2012, The Journal of the Acoustical Society of America.

[37]  David Schönstein,et al.  HRTF selection for binaural synthesis from a database using morphological parameters , 2010 .