The influence of visual distance on the room-acoustic experience of auralizations.

Auralizations have become more prevalent in architectural acoustics and virtual reality. Studies have shown that by employing a methodical calibration procedure, ecologically/perceptually valid auralizations can be obtained. Another study demonstrated a manner to include dynamic voice directivity with results indicating these auralizations were judged significantly more plausible than auralizations with static source orientations. With the increased plausibility of auralizations, it is possible to study room-acoustic experience employing virtual reality, having confidence that the results also apply to real-life situations. Limited studies have examined the influence of visuals on room-acoustic experience. Using a virtual reality framework, this study investigated the influence of visuals on the room-acoustic experience of auralizations. Evaluations compared dynamic voice auralizations coherently matched with visualization positions to incoherently matched audio-visual pairs. Based on the results, the test population could be divided into three subgroups: (1) those who judged auralizations more acoustically distant with increased visual distance, (2) those who judged auralizations louder with increased visual distance, and (3) those whose audio judgment was uninfluenced by the visual stimulus.

[1]  Steffen Lepa,et al.  A spatial audio quality inventory for virtual acoustic environments (SAQI) , 2014 .

[2]  Nick Zacharov,et al.  Perceptual attributes for the comparison of head-related transfer functions. , 2016, The Journal of the Acoustical Society of America.

[3]  John S. Bradley,et al.  The influence of late arriving energy on spatial impression , 1995 .

[4]  Jin Yong Jeon,et al.  The effect of visual and auditory cues on seat preference in an opera theater. , 2008, The Journal of the Acoustical Society of America.

[5]  Christian Jacquemin,et al.  Cueing multimedia search with audiovisual blur , 2013, TAP.

[6]  Hans-Joachim Maempel,et al.  Auditory and Visual Contribution to Egocentric Distance and Room Size Perception , 2013 .

[7]  Matthias Scheutz,et al.  A mismatch in the human realism of face and voice produces an uncanny valley , 2011, i-Perception.

[8]  Pavel Zahorik,et al.  Loudness constancy with varying sound source distance , 2001, Nature Neuroscience.

[9]  Brian F. G. Katz,et al.  Creation and calibration method of acoustical models for historic virtual reality auralizations , 2015, Virtual Reality.

[10]  P Zahorik,et al.  Estimating Sound Source Distance with and without Vision , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[11]  Peter Stitt,et al.  Influence of head tracking on the externalization of speech stimuli for non-individualized binaural synthesis. , 2017, The Journal of the Acoustical Society of America.

[12]  Guy L. Lacroix,et al.  Does the uncanny valley exist? An empirical test of the relationship between eeriness and the human likeness of digitally created faces , 2013, Comput. Hum. Behav..

[13]  M. Barron,et al.  Subjective study of British symphony concert halls , 1988 .

[14]  O. J. Dunn.  Multiple Comparisons among Means , 1961 .

[15]  T. Lokki,et al.  Investigation of auditory distance perception and preferences in concert halls by using virtual acoustics. , 2015, The Journal of the Acoustical Society of America.

[16]  Marc Rébillat,et al.  Audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments , 2012, TAP.

[17]  Tapio Lokki,et al.  Auditory Distance Presentation in an Urban Augmented Reality Environment , 2015, TAP.

[18]  Esteban R Calcagno,et al.  The Role of Vision in Auditory Distance Perception , 2012, Perception.

[19]  Barteld N. J. Postma,et al.  Perceptive and objective evaluation of calibrated room acoustic simulation auralizations. , 2016, The Journal of the Acoustical Society of America.

[20]  Brian F. G. Katz,et al.  Subjective Evaluation of Dynamic Voice Directivity for Auralizations , 2017 .

[21]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[22]  G. A. Soulodre,et al.  Objective measures of listener envelopment , 1995 .

[23]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.