Auditory and Visual Contribution to Egocentric Distance and Room Size Perception

The perception of rooms involves various unimodal and multimodal aspects on different perceptual levels. Rather abstract yet self-evident aspects are the source distance and the room size. We investigated to what extent the perceived room size and egocentric source distance as supramodal aspects are based on the auditory and the visual modality, i.e. experimentally influenced by the acoustic and optical stimulus. The statistical determination of the respective contributions demands the mutually independent variation of optical and acoustical room properties, usually referred to as conflicting stimulus paradigm. Simulation data of four rooms were collected acoustically by acquiring binaural room impulse responses for different head orientations and optically by acquiring stereoscopic images of the rooms including the electroacoustic sound source. In the laboratory, respective acoustic scenes were played back applying dynamic binaural synthesis, whereas the optical scenes were presented by the use of a stereoscopic display. Test participants were asked to assess the source distance and the room size. Results show main effects of the modalities rather than an interaction effect. It was found that distance perception in rooms is predominantly based on the acoustic stimulus characteristics whereas room size perception predominantly relies on optical information. There is no evidence in favour of the proximity image effect hypothesis. Results do also not confirm an auditory or audio-visual underestimation of the source distance but show a general underestimation of room size and indicate an audio-visual asymmetry regarding the accuracy of room size perception. Maximum accuracy and cross-modal consistency of judgements were distinctively observed in low-absorbent rooms.

[1]  J. Edward Swan,et al.  Measurement Protocols for Medium-Field Distance Perception in Large-Screen Immersive Displays , 2009, 2009 IEEE Virtual Reality Conference.

[2]  Densil Cabrera,et al.  Auditory room size perception: A comparison of real versus binaural sound-fields , 2006 .

[3]  Tammo Houtgast,et al.  Auditory distance perception in rooms , 1999, Nature.

[4]  Helmut. Wittek,et al.  Perceptual Differences Between Wavefield Synthesis and Stereophony. , 2007 .

[5]  R. Bakeman Recommended effect size statistics for repeated measures designs , 2005, Behavior research methods.

[6]  Will Spijkers,et al.  Depth Perception in Virtual Reality: Distance Estimations in Peri- and Extrapersonal Space , 2008, Cyberpsychology Behav. Soc. Netw..

[7]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.

[8]  Jesper Sandvad Auditory perception of reverberant surroundings , 1999 .

[9]  J. Algina,et al.  Generalized eta and omega squared statistics: measures of effect size for some common research designs. , 2003, Psychological methods.

[10]  Uwe Kloos,et al.  Egocentric distance judgments in a large screen display immersive virtual environment , 2010, APGV '10.

[12]  D. Pisoni,et al.  Auditory-visual speech perception and synchrony detection for speech and nonspeech signals. , 2006, The Journal of the Acoustical Society of America.

[13]  W. Wiest,et al.  Stevens's exponent for psychophysical scaling of perceived, remembered, and inferred distance. , 1985, Psychological bulletin.

[14]  Søren H. Nielsen,et al.  Auditory Distance Perception in Different Rooms , 1993 .

[15]  W. Wiest,et al.  Stevens's exponent for psychophysical scaling of perceived, remembered, and inferred distance. , 1985, Psychological bulletin.

[16]  P Zahorik,et al.  Estimating Sound Source Distance with and without Vision , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[17]  Densil Cabrera,et al.  ACOUSTIC CLARITY AND AUDITORY ROOM SIZE PERCEPTION , 2007 .

[18]  Ryad Chellali,et al.  Depth Perception within Virtual Environments: A Comparative Study Between Wide Screen Stereoscopic Displays and Head Mounted Devices , 2009, 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns.

[19]  G. Keppel,et al.  Design and Analysis: A Researcher's Handbook , 1976 .

[20]  Stefan Weinzierl,et al.  FABIAN - An instrument for software-based measurement of binaural room impulse responses in multiple degrees of freedom (FABIAN - Ein Instrument zur softwaregestützten Messung binauraler Raumimpulsantworten in mehreren Freiheitsgraden ) , 2006 .

[21]  E. H. Matsushima,et al.  THE PSYCHOPHYSICS OF VISUALLY DIRECTED WALKING , 2007 .

[22]  AUDITORY-VISUAL INTERACTION IN REAL AND VIRTUAL ROOMS , 2002 .

[23]  Ville Pulkki,et al.  Psychoacoustic Cues in Room Size Perception , 2004 .

[24]  Ag Armin Kohlrausch,et al.  Audio—Visual Interaction in the Context of Multi-Media Applications , 2005 .

[25]  Roberta L. Klatzky,et al.  Auditory Distance Perception in Real, Virtual, and Mixed Environments , 1999 .

[26]  Tien Dat Nguyen,et al.  How does presentation method and measurement protocol affect distance estimation in real and virtual environments? , 2010, TAP.

[27]  D. Teller,et al.  Simultaneous Color Contrast in 4-Month-Old Infants , 2009, Perception.

[28]  Densil Cabreraa,et al.  Auditory Room Size Perception for Modeled and Measured Rooms , 2005 .

[29]  Daniel Västfjäll,et al.  ECOLOGICAL ACOUSTICS AND THE MULTI-MODAL PERCEPTION OF ROOMS: REAL AND UNREAL EXPERIENCES OF AUDITORY-VISUAL VIRTUAL ENVIRONMENTS , 2001 .

[30]  Pavel Zahorik,et al.  Assessing auditory distance perception using virtual acoustics. , 2002, The Journal of the Acoustical Society of America.

[31]  Yôiti Suzuki,et al.  Control of auditory distance perception based on the auditory parallax model , 2001 .

[32]  Francis Morgan Boland Depth Perception in Interactive Virtual Acoustic Environments using Higher Order Ambisonic Soundfields , 2010 .

[33]  W. Marsden I and J , 2012 .

[34]  M. Gardner Proximity image effect in sound localization. , 1968, The Journal of the Acoustical Society of America.

[36]  C. Spence,et al.  Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task , 2006, Neuroscience Letters.

[37]  Marc Rébillat,et al.  Audio, visual, and audio-visual egocentric distance perception in virtual environments. , 2011 .

[38]  Densil Cabrera,et al.  AUDITORY ROOM SIZE PERCEIVED FROM A ROOM ACOUSTIC SIMULATION WITH AUTOPHONIC STIMULI , 2011 .

[39]  Atsushi Marui,et al.  The Influence of Camera Focal Length in the Direct-To-Reverb Ratio Suitability and Its Effect in the Perception of Distance for a Motion Picture , 2011 .

[40]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[41]  D H Mershon,et al.  Visual capture in auditory distance perception: proximity image effect reconsidered. , 1980, The Journal of auditory research.