Audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments

We present a study on audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments. Audio-visual rendering is provided using tracked passive visual stereoscopy and acoustic wave field synthesis (WFS). Distances are estimated using indirect blind-walking (triangulation) under each rendering condition. Experimental results show that distances perceived in the virtual environment are systematically overestimated for rendered distances closer than the position of the audio-visual rendering system and underestimated for farther distances. Interestingly, subjects perceived each virtual object at a modality-independent distance when using the audio modality, the visual modality, or the combination of both. WFS was able to synthesise perceptually meaningful sound fields. Dynamic audio-visual cues were used by subjects when estimating the distances in the virtual world. Moving may have provided subjects with a better visual distance perception of close distances than if they were static. No correlation between the feeling of presence and the visual distance underestimation has been found. To explain the observed perceptual distance compression, it is proposed that, due to conflicting distance cues, the audio-visual rendering system physically anchors the virtual world to the real world. Virtual objects are thus attracted by the physical audio-visual rendering system.

[1]  Karsten Bormann,et al.  Presence and the Utility of Audio Spatialization , 2005, Presence: Teleoperators & Virtual Environments.

[2]  Michael A. Gerzon,et al.  Ambisonics in Multichannel Broadcasting and Video , 1985 .

[3]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.

[4]  Jodie M. Plumert,et al.  Distance perception in real and virtual environments , 2004, APGV '04.

[5]  S S Fukusima,et al.  Visual perception of egocentric distance as assessed by triangulation. , 1997, Journal of experimental psychology. Human perception and performance.

[6]  Etienne Corteel,et al.  Objective and subjective comparison of electrodynamic and MAP loudspeakers for Wave Field Synthesis , 2007 .

[7]  A. Bronkhorst,et al.  Auditory distance perception in humans : A summary of past and present research , 2005 .

[8]  Etienne Corteel.  Caractérisation et extensions de la wave field synthesis en conditions réelles , 2004 .

[9]  Jack M. Loomis,et al.  Absolute motion parallax weakly determines visual scale in real and virtual environments , 1995, Electronic Imaging.

[10]  R. Klatzky,et al.  Assessing auditory distance perception using perceptually directed action , 1998, Perception & psychophysics.

[11]  Michael W. Haas,et al.  Virtual and Adaptive Environments: Applications, Implications, and Human Performance Issues , 2003 .

[12]  Christoph Pörschmann,et al.  Investigations Into the Velocity and Distance Perception of Moving Sound Sources , 2009 .

[13]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[14]  Frank Boland,et al.  Distance Perception in Interactive Virtual Acoustic Environments using First and Higher Order Ambiso , 2012 .

[15]  W. Wiest,et al.  Stevens's exponent for psychophysical scaling of perceived, remembered, and inferred distance. , 1985, Psychological bulletin.

[16]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[17]  Akira Morita,et al.  Distance Control System for a Sound Image , 1991 .

[18]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[19]  J. Edward Swan,et al.  Measurement Protocols for Medium-Field Distance Perception in Large-Screen Immersive Displays , 2009, 2009 IEEE Virtual Reality Conference.

[20]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[21]  Frank Melchior,et al.  Combining Wave Field Synthesis and Multi-Viewer Stereo Displays , 2006, IEEE Virtual Reality Conference (VR 2006).

[22]  Makoto Sato,et al.  Influence of resolution degradation on distance estimation in virtual space displaying static and dynamic image , 2005, 2005 International Conference on Cyberworlds (CW'05).

[23]  Uwe Kloos,et al.  Egocentric distance judgments in a large screen display immersive virtual environment , 2010, APGV '10.

[24]  James E. Cutting,et al.  HIGH-PERFORMANCE COMPUTING AND HUMAN VISION I , 2002 .

[25]  Roy A. Ruddle,et al.  Virtual and Adaptive Environments: Applications, Implications, and Human Performance Issues , 2004, Presence: Teleoperators & Virtual Environments.

[26]  Tien Dat Nguyen,et al.  How does presentation method and measurement protocol affect distance estimation in real and virtual environments? , 2010, TAP.

[27]  Victoria Interrante,et al.  Elucidating Factors that Can Facilitate Veridical Spatial Perception in Immersive Virtual Environments , 2007, PRESENCE: Teleoperators and Virtual Environments.

[28]  Peter A Howarth,et al.  Potential hazards of viewing 3‐D stereoscopic television, cinema and computer games: a review , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[29]  Etienne Corteel,et al.  Objective and Subjective Analysis of Localisation Accuracy in Wave Field Synthesis , 2008 .

[30]  Jack M. Loomis,et al.  Auditory distance perception by translating observers , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[31]  Vincent Koehl,et al.  Interaction between auditory and visual distance cues in virtual reality applications , 2011 .

[32]  Stephen Grossberg,et al.  Depth-tuning of occluded moving objects by boundary selection of motion signals , 2005 .

[33]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[34]  Etienne Corteel,et al.  SMART-I2: “Spatial multi-user audio-visual real-time interactive interface”, A broadcast application context , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[35]  D H Ashmead,et al.  Contribution of listeners' approaching motion to auditory distance perception. , 1995, Journal of experimental psychology. Human perception and performance.

[36]  Tammo Houtgast,et al.  Auditory distance perception in rooms , 1999, Nature.

[37]  Will Spijkers,et al.  Depth Perception in Virtual Reality: Distance Estimations in Peri- and Extrapersonal Space , 2008, Cyberpsychology Behav. Soc. Netw..

[38]  J. Andre,et al.  Using verbal and blind-walking distance estimates to investigate the two visual systems hypothesis , 2006, Perception & psychophysics.

[39]  Marcelo Knörich Zuffo,et al.  Improving spatial perception through sound field simulation in VR , 2005, IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2005..

[40]  W. Wiest,et al.  Stevens's exponent for psychophysical scaling of perceived, remembered, and inferred distance. , 1985, Psychological bulletin.

[41]  Frederick P. Brooks.  What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[42]  Ryad Chellali,et al.  Depth Perception within Virtual Environments: A Comparative Study Between Wide Screen Stereoscopic Displays and Head Mounted Devices , 2009, 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns.

[43]  Mark Nawrot,et al.  The motion/pursuit law for visual depth perception from motion parallax , 2009, Vision Research.

[44]  M. Russell,et al.  Sound Source Perception in a Two-Dimensional Setting: Comparison of Action and Nonaction-Based Response Tasks , 2006 .