The Role of Vision in Auditory Distance Perception

In humans, multisensory interaction is an important strategy for improving the detection of stimuli of different nature and reducing the variability of response. It is known that the presence of visual information affects the auditory perception in the horizontal plane (azimuth), but there are few researches that study the influence of vision in the auditory distance perception. In general, the data obtained from these studies are contradictory and do not completely define the way in which visual cues affect the apparent distance of a sound source. Here psychophysical experiments on auditory distance perception in humans are performed, including and excluding visual cues. The results show that the apparent distance from the source is affected by the presence of visual information and that subjects can store in their memory a representation of the environment that later improves the perception of distance.

[1]  Pawan Sinha,et al.  Top-down influences on stereoscopic depth-perception , 1998, Nature Neuroscience.

[2]  Mikael Fernström,et al.  Listening to Rooms and Objects , 1999 .

[3]  Tammo Houtgast,et al.  Auditory distance perception in rooms , 1999, Nature.

[4]  J L Semmlow,et al.  The role of accommodative convergence at the limits of fusional vergence. , 1979, Investigative ophthalmology & visual science.

[5]  A. Bronkhorst,et al.  Auditory distance perception in humans : A summary of past and present research , 2005 .

[6]  R. Klatzky,et al.  Assessing auditory distance perception using perceptually directed action , 1998, Perception & psychophysics.

[7]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[8]  Ville Pulkki,et al.  Psychoacoustic Cues in Room Size Perception , 2004 .

[9]  P. Bertelson,et al.  Cross-modal bias and perceptual fusion with auditory-visual spatial discordance , 1981, Perception & psychophysics.

[10]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[11]  P. Coleman.  Failure to Localize the Source Distance of an Unfamiliar Sound , 1962 .

[12]  J. Philbeck,et al.  Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions. , 1997, Journal of experimental psychology. Human perception and performance.

[13]  Jesper Sandvad.  Auditory perception of reverberant surroundings , 1999 .

[14]  W E Simpson,et al.  Head movement does not facilitate perception of the distance of a source of sound. , 1973, The American journal of psychology.

[15]  David H. Warren,et al.  Intermodality interactions in spatial localization , 1970 .

[16]  Wm Wil Wagenaars.  Localization of Sound in a Room with Reflecting Walls , 1989 .

[17]  S S Fukusima,et al.  Visual perception of egocentric distance as assessed by triangulation. , 1997, Journal of experimental psychology. Human perception and performance.

[18]  Michel Laurent,et al.  Rôle des modalités de prise d'informations visuelles dans un pointage locomoteur , 1985 .

[19]  B. Jones.  Visual facilitation of auditory localization in schoolchildren: A signal detection analysis , 1975 .

[20]  C. V. Jackson,et al.  Visual Factors in Auditory Localization , 1953 .

[21]  D. H. Warren,et al.  The role of visual-auditory “compellingness” in the ventriloquism effect: Implications for transitivity among the spatial senses , 1981, Perception & psychophysics.

[22]  M Ohmi,et al.  Dynamic Occlusion and Motion Parallax in Depth Perception , 1988, Perception.

[23]  J. Vroomen,et al.  Sound enhances visual perception: cross-modal effects of auditory organization on vision. , 2000, Journal of experimental psychology. Human perception and performance.

[24]  J. Loomis,et al.  Visual space perception and visually directed action. , 1992, Journal of experimental psychology. Human perception and performance.

[25]  Densil Cabreraa,et al.  Auditory Room Size Perception for Modeled and Measured Rooms , 2005 .

[26]  Barbara G. Shinn-Cunningham,et al.  Learning Reverberation: Considerations for Spatial Auditory Displays , 2000 .

[27]  J. Thomson.  Is continuous visual monitoring necessary in visually guided locomotion? , 1983, Journal of experimental psychology. Human perception and performance.

[28]  E. McKone,et al.  Solving the upside-down puzzle: Why do upright and inverted face aftereffects look alike? , 2010, Journal of vision.

[29]  G VON BEKESY.  The moon illusion and similar auditory phenomena. , 1949, The American journal of psychology.

[30]  D. H. Warren,et al.  Sensory conflict in judgments of spatial direction , 1969 .

[31]  D H Mershon,et al.  Absolute and Relative Cues for the Auditory Perception of Egocentric Distance , 1979, Perception.

[32]  D. Mershon,et al.  Intensity and reverberation as factors in the auditory perception of egocentric distance , 1975 .

[33]  Ning Qian,et al.  Binocular Disparity Review and the Perception of Depth , 1997 .

[34]  A. D. Little,et al.  Effects of Room Reflectance and Background Noise on Perceived Auditory Distance , 1989, Perception.

[35]  P Zahorik,et al.  Estimating Sound Source Distance with and without Vision , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[36]  K. Saberi,et al.  Auditory psychomotor coordination and visual search performance , 1990, Perception & psychophysics.

[37]  Pavel Zahorik,et al.  Assessing auditory distance perception using virtual acoustics. , 2002, The Journal of the Acoustical Society of America.

[38]  B. R. Shelton,et al.  The influence of vision on the absolute identification of sound-source position , 1980, Perception & psychophysics.

[39]  J. Loomis,et al.  Visual space perception and visually directed action. , 1992 .

[40]  Robert A Jacobs,et al.  Bayesian integration of visual and auditory signals for spatial localization. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[41]  Anne Treisman,et al.  Natural cross-modal mappings between visual and auditory features. , 2011, Journal of vision.

[42]  W C GOGEL,et al.  Convergence as a cue to absolute distance. , 1961, Report. Army Medical Research Laboratory.

[43]  W R Thurlow,et al.  Certain Determinants of the “Ventriloquism Effect” , 1973, Perceptual and motor skills.

[44]  G. Recanzone.  Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[45]  D. Cabrera,et al.  Twelfth International Congress on Sound and Vibration PERCEIVED ROOM SIZE AND SOURCE DISTANCE IN FIVE SIMULATED CONCERT AUDITORIA , 2005 .

[46]  G. Békésy,et al.  The moon illusion and similar auditory phenomena , 1949 .

[47]  Barry E Stein,et al.  Visual Experience Is Necessary for the Development of Multisensory Integration , 2004, The Journal of Neuroscience.

[48]  J. M. Foley.  Binocular distance perception. , 1980, Psychological review.

[49]  J.B.J. Smeets,et al.  A new binocular cue for absolute distance: Disparity relative to the most distant structure , 2010, Vision Research.

[50]  J R Simon,et al.  Effects of an irrelevant auditory stimulus on visual choice reaction time. , 1970, Journal of experimental psychology.

[51]  N. Qian.  Binocular Disparity and the Perception of Depth , 1997, Neuron.

[52]  Andrew J. King,et al.  Visual influences on auditory spatial learning , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[53]  Søren H. Nielsen,et al.  Auditory Distance Perception in Different Rooms , 1993 .

[54]  Lawrence G. McDade,et al.  Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli , 1989, Journal of Cognitive Neuroscience.

[55]  P. Bertelson,et al.  The After-Effects of Ventriloquism , 1974, The Quarterly journal of experimental psychology.

[56]  D H Mershon,et al.  Visual capture in auditory distance perception: proximity image effect reconsidered. , 1980, The Journal of auditory research.

[57]  Durand R. Begault,et al.  Perceptual Effects of Synthetic Reverberation on Three-Dimensional Audio Systems , 1992 .

[58]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[59]  W E Simpson,et al.  Estimation of distance of a source of sound. , 1968, The American journal of psychology.

[60]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[61]  Ian P. Howard,et al.  Auditory Distance Perception , 2012 .

[62]  W. D. Neff,et al.  Apparent distance of sounds recorded in echoic and anechoic chambers. , 1980, Journal of experimental psychology. Human perception and performance.

[63]  J. Loomis.  Looking down is looking up , 2001, Nature.

[64]  M. Gardner.  Proximity image effect in sound localization. , 1968, The Journal of the Acoustical Society of America.

[65]  D. Elliott.  Continuous visual information may be important after all: a failure to replicate Thomson (1983). , 1986, Journal of experimental psychology. Human perception and performance.

[66]  J. Lewald.  Rapid adaptation to auditory-visual spatial disparity. , 2002, Learning & memory.

[67]  J. Wolfe,et al.  When the animal destroys the beach, the beach destroys the animal. Mutually assured destruction in gist processing , 2010 .