Eye-position effects in directional hearing

The influence of gaze direction on azimuthal sound localization was investigated by presenting free-field acoustical stimuli in combination with a visual fixation task. In Experiment 1, a two-alternative forced-choice method was employed. While fixating visual targets, subjects judged whether noise bursts, presented from various directions, were perceived as being on the left or right of either a visual reference indicating straight ahead or the subjective straight-ahead direction. The psychometric functions measured with the first task shifted consistently opposite to the direction of eccentric gaze, i.e., the location of the auditory stimulus was perceived as shifted toward the direction of gaze. The mean magnitude of the shift was 4.7 degrees over a range of fixation angles up to 45 degrees on either side. Without an external reference indicating straight ahead, shifts of sound localization were inconsistent, either opposite or toward the direction of fixation in individual subjects. In Experiment 2, subjects orientated their head toward sound stimuli while fixating visual targets in various directions. As in Experiment 1, head position as a measure of sound localization shifted significantly toward the direction of eccentric gaze when a visual reference of the head median plane was present, and the results were inconsistent across subjects when it was absent. The results indicate a significant effect of gaze direction on the spatial agreement of auditory and visual perception which may be based on the superposition of distinct auditory and visual eye-position effects. The effect is in agreement with previous neurophysiological results that have suggested an incomplete neural transformation of auditory spatial coordinates from a craniocentric into an oculocentric frame of reference.

[1]  E. Vaadia,et al.  Unit study of monkey frontal cortex: active localization of auditory and of visual stimuli. , 1986, Journal of neurophysiology.

[2]  J. C. Middlebrooks,et al.  A neural code for auditory space in the cat's superior colliculus , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  L. Thurstone.  A factorial study of perception , 1944 .

[4]  R. Andersen,et al.  Spatially tuned auditory responses in area LIP of macaques performing delayed memory saccades to acoustic targets. , 1996, Journal of neurophysiology.

[5]  G. L. Walls.  A theory of ocular dominance. , 1951, A.M.A. archives of ophthalmology.

[6]  R. Bohlander,et al.  Eye Position and Visual Attention Influence Perceived Auditory Direction , 1984, Perceptual and motor skills.

[7]  R. Guski.  Auditory Localization: Effects of Reflecting Surfaces , 1990, Perception.

[8]  Otmar Bock,et al.  Localization of objects in the peripheral visual field , 1993, Behavioural Brain Research.

[9]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[10]  L. Spillmann,et al.  A comparison of perceptive and receptive fields in man and monkey. , 1987, Human neurobiology.

[11]  ERNST PÖPPEL.  Comment on “Visual System's View of Acoustic Space” , 1973, Nature.

[12]  S. Coren.  The lateral preference inventory for measurement of handedness, footedness, eyedness, and earedness: Norms for young adults , 1993 .

[13]  M. Wallace,et al.  Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. , 1993, Journal of neurophysiology.

[14]  FRANK MORRELL,et al.  Visual System's View of Acoustic Space , 1972, Nature.

[15]  W H Ehrenstein,et al.  Auditory-visual shift in localization depending on gaze direction. , 1996, Neuroreport.

[16]  T. A. Ryan,et al.  The Influence of Eye Movement and Position on Auditory Localization , 1941 .

[17]  Nicholas J. Ward,et al.  Effect of Background Scene Complexity and Field Dependence on the Legibility of Head-Up Displays for Automotive Applications , 1995, Hum. Factors.

[18]  E. Knudsen.  Auditory and visual maps of space in the optic tectum of the owl , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  D L Sparks,et al.  Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. , 1987, Journal of neurophysiology.

[20]  L F Dell'Osso,et al.  Audio-ocular response characteristics. , 1978, Sensory processes.

[21]  C. L. Morgan.  Constancy of egocentric visual direction , 1978, Perception & psychophysics.

[22]  Z. Wollberg,et al.  Frontal cortex of the awake squirrel monkey: responses of single cells to visual and auditory stimuli , 1980, Brain Research.

[23]  C. R. Michael,et al.  Integration of auditory information in the cat's visual cortex. , 1973, Vision research.

[24]  W H Ehrenstein,et al.  A Cross-Modal Aftereffect: Auditory Displacement following Adaptation to Visual Motion , 1996, Perceptual and motor skills.

[25]  E Vaadia,et al.  Single-unit activity related to active localization of acoustic and visual stimuli in the frontal cortex of the rhesus monkey. , 1989, Brain, behavior and evolution.

[26]  Willard R. Thurlow,et al.  The effects of eye position and expectation on sound localization , 1971 .

[27]  S. Ito.  Prefrontal unit activity of macaque monkeys during auditory and visual reaction time tasks , 1982, Brain Research.

[28]  D R Goodenough,et al.  A Review of Individual Differences in Field Dependence as a Factor in Auto Safety1 , 1976, Human factors.

[29]  A J King,et al.  Spatial response properties of acoustically responsive neurons in the superior colliculus of the ferret: a map of auditory space. , 1987, Journal of neurophysiology.