Auditory Spatial Perception Dynamically Realigns with Changing Eye Position

Audition and vision both form spatial maps of the environment in the brain, and their congruency requires alignment and calibration. Because audition is referenced to the head and vision is referenced to movable eyes, the brain must accurately account for eye position to maintain alignment between the two modalities as well as perceptual space constancy. Changes in eye position are known to variably, but inconsistently, shift sound localization, suggesting subtle shortcomings in the accuracy or use of eye position signals. We systematically and directly quantified sound localization across a broad spatial range and over time after changes in eye position. A sustained fixation task addressed the spatial (steady-state) attributes of eye position-dependent effects on sound localization. Subjects continuously fixated visual reference spots straight ahead (center), to the left (20°), or to the right (20°) of the midline in separate sessions while localizing auditory targets using a laser pointer guided by peripheral vision. An alternating fixation task focused on the temporal (dynamic) aspects of auditory spatial shifts after changes in eye position. Localization proceeded as in sustained fixation, except that eye position alternated between the three fixation references over multiple epochs, each lasting minutes. Auditory space shifted by ∼40% toward the new eye position and dynamically over several minutes. We propose that this spatial shift reflects an adaptation mechanism for aligning the “straight-ahead” of perceived sensory–motor maps, particularly during early childhood when normal ocular alignment is achieved, but also resolving challenges to normal spatial perception throughout life.

[1]  H. Kornhuber,et al.  Natural and drug-induced variations of velocity and duration of human saccadic eye movements: Evidence for a control of the neural pulse generator by local feedback , 2004, Biological Cybernetics.

[2]  J. C. Middlebrooks Narrow-band sound localization related to external ear acoustics. , 1992, The Journal of the Acoustical Society of America.

[3]  R. Andersen,et al.  Responses to auditory stimuli in macaque lateral intraparietal area. II. Behavioral modulation. , 1999, Journal of neurophysiology.

[4]  R. Tomlinson,et al.  Combined eye-head gaze shifts in the primate. I. Metrics. , 1986, Journal of neurophysiology.

[5]  M. Dürsteler,et al.  Normal eye drift and saccadic drift correction in darkness , 1985 .

[6]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[7]  R. Frecker,et al.  End-point nystagmus and ocular drift: An experimental and theoretical study , 1990, Vision Research.

[8]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[9]  C. K. Peck,et al.  Saccadic eye movements to visual and auditory targets , 1997, Experimental Brain Research.

[10]  E. Knudsen,et al.  Creating a unified representation of visual and auditory space in the brain. , 1995, Annual review of neuroscience.

[11]  D. Robinson Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[12]  D. Sparks,et al.  Sensorimotor integration in the primate superior colliculus. I. Motor convergence. , 1987, Journal of neurophysiology.

[13]  R. Bohlander,et al.  Eye Position and Visual Attention Influence Perceived Auditory Direction , 1984, Perceptual and motor skills.

[14]  C. Scudder A new local feedback model of the saccadic burst generator. , 1988, Journal of neurophysiology.

[15]  R. Wurtz,et al.  Interaction of the frontal eye field and superior colliculus for saccade generation. , 2001, Journal of neurophysiology.

[16]  D. Sparks,et al.  Dissociation of visual and saccade-related responses in superior colliculus neurons. , 1980, Journal of neurophysiology.

[17]  Jörg Lewald,et al.  Eye-position effects in directional hearing , 1997, Behavioural Brain Research.

[18]  H. Versnel,et al.  Involvement of Monkey Inferior Colliculus in Spatial Hearing , 2004, The Journal of Neuroscience.

[19]  W H Ehrenstein,et al.  Auditory-visual shift in localization depending on gaze direction. , 1996, Neuroreport.

[20]  Y. Cohen,et al.  Discrimination of Functionally Referential Calls by Laboratory-Housed Rhesus Macaques: Implications for Neuroethological Studies , 2003, Brain, Behavior and Evolution.

[21]  L C Populin,et al.  Human Gaze Shifts to Acoustic and Visual Targets , 2002, Annals of the New York Academy of Sciences.

[22]  A. John van Opstal,et al.  A novel interpretation for the collicular role in saccade generation , 1995, Biological Cybernetics.

[23]  R. Andersen,et al.  The influence of the angle of gaze upon the excitability of the light- sensitive neurons of the posterior parietal cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Stephan Getzmann,et al.  The effect of eye position and background noise on vertical sound localization , 2002, Hearing Research.

[25]  Daniel J Tollin,et al.  Effect of eye position on saccades and neuronal responses to acoustic stimuli in the superior colliculus of the behaving cat. , 2004, Journal of neurophysiology.

[26]  J. C. Middlebrooks,et al.  Two-dimensional sound localization by human listeners. , 1990, The Journal of the Acoustical Society of America.

[27]  W. Becker,et al.  Accuracy of saccadic eye movements and maintenance of eccentric eye positions in the dark. , 1973, Vision research.

[28]  D L Sparks,et al.  Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. , 1987, Journal of neurophysiology.

[29]  S. Squatrito,et al.  Gaze field properties of eye position neurones in areas MST and 7a of the macaque monkey , 1996, Visual Neuroscience.

[30]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[31]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[32]  K. Hoffmann,et al.  Eye position effects in monkey cortex. II. Pursuit- and fixation-related activity in posterior parietal areas LIP and 7A. , 1997, Journal of neurophysiology.

[33]  P. Schiller,et al.  Single-unit recording and stimulation in superior colliculus of the alert rhesus monkey. , 1972, Journal of neurophysiology.

[34]  D. Sparks,et al.  Site and parameters of microstimulation: evidence for independent effects on the properties of saccades evoked from the primate superior colliculus. , 1996, Journal of neurophysiology.

[35]  F Bremmer,et al.  Eye position encoding in the macaque ventral intraparietal area (VIP). , 1999, Neuroreport.

[36]  Ankoor S. Shah,et al.  Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex. , 2004, Journal of neurophysiology.

[37]  J. L. Conway,et al.  Deficits in eye movements following frontal eye-field and superior colliculus ablations. , 1980, Journal of neurophysiology.

[38]  Jörg Lewald,et al.  Visual and proprioceptive shifts in perceived egocentric direction induced by eye-position , 2000, Vision Research.

[39]  A. John Van Opstal,et al.  Plasticity in human sound localization induced by compressed spatial vision , 2003, Nature Neuroscience.

[40]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[41]  R. Andersen,et al.  Responses to auditory stimuli in macaque lateral intraparietal area. I. Effects of training. , 1999, Journal of neurophysiology.

[42]  M. Hepp-Reymond,et al.  Eye and head movements to auditory targets , 2004, Experimental Brain Research.

[43]  J. Groh,et al.  Eye Position Affects Activity in Primary Auditory Cortex of Primates , 2003, Current Biology.

[44]  D. Sparks,et al.  Eye-head coordination during head-unrestrained gaze shifts in rhesus monkeys. , 1997, Journal of neurophysiology.

[45]  K. Hoffmann,et al.  Eye position effects in monkey cortex. I. Visual and pursuit-related activity in extrastriate areas MT and MST. , 1997, Journal of neurophysiology.

[46]  W H Ehrenstein,et al.  Auditory-visual spatial integration: a new psychophysical approach using laser pointing to acoustic targets. , 1998, The Journal of the Acoustical Society of America.

[47]  D. Kurylo,et al.  Effects of eye position on auditory localization and neural representation of space in superior colliculus of cats , 2004, Experimental Brain Research.

[48]  R. Andersen,et al.  The role of the posterior parietal cortex in coordinate transformations for visual-motor integration. , 1988, Canadian journal of physiology and pharmacology.

[49]  I. D. Hood FURTHER OBSERVATIONS ON THE PHENOMENON OF REBOUND NYSTAGMUS , 1981, Annals of the New York Academy of Sciences.

[50]  Y. Cohen,et al.  Eye-centered, head-centered, and complex coding of visual and auditory targets in the intraparietal sulcus. , 2005, Journal of neurophysiology.

[51]  Jennifer M. Groh,et al.  Converting neural signals from place codes to rate codes , 2001, Biological Cybernetics.

[52]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[53]  J. Winn,et al.  Brain , 1878, The Lancet.

[54]  R. Tomlinson,et al.  Combined eye-head gaze shifts in the primate. II. Interactions between saccades and the vestibuloocular reflex. , 1986, Journal of neurophysiology.

[55]  W Noble,et al.  Available response choices affect localization of sound , 1995, Perception & psychophysics.

[56]  R. Andersen,et al.  Reaches to Sounds Encoded in an Eye-Centered Reference Frame , 2000, Neuron.

[57]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[58]  Yale E Cohen,et al.  Auditory saccades from different eye positions in the monkey: implications for coordinate transformations. , 2004, Journal of neurophysiology.

[59]  John A. Baro,et al.  Effects of eye position on saccadic eye movements and on the neuronal responses to auditory and visual stimuli in cat superior colliculus , 2004, Experimental Brain Research.

[60]  N. Shimizu [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[61]  R. Andersen,et al.  Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. , 1996, Journal of neurophysiology.

[62]  W H Ehrenstein,et al.  Spatial coordinates of human auditory working memory. , 2001, Brain research. Cognitive brain research.

[63]  Sylvain Choisel,et al.  A pointing Technique with Visual Feedback for Sound Source Localization Experiments , 2003 .

[64]  A. Opstal,et al.  Influence of eye position on activity in monkey superior colliculus. , 1995, Journal of neurophysiology.

[65]  David L. Sparks,et al.  Sensori-motor integration in the primate superior colliculus , 1991 .

[66]  C. Galletti,et al.  Cortical mechanisms of visual space representation , 1993 .

[67]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[68]  H. Simonsz,et al.  A reexamination of end-point and rebound nystagmus in normals. , 1990, Investigative ophthalmology & visual science.

[69]  G. Recanzone Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[70]  W. Ehrenstein,et al.  The effect of eye position on auditory lateralization , 1996, Experimental Brain Research.

[71]  S. Celebrini,et al.  Gaze direction controls response gain in primary visual-cortex neurons , 1999, Nature.

[72]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[73]  J. Lewald,et al.  Horizontal and vertical effects of eye-position on sound localization , 2006, Hearing Research.

[74]  D. Sparks,et al.  Saccades to somatosensory targets. I. behavioral characteristics. , 1996, Journal of neurophysiology.

[75]  M. J. Nichols,et al.  Nonstationary properties of the saccadic system: new constraints on models of saccadic control. , 1995, Journal of neurophysiology.

[76]  D. Boussaoud,et al.  Gaze effects in the cerebral cortex: reference frames for space coding and action , 1999, Experimental Brain Research.

[77]  G. S. Russo,et al.  Frontal eye field activity preceding aurally guided saccades. , 1994, Journal of neurophysiology.

[78]  D. Sparks,et al.  Saccades to remembered targets exhibit enhanced orbital position effects in monkeys , 2001, Vision Research.

[79]  Jennifer M. Groh,et al.  Two models for transforming auditory signals from head-centered to eye-centered coordinates , 1993, Biological Cybernetics.

[80]  Both Interaural and Spectral Cues Impact Sound Localization in Azimuth , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[81]  Robert A Jacobs,et al.  Bayesian integration of visual and auditory signals for spatial localization. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[82]  Bremmer,et al.  Eye position encoding in the macaque posterior parietal cortex , 1998, The European journal of neuroscience.

[83]  Jan W. H. Schnupp,et al.  Passive eye displacement alters auditory spatial receptive fields of cat superior colliculus neurons , 2001, Nature Neuroscience.

[84]  Willard R. Thurlow,et al.  The effects of eye position and expectation on sound localization , 1971 .

[85]  Zahn,et al.  The audioocular response: intersensory delay. , 1979, Sensory processes.

[86]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[87]  J. Malpeli,et al.  Responses of neurons in primary visual cortex are modulated by eye position. , 1993, Journal of neurophysiology.

[88]  Bernhard U. Seeber,et al.  A New Method for Localization Studies , 2002 .

[89]  K. Guo,et al.  Eye position‐dependent activation of neurones in striate cortex of macaque , 1997, Neuroreport.

[90]  Emilio Salinas,et al.  Gain Modulation A Major Computational Principle of the Central Nervous System , 2000, Neuron.

[91]  S. Inati,et al.  Eye Position Influences Auditory Responses in Primate Inferior Colliculus , 2001, Neuron.

[92]  Jörg Lewald,et al.  The effect of gaze eccentricity on perceived sound direction and its relation to visual localization , 1998, Hearing Research.

[93]  A. Opstal,et al.  Human eye-head coordination in two dimensions under different sensorimotor conditions , 1997, Experimental Brain Research.

[94]  N I Durlach,et al.  Evaluation of response methods for the localization of nearby objects , 2000, Perception & psychophysics.

[95]  A. Opstal,et al.  Auditory-evoked saccades in two dimensions: Dynamical characteristics, influence of eye position, and Sound source spectrum , 1994 .