Audiovisual links in exogenous covert spatial orienting

Subjects judged the elevation (up vs. down, regardless of laterality) of peripheral auditory or visual targets, following uninformative cues on either side with an intermediate elevation. Judgments were better for targets in either modality when preceded by an uninformative auditory cue on the side of the target. Experiment 2 ruled out nonattentional accounts for these spatial cuing effects. Experiment 3 found that visual cues affected elevation judgments for visual but not auditory targets. Experiment 4 confirmed that the effect on visual targets was attentional. In Experiment 5, visual cues produced spatial cuing when targets were always auditory, but saccades toward the cue may have been responsible. No such visual-to-auditory cuing effects were found in Experiment 6 when saccades were prevented, though they were present when eye movements were not monitored. These results suggest a one-way cross-modal dependence in exogenous covert orienting whereby audition influences vision, but not vice versa. Possible reasons for this asymmetry are discussed in terms of the representation of space within the brain.

[1]  T. Gold Hearing , 1953, Transactions of the IRE Professional Group on Information Theory.

[2]  A. Mills On the minimum audible angle , 1958 .

[3]  A. Mills Lateralization of High‐Frequency Tones , 1960 .

[4]  E. N. Solokov Perception and the conditioned reflex , 1963 .

[5]  J. Rutschmann,et al.  Perception of Temporal Order of Stimuli Differing in Sense Mode and Simple Reaction Time , 1964, Perceptual and motor skills.

[6]  R. Irving,et al.  Visual and Nonvisual Auditory Systems in Mammals , 1966, Science.

[7]  R. Irving,et al.  The superior olivary complex and audition: A comparative study , 1967, The Journal of comparative neurology.

[8]  Simple visual and simple auditory reaction , 1968 .

[9]  A J Dinnerstein,et al.  Intermodal Perception of Temporal Order and Motor Skills: Effects of Age , 1968, Perceptual and motor skills.

[10]  Rogers Elliott Simple visual and simple auditory reaction time: A comparison , 1968 .

[11]  R. Butler,et al.  Factors that influence the localization of sound in the vertical plane. , 1968, The Journal of the Acoustical Society of America.

[12]  J R Simon,et al.  Effects of an irrelevant auditory stimulus on visual choice reaction time. , 1970, Journal of experimental psychology.

[13]  I H Bernstein,et al.  Effects of some variations in auditory input upon visual choice reaction time. , 1971, Journal of experimental psychology.

[14]  Bruce B. Platt,et al.  Auditory localization: The importance of eye movements and a textured visual environment , 1972 .

[15]  Daniel Gopher,et al.  Eye-movement patterns in selective listening tasks of focused attention , 1973 .

[16]  B. Kabanoff,et al.  Eye movements in auditory space perception , 1975 .

[17]  J R Simon,et al.  Effect of locus of warning tone on auditory choice reaction time , 1975, Memory & cognition.

[18]  E R Hafter,et al.  Difference thresholds for interaural delay. , 1975, The Journal of the Acoustical Society of America.

[19]  P Bertelson,et al.  Spatial Constraints on Focused Attention: Beyond the Right-Side Advantage , 1976, Perception.

[20]  Colin Blakemore,et al.  Functional organization in the superior colliculus of the golden hamster , 1976, The Journal of comparative neurology.

[21]  Spatial Effects in Speech Perception in the Absence of Spatial Competition , 1977, Perception.

[22]  M. Posner Chronometric explorations of mind , 1978 .

[23]  G. C. Thompson,et al.  Brain stem auditory pathways involved in reflexive head orientation to sound. , 1978, Journal of neurophysiology.

[24]  J Field,et al.  Newborn infants orient to sounds. , 1979, Child development.

[25]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[26]  John Duncan,et al.  The demonstration of capacity limitation , 1980, Cognitive Psychology.

[27]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[28]  Steiner Be,et al.  Control of pinna movements and sensorimotor register in cat superior colliculus. , 1981 .

[29]  R. Näätänen,et al.  Foreperiod and simple reaction time. , 1981 .

[30]  D. Reisberg,et al.  Eye position and the control of auditory attention. , 1981, Journal of experimental psychology. Human perception and performance.

[31]  B E Stein,et al.  Control of pinna movements and sensorimotor register in cat superior colliculus. , 1981, Brain, behavior and evolution.

[32]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[33]  A. R. Palmer,et al.  The representation of auditory space in the mammalian superior colliculus , 1982, Nature.

[34]  R. Wurtz,et al.  Brain mechanisms of visual attention. , 1982, Scientific American.

[35]  L. Soderblom,et al.  The moons of Saturn , 1982 .

[36]  Hemispheric prevalence in acoustical attention , 1983, Brain and Cognition.

[37]  S D Esterly,et al.  Monaural occlusion alters sound localization during a sensitive period in the barn owl , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  J. C. Middlebrooks,et al.  A neural code for auditory space in the cat's superior colliculus , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  M. Posner,et al.  Components of visual orienting , 1984 .

[40]  B. Stein,et al.  Multimodal Representation in the Superior Colliculus and Optic Tectum , 1984 .

[41]  M. Posner,et al.  Inhibition of return : Neural basis and function , 1985 .

[42]  A. H. C. Heijden,et al.  Visual selective attention: Introductory remarks , 1986, Psychological research.

[43]  J. Findlay,et al.  The Relationship between Eye Movements and Spatial Attention , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[44]  L. Aitkin The auditory midbrain , 1979, Trends in Neurosciences.

[45]  L. Aitkin Auditory Midbrain, The , 1986 .

[46]  M. Posner,et al.  Does attention affect visual feature integration? , 1986, Journal of experimental psychology. Human perception and performance.

[47]  Auditory localization in a free field using discrimination procedures. , 1987, The Journal of auditory research.

[48]  A DIGITALLY CONTROLLED VERTICAL HOOP SYSTEM FOR THE PRESENTATION OF FREE-FIELD AUDITORY AND VISUAL-STIMULI , 1987 .

[49]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[50]  A. Reeves,et al.  Focused auditory attention and frequency selectivity , 1987, Perception & psychophysics.

[51]  G. Rhodes Auditory attention and the representation of spatial information , 1987, Perception & psychophysics.

[52]  R. Klein,et al.  Is Posner's "beam" the same as Treisman's "glue"?: On the relation between visual orienting and feature integration theory. , 1987, Journal of experimental psychology. Human perception and performance.

[53]  H. Buchtel,et al.  Spatial attentional shifts: Implications for the role of polysensory mechanisms , 1988, Neuropsychologia.

[54]  C. Blakemore,et al.  Developmental plasticity in the visual and auditory representations in the mammalian superior colliculus , 1988, Nature.

[55]  D. Sparks Neural cartography: sensory and motor maps in the superior colliculus. , 1988, Brain, behavior and evolution.

[56]  C. Umilta,et al.  Splitting visual space with attention. , 1989, Journal of experimental psychology. Human perception and performance.

[57]  D. Sparks,et al.  The deep layers of the superior colliculus. , 1989, Reviews of oculomotor research.

[58]  R. Ivry,et al.  Illusory conjunctions inside and outside the focus of attention. , 1989, Journal of experimental psychology. Human perception and performance.

[59]  M. Farah,et al.  Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal? , 1989, Neuropsychologia.

[60]  H. J. Muller,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. , 1989, Journal of experimental psychology. Human perception and performance.

[61]  K. E. Binns,et al.  The Maturation of the Superior Collicular Map of Auditory Space in the Guinea Pig is Disrupted by Developmental Visual Deprivation , 1990, The European journal of neuroscience.

[62]  K. E. Binns,et al.  The Maturation of the Superior Collicular Map of Auditory Space in the Guinea Pig is Disrupted by Developmental Auditory Deprivation , 1990, The European journal of neuroscience.

[63]  R. Desimone,et al.  Attentional control of visual perception: cortical and subcortical mechanisms. , 1990, Cold Spring Harbor symposia on quantitative biology.

[64]  H. Hawkins,et al.  Visual attention modulates signal detectability. , 1990 .

[65]  K. Saberi,et al.  Auditory psychomotor coordination and visual search performance , 1990, Perception & psychophysics.

[66]  Avishai Henik,et al.  Extrageniculate Contributions to Reflex Visual Orienting in Normal Humans: A Temporal Hemifield Advantage , 1991, Journal of Cognitive Neuroscience.

[67]  E I Knudsen,et al.  Visual instruction of the neural map of auditory space in the developing optic tectum. , 1991, Science.

[68]  Newborns' head orientation toward trains of brief sounds. , 1991, The Journal of the Acoustical Society of America.

[69]  E I Knudsen,et al.  Stretched and upside-down maps of auditory space in the optic tectum of blind-reared owls; acoustic basis and behavioral correlates , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[70]  A Cohen,et al.  Density effects in conjunction search: evidence for a coarse location mechanism of feature integration. , 1991, Journal of experimental psychology. Human perception and performance.

[71]  D. Withington,et al.  The effect of binocular lid suture on auditory responses in the guinea-pig superior colliculus , 1992, Neuroscience Letters.

[72]  Pascal Barone,et al.  Physiology of Thalamus and Cortex , 1992 .

[73]  Henry E. Heffner,et al.  Evolution of Sound Localization in Mammals , 1992 .

[74]  T Z Strybel,et al.  Auditory apparent motion in the free field: The effects of stimulus duration and separation , 1992, Perception & psychophysics.

[75]  Alan Kingstone,et al.  Orienting of Visual Attention , 1992 .

[76]  H. Heffner,et al.  Visual factors in sound localization in mammals , 1992, The Journal of comparative neurology.

[77]  B. Pillon,et al.  Time for reorienting of attention: A premotor hypothesis of the underlying mechanism , 1993, Neuropsychologia.

[78]  Aaron M. King,et al.  The Wellcome Prize Lecture. A map of auditory space in the mammalian brain: neural computation and development , 1993, Experimental physiology.

[79]  B. Stein,et al.  The Merging of the Senses , 1993 .

[80]  Jon Driver,et al.  Covert Spatial Orienting in Audition: Exogenous and Endogenous Mechanisms , 1994 .

[81]  L. M. Ward,et al.  Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. , 1994, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[82]  R. Klein,et al.  Perceptual-motor expectancies interact with covert visual orienting under conditions of endogenous but not exogenous control. , 1994, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[83]  Charles Spence,et al.  Spatial synergies between auditory and visual attention. , 1994 .

[84]  Steven A. Hillyard,et al.  Effects of spatial cuing on luminance detectability: Psychophysical and electrophysiological evidence for early selection. , 1994 .

[85]  L. Chelazzi,et al.  Do peripheral non-informative cues induce early facilitation of target detection? , 1994, Vision Research.

[86]  Claus Bundesen,et al.  Visual selective attention , 1995 .

[87]  R. Frick Accepting the null hypothesis , 1995, Memory & cognition.

[88]  P T Quinlan,et al.  An examination of attentional control in the auditory modality: Further evidence for auditory orienting , 1995, Perception & psychophysics.

[89]  J. Driver,et al.  Audiovisual links in endogenous covert spatial attention. , 1996, Journal of experimental psychology. Human perception and performance.

[90]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[91]  Yehuda Albeck Sound localization and binaural processing , 1998 .