When What You Hear Influences When You See

The three experiments reported here demonstrated a cross-modal influence of an auditory rhythm on the temporal allocation of visual attention. In Experiment 1, participants moved their eyes to a test dot with a temporal onset that was either synchronous or asynchronous with a preceding auditory rhythm. Saccadic latencies were faster for the synchronous condition than for the asynchronous conditions. In Experiment 2, the effect was replicated in a condition in which the auditory context stopped prior to the onset of the test dot, and the effect did not occur in a condition in which auditory tones were presented at irregular intervals. Experiment 3 replicated the effect using an accuracy measure within a nontimed visual task. Together, the experiments’ findings support a general entrainment perspective on attention to events over time.

[1]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[2]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[3]  Pascal Fries,et al.  A Microsaccadic Rhythm Modulates Gamma-Band Synchronization and Behavior , 2009, The Journal of Neuroscience.

[4]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[5]  A. Nobre,et al.  Orienting attention in time: behavioural and neuroanatomical distinction between exogenous and endogenous shifts , 2000, Neuropsychologia.

[6]  Daniel Senkowski,et al.  Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations , 2007, Neuropsychologia.

[7]  Ralph Barnes,et al.  Expectancy, Attention, and Time , 2000, Cognitive Psychology.

[8]  M. Frens,et al.  Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements , 1995, Perception & psychophysics.

[9]  J. Devin McAuley,et al.  Modeling effects of rhythmic context on perceived duration: a comparison of interval and entrainment approaches to short-interval timing. , 2003, Journal of experimental psychology. Human perception and performance.

[10]  Edward W. Large,et al.  Tracking simple and complex sequences , 2002, Psychological research.

[11]  Peter Q. Pfordresher,et al.  Tracking Musical Patterns using Joint Accent Structure , 1997 .

[12]  M. Jones,et al.  Temporal Aspects of Stimulus-Driven Attending in Dynamic Arrays , 2002, Psychological science.

[13]  M R Jones,et al.  Controlled attending as a function of melodic and temporal context , 1982, Perception & psychophysics.

[14]  Anna C. Nobre,et al.  Synergistic Effect of Combined Temporal and Spatial Expectations on Visual Attention , 2005, The Journal of Neuroscience.

[15]  M. Jones,et al.  The Role of Event Time in Attending , 1993 .

[16]  Anna C. Nobre,et al.  How can temporal expectations bias perception and action , 2010 .

[17]  Brigitte Röder,et al.  Orienting Attention to Points in Time Improves Stimulus Processing Both within and across Modalities , 2006, Journal of Cognitive Neuroscience.

[18]  Daniel Sanabria,et al.  Rhythms that speed you up. , 2011, Journal of experimental psychology. Human perception and performance.

[19]  A. Winfree.  The geometry of biological time , 1991 .

[20]  A. Bonnel,et al.  Divided attention between simultaneous auditory and visual signals , 1998, Perception & psychophysics.

[21]  M. R. Jones,et al.  Time, our lost dimension: toward a new theory of perception, attention, and memory. , 1976, Psychological review.

[22]  Ankoor S. Shah,et al.  An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. , 2005, Journal of neurophysiology.

[23]  M. Chun,et al.  Temporal contextual cuing of visual attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[24]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[25]  Drew H. Abney,et al.  Journal of Experimental Psychology : Human Perception and Performance Influence of Musical Groove on Postural Sway , 2015 .

[26]  C. Spence,et al.  Attention and the crossmodal construction of space , 1998, Trends in Cognitive Sciences.

[27]  Mari Riess Jones,et al.  Sensitivity to time change : The role of context and skill , 1997 .

[28]  J. Vroomen,et al.  Sound enhances visual perception: cross-modal effects of auditory organization on vision. , 2000, Journal of experimental psychology. Human perception and performance.

[29]  R. Shiffrin,et al.  Can attention be allocated to sensory modalities? , 1974 .

[30]  D. Kahneman,et al.  Attention and Effort , 1973 .

[31]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[32]  P. Lakatos,et al.  Aligning the Brain in a Rhythmic World , 2009 .

[33]  Jean Vroomen,et al.  Perceptual effects of cross-modal stimulation : The cases of ventriloquism and the freezing phenomenon , 2004 .

[34]  J. Driver,et al.  Audiovisual links in exogenous covert spatial orienting , 1997, Perception & psychophysics.

[35]  S. Hillyard,et al.  Involuntary orienting to sound improves visual perception , 2000, Nature.

[36]  J. T. Walker,et al.  Auditory-visual conflicts in the perceived duration of lights, tones and gaps. , 1981, Journal of experimental psychology. Human perception and performance.

[37]  Anna C Nobre,et al.  Neural modulation by regularity and passage of time. , 2008, Journal of neurophysiology.

[38]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[39]  H Colonius,et al.  A two-stage model for visual-auditory interaction in saccadic latencies , 2001, Perception & psychophysics.

[40]  Edward W. Large,et al.  Perceiving temporal regularity in music , 2002, Cogn. Sci..

[41]  C. Spence,et al.  Perceptual effects of cross-modal stimulation , 2022 .

[42]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .