Sequential sampling of visual objects during sustained attention

In a crowded visual scene, attention must be distributed efficiently and flexibly over time and space to accommodate different contexts. It is well established that selective attention enhances the corresponding neural responses, presumably implying that attention would persistently dwell on the task-relevant item. Meanwhile, recent studies, mostly in divided attentional contexts, suggest that attention does not remain stationary but samples objects alternately over time, suggesting a rhythmic view of attention. However, it remains unknown whether the dynamic mechanism essentially mediates attentional processes at a general level. Importantly, there is also a complete lack of direct neural evidence reflecting whether and how the brain rhythmically samples multiple visual objects during stimulus processing. To address these issues, in this study, we employed electroencephalography (EEG) and a temporal response function (TRF) approach, which can dissociate responses that exclusively represent a single object from the overall neuronal activity, to examine the spatiotemporal characteristics of attention in various attentional contexts. First, attention, which is characterized by inhibitory alpha-band (approximately 10 Hz) activity in TRFs, switches between attended and unattended objects every approximately 200 ms, suggesting a sequential sampling even when attention is required to mostly stay on the attended object. Second, the attentional spatiotemporal pattern is modulated by the task context, such that alpha-mediated switching becomes increasingly prominent as the task requires a more uniform distribution of attention. Finally, the switching pattern correlates with attentional behavioral performance. Our work provides direct neural evidence supporting a generally central role of temporal organization mechanism in attention, such that multiple objects are sequentially sorted according to their priority in attentional contexts. The results suggest that selective attention, in addition to the classically posited attentional “focus,” involves a dynamic mechanism for monitoring all objects outside of the focus. Our findings also suggest that attention implements a space (object)-to-time transformation by acting as a series of concatenating attentional chunks that operate on 1 object at a time.

[1]  Saskia Haegens,et al.  Somatosensory Anticipatory Alpha Activity Increases to Suppress Distracting Input , 2012, Journal of Cognitive Neuroscience.

[2]  Raymond Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.

[3]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[4]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[5]  G. Sandini,et al.  Rhythmic Oscillations of Visual Contrast Sensitivity Synchronized with Action , 2015, The Journal of Neuroscience.

[6]  J. Schoffelen,et al.  University of Birmingham Occipital alpha activity during stimulus processing gates the information flow to object-selective cortex , 2014 .

[7]  Bart Gips,et al.  Temporal coding organized by coupled alpha and gamma oscillations prioritize visual processing , 2014, Trends in Neurosciences.

[8]  W. Klimesch Alpha-band oscillations, attention, and controlled access to stored information , 2012, Trends in Cognitive Sciences.

[9]  Marisa Carrasco,et al.  Attention Reorients Periodically , 2016, Current Biology.

[10]  P. Fries,et al.  Attention Samples Stimuli Rhythmically , 2012, Current Biology.

[11]  Danique Jeurissen,et al.  Serial grouping of 2D-image regions with object-based attention in humans , 2016, eLife.

[12]  D. Whitney,et al.  Serial dependence in visual perception , 2011 .

[13]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[14]  R. Marois,et al.  Capacity limits of information processing in the brain , 2005, Trends in Cognitive Sciences.

[15]  Huan Luo,et al.  Behavioral oscillation in priming: competing perceptual predictions conveyed in alternating theta-band rhythms. , 2015, Journal of vision.

[16]  Rufin VanRullen,et al.  Attention searches nonuniformly in space and in time , 2015, Proceedings of the National Academy of Sciences.

[17]  R. VanRullen,et al.  An oscillatory mechanism for prioritizing salient unattended stimuli , 2012, Trends in Cognitive Sciences.

[18]  Y. Saalmann,et al.  Rhythmic Sampling within and between Objects despite Sustained Attention at a Cued Location , 2013, Current Biology.

[19]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[20]  R. VanRullen Perceptual Cycles , 2016, Trends in Cognitive Sciences.

[21]  Jan Drewes,et al.  Dense sampling reveals behavioral oscillations in rapid visual categorization , 2015, Scientific Reports.

[22]  P. Fries Neuronal gamma-band synchronization as a fundamental process in cortical computation. , 2009, Annual review of neuroscience.

[23]  M. Chun,et al.  The dark side of visual attention , 2002, Current Opinion in Neurobiology.

[24]  Huan Luo,et al.  Behavioral Oscillations in Attention: Rhythmic α Pulses Mediated through θ Band , 2014, The Journal of Neuroscience.

[25]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[26]  A. Baddeley Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[27]  Yingchen He,et al.  Attention-Dependent Early Cortical Suppression Contributes to Crowding , 2014, The Journal of Neuroscience.

[28]  R. VanRullen,et al.  The Phase of Ongoing EEG Oscillations Predicts Visual Perception , 2009, The Journal of Neuroscience.

[29]  Ole Jensen,et al.  Alpha Oscillations Correlate with the Successful Inhibition of Unattended Stimuli , 2011, Journal of Cognitive Neuroscience.

[30]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[31]  Huan Luo,et al.  Behavioral Oscillation in Priming: Competing Perceptual Predictions Conveyed in Alternating Theta-Band Rhythms , 2015, The Journal of Neuroscience.

[32]  Rufin VanRullen,et al.  Perceptual Echoes at 10 Hz in the Human Brain , 2012, Current Biology.

[33]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[34]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[35]  John D. Storey A direct approach to false discovery rates , 2002 .

[36]  Patrick Cavanagh,et al.  The blinking spotlight of attention , 2007, Proceedings of the National Academy of Sciences.

[37]  B. Postle,et al.  The Speed of Alpha-Band Oscillations Predicts the Temporal Resolution of Visual Perception , 2015, Current Biology.

[38]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[39]  John J. Foxe,et al.  Towards obtaining spatiotemporally precise responses to continuous sensory stimuli in humans: A general linear modeling approach to EEG , 2014, NeuroImage.

[40]  P. Cavanagh,et al.  Independent Resources for Attentional Tracking in the Left and Right Visual Hemifields , 2005, Psychological science.

[41]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[42]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[43]  P. Cavanagh,et al.  Tracking multiple targets with multifocal attention , 2005, Trends in Cognitive Sciences.

[44]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[45]  J. Simon,et al.  Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. , 2012, Journal of neurophysiology.

[46]  S. Kastner,et al.  From Behavior to Neural Dynamics: An Integrated Theory of Attention , 2015, Neuron.

[47]  Barak A. Pearlmutter,et al.  The VESPA: A method for the rapid estimation of a visual evoked potential , 2006, NeuroImage.

[48]  P. Cavanagh,et al.  Attentional resolution and the locus of visual awareness , 1996, Nature.

[49]  P. Fries,et al.  Distributed Attention Is Implemented through Theta-Rhythmic Gamma Modulation , 2015, Current Biology.

[50]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[51]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[52]  Andreas Wutz,et al.  Temporal Integration Windows in Neural Processing and Perception Aligned to Saccadic Eye Movements , 2016, Current Biology.