A dynamic normalization model of temporal attention

Vision is dynamic, handling a continuously changing stream of input, yet most models of visual attention are static. Here, we develop a dynamic normalization model of visual temporal attention and constrain it with new psychophysical human data. We manipulated temporal attention–the prioritization of visual information at specific points in time–to a sequence of two stimuli separated by a variable time interval. Voluntary temporal attention improved perceptual sensitivity only over a specific interval range. To explain these data, we modeled voluntary and involuntary attentional gain dynamics. Voluntary gain enhancement took the form of a limited resource over short time intervals, which recovered over time. Taken together, our theoretical and experimental results formalize and generalize the idea of limited attentional resources across space at a single moment to limited resources across time at a single location.

[1]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[2]  Seul Lee,et al.  Temporal Dynamics of Visual Attention Allocation , 2019, Scientific Reports.

[3]  A. Nobre,et al.  Temporal Expectation Improves the Quality of Sensory Information , 2012, The Journal of Neuroscience.

[4]  S J Luck,et al.  Mechanisms of visual-spatial attention: resource allocation or uncertainty reduction? , 1996, Journal of experimental psychology. Human perception and performance.

[5]  R. Blake,et al.  Normalization Regulates Competition for Visual Awareness , 2012, Neuron.

[6]  M. Carandini,et al.  Summation and division by neurons in primate visual cortex. , 1994, Science.

[7]  C. Bundesen,et al.  Temporal expectancy in the context of a theory of visual attention , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[9]  M. Carrasco,et al.  On the automaticity and flexibility of covert attention: a speed-accuracy trade-off analysis. , 2009, Journal of vision.

[10]  R. Klein,et al.  The independence of endogenous and exogenous temporal attention , 2018, Attention, Perception, & Psychophysics.

[11]  P. Rabbitt,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption , 1989 .

[12]  S. Morad,et al.  Ceramide-orchestrated signalling in cancer cells , 2012, Nature Reviews Cancer.

[13]  Yuhong Jiang,et al.  Attentional Load and Attentional Boost: A Review of Data and Theory , 2013, Front. Psychol..

[14]  M C Potter,et al.  Two attentional deficits in serial target search: the visual attentional blink and an amodal task-switch deficit. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[15]  Philip L. Smith,et al.  An integrated theory of attention and decision making in visual signal detection. , 2009, Psychological review.

[16]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[17]  Marisa Carrasco,et al.  Deconstructing Interocular Suppression: Attention and Divisive Normalization , 2015, PLoS Comput. Biol..

[18]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[19]  M. Potter,et al.  Temporal constraints on conscious vision: on the ubiquitous nature of the attentional blink. , 2009, Journal of vision.

[20]  C. Bundesen,et al.  A neural theory of visual attention: bridging cognition and neurophysiology. , 2005, Psychological review.

[21]  Simon D Lilburn,et al.  From shunting inhibition to dynamic normalization: Attentional selection and decision-making in brief visual displays , 2015, Vision Research.

[22]  Luigi Acerbi,et al.  Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search , 2017, NIPS.

[23]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[24]  B. Breitmeyer,et al.  Recent models and findings in visual backward masking: A comparison, review, and update , 2000, Perception & psychophysics.

[25]  B. Postle,et al.  Top-down control of the phase of alpha-band oscillations as a mechanism for temporal prediction , 2015, Proceedings of the National Academy of Sciences.

[26]  Kim Borron,et al.  THE PAST 25 YEARS , 2000 .

[27]  Marisa Carrasco,et al.  Attentional enhancement of spatial resolution: linking behavioural and neurophysiological evidence , 2013, Nature Reviews Neuroscience.

[28]  H. J. Muller,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. , 1989, Journal of experimental psychology. Human perception and performance.

[29]  John H. R. Maunsell,et al.  Neuronal Mechanisms of Visual Attention. , 2015, Annual review of vision science.

[30]  M. Carrasco Spatial Covert Attention , 2014 .

[31]  Zachary M. Westrick,et al.  Pattern Adaptation and Normalization Reweighting , 2016, The Journal of Neuroscience.

[32]  D. Heeger,et al.  Feature-based attention enhances performance by increasing response gain , 2011, Vision Research.

[33]  A. Nobre,et al.  Where and When to Pay Attention: The Neural Systems for Directing Attention to Spatial Locations and to Time Intervals as Revealed by Both PET and fMRI , 1998, The Journal of Neuroscience.

[34]  Raymond M Klein,et al.  Isolating exogenous and endogenous modes of temporal attention. , 2013, Journal of experimental psychology. General.

[35]  A. Nobre,et al.  Temporal Expectation Enhances Contrast Sensitivity by Phase Entrainment of Low-Frequency Oscillations in Visual Cortex , 2013, The Journal of Neuroscience.

[36]  Anna C. Nobre,et al.  Anticipated moments: temporal structure in attention , 2017, Nature Reviews Neuroscience.

[37]  Anna C Nobre,et al.  Combining spatial and temporal expectations to improve visual perception. , 2014, Journal of vision.

[38]  M. Carrasco,et al.  Attention enhances contrast sensitivity at cued and impairs it at uncued locations , 2005, Vision Research.

[39]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[40]  D. Heeger,et al.  When size matters: attention affects performance by contrast or response gain , 2010, Nature Neuroscience.

[41]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[42]  Leslie G. Ungerleider,et al.  A Normalization Framework for Emotional Attention , 2016, PLoS biology.

[43]  S. Martens,et al.  Timing attention: Cuing target onset interval attenuates the attentional blink , 2005, Memory & cognition.

[44]  P. Glimcher,et al.  Dynamic Divisive Normalization Predicts Time-Varying Value Coding in Decision-Related Circuits , 2014, The Journal of Neuroscience.

[45]  Scott D. Brown,et al.  Diffusion Decision Model: Current Issues and History , 2016, Trends in Cognitive Sciences.

[46]  H. Wilson,et al.  Spatial frequency adaptation and contrast gain control , 1993, Vision Research.

[47]  Eero P. Simoncelli,et al.  Natural image statistics and divisive normalization: Modeling nonlinearity and adaptation in cortical neurons , 2002 .

[48]  C. Bundesen,et al.  Recent developments in a computational theory of visual attention (TVA) , 2015, Vision Research.

[49]  Britt Anderson,et al.  Effects of temporal context and temporal expectancy on neural activity in inferior temporal cortex , 2008, Neuropsychologia.

[50]  Rufin Vogels,et al.  Divisive Normalization Predicts Adaptation-Induced Response Changes in Macaque Inferior Temporal Cortex , 2016, The Journal of Neuroscience.

[51]  Marisa Carrasco,et al.  Directing Voluntary Temporal Attention Increases Fixational Stability , 2018, The Journal of Neuroscience.

[52]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[53]  Joonyeol Lee,et al.  A Normalization Model of Attentional Modulation of Single Unit Responses , 2009, PloS one.

[54]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[55]  M. Carrasco,et al.  Sustained and transient covert attention enhance the signal via different contrast response functions , 2006, Vision Research.

[56]  F. Chavane,et al.  Dynamics of Local Input Normalization Result from Balanced Short- and Long-Range Intracortical Interactions in Area V1 , 2012, The Journal of Neuroscience.

[57]  E. Seidemann,et al.  Complex Dynamics of V1 Population Responses Explained by a Simple Gain-Control Model , 2009, Neuron.

[58]  Alex R. Wade,et al.  Representation of Concurrent Stimuli by Population Activity in Visual Cortex , 2014, Neuron.

[59]  Marisa Carrasco,et al.  Modeling pupil responses to rapid sequential events , 2019, Behavior Research Methods.

[60]  G. Sperling,et al.  Attention gating in short-term visual memory. , 1986, Psychological review.

[61]  Mark S. Gilzenrat,et al.  The role of the locus coeruleus in mediating the attentional blink: a neurocomputational theory. , 2005, Journal of experimental psychology. General.

[62]  R. Ulrich,et al.  Visual attention and temporal discrimination: Differential effects of automatic and voluntary cueing , 2006 .

[63]  J. Lupiáñez,et al.  Attentional preparation based on temporal expectancy modulates processing at the perceptual level , 2005, Psychonomic bulletin & review.

[64]  G. Boynton A framework for describing the effects of attention on visual responses , 2009, Vision Research.

[65]  Brad Wyble,et al.  Attentional episodes in visual perception. , 2011, Journal of experimental psychology. General.

[66]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[67]  Marisa Carrasco,et al.  Attention model of binocular rivalry , 2017, Proceedings of the National Academy of Sciences.

[68]  Amy M. Ni,et al.  Spatially tuned normalization explains attention modulation variance within neurons. , 2017, Journal of neurophysiology.

[69]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[70]  M. Cheal,et al.  Does Attention Have Different Effects on Line Orientation and Line Arrangement Discrimination? , 1991, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[71]  Stefan Treue,et al.  An Extended Normalization Model of Attention Accounts for Feature-Based Attentional Enhancement of Both Response and Coherence Gain , 2016, PLoS Comput. Biol..

[72]  A. Nobre,et al.  Orienting attention in time. Modulation of brain potentials. , 1999, Brain : a journal of neurology.

[73]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[74]  Kimron Shapiro,et al.  Attentional blink , 2009, Scholarpedia.

[75]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[76]  I. Scharlau,et al.  Rapid allocation of temporal attention in the attentional blink paradigm , 2010 .

[77]  Jonathan Winawer,et al.  Compressive Temporal Summation in Human Visual Cortex , 2017, The Journal of Neuroscience.

[78]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[79]  R. Marois,et al.  The attentional blink: A review of data and theory , 2009, Attention, perception & psychophysics.

[80]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[81]  G. Sperling,et al.  Episodic theory of the dynamics of spatial attention. , 1995 .

[82]  J. C. Johnston,et al.  Involuntary attentional capture by abrupt onsets , 1992, Perception & psychophysics.

[83]  G. DeAngelis,et al.  A Normalization Model of Multisensory Integration , 2011, Nature Neuroscience.

[84]  D. Kahneman Method, findings, and theory in studies of visual masking. , 1968, Psychological bulletin.

[85]  Matthew F. Tang,et al.  Temporal cues and the attentional blink: A further examination of the role of expectancy in sequential object perception , 2014, Attention, perception & psychophysics.

[86]  Amy M. Ni,et al.  Neuronal Effects of Spatial and Feature Attention Differ Due to Normalization , 2019, The Journal of Neuroscience.

[87]  Simon Hanslmayr,et al.  Alpha, beta: The rhythm of the attentional blink , 2017, Psychonomic Bulletin & Review.

[88]  Marisa Carrasco,et al.  How Attention Affects Spatial Resolution Attention Is a Selective Process , 2022 .

[89]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[90]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[91]  J. Lupiáñez,et al.  Temporal attention enhances early visual processing: A review and new evidence from event-related potentials , 2006, Brain Research.

[92]  Ryszard Auksztulewicz,et al.  Rhythmic Temporal Expectation Boosts Neural Activity by Increasing Neural Gain , 2019, The Journal of Neuroscience.

[93]  Adam Kohn,et al.  The influence of surround suppression on adaptation effects in primary visual cortex. , 2012, Journal of neurophysiology.

[94]  David K. Sewell,et al.  A competitive interaction theory of attentional selection and decision making in brief, multielement displays. , 2013, Psychological review.

[95]  Rachel N. Denison,et al.  Temporal attention improves perception similarly at foveal and parafoveal locations , 2019, Journal of vision.

[96]  Sabine Kastner,et al.  The Oxford Handbook of Attention , 2014 .

[97]  J. Coull,et al.  Great expectations: temporal expectation modulates perceptual processing speed. , 2012, Journal of experimental psychology. Human perception and performance.

[98]  J. Enns,et al.  The attentional blink: Resource depletion or temporary loss of control? , 2005, Psychological research.

[99]  M. Carandini,et al.  The Suppressive Field of Neurons in Lateral Geniculate Nucleus , 2005, The Journal of Neuroscience.

[100]  Marisa Carrasco,et al.  Attention flexibly trades off across points in time , 2017, Psychonomic bulletin & review.