Combined contributions of feedforward and feedback inputs to bottom-up attention

In order to deal with a large amount of information carried by visual inputs entering the brain at any given point in time, the brain swiftly uses the same inputs to enhance processing in one part of visual field at the expense of the others. These processes, collectively called bottom-up attentional selection, are assumed to solely rely on feedforward processing of the external inputs, as it is implied by the nomenclature. Nevertheless, evidence from recent experimental and modeling studies points to the role of feedback in bottom-up attention. Here, we review behavioral and neural evidence that feedback inputs are important for the formation of signals that could guide attentional selection based on exogenous inputs. Moreover, we review results from a modeling study elucidating mechanisms underlying the emergence of these signals in successive layers of neural populations and how they depend on feedback from higher visual areas. We use these results to interpret and discuss more recent findings that can further unravel feedforward and feedback neural mechanisms underlying bottom-up attention. We argue that while it is descriptively useful to separate feedforward and feedback processes underlying bottom-up attention, these processes cannot be mechanistically separated into two successive stages as they occur at almost the same time and affect neural activity within the same brain areas using similar neural mechanisms. Therefore, understanding the interaction and integration of feedforward and feedback inputs is crucial for better understanding of bottom-up attention.

[1]  C. Koch,et al.  Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. , 2008, Journal of vision.

[2]  Jacqueline Gottlieb,et al.  LIP responses to a popout stimulus are reduced if it is overtly ignored , 2006, Nature Neuroscience.

[3]  Joseph Krummenacher,et al.  Inter-trial and redundant-signals effects in visual search and discrimination tasks: Separable pre-attentive and post-selective effects , 2010, Vision Research.

[4]  P. Goldman-Rakic,et al.  Modulation of memory fields by dopamine Dl receptors in prefrontal cortex , 1995, Nature.

[5]  J. Movshon,et al.  Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[6]  Tirin Moore,et al.  Influence and Limitations of Popout in the Selection of Salient Visual Stimuli by Area V4 Neurons , 2009, The Journal of Neuroscience.

[7]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[8]  C. Schroeder,et al.  Intermodal selective attention in monkeys. I: distribution and timing of effects across visual areas. , 2000, Cerebral cortex.

[9]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[10]  R Groner,et al.  Top-Down versus Bottom-up Control of Saccades in Texture Perception , 1997 .

[11]  J. Haynes,et al.  Decoding Successive Computational Stages of Saliency Processing , 2011, Current Biology.

[12]  Zhaoping Li A saliency map in primary visual cortex , 2002, Trends in Cognitive Sciences.

[13]  H. Müller,et al.  Visual search for dimensionally redundant pop-out targets: Evidence for parallel-coactive processing of dimensions , 2001, Perception & psychophysics.

[14]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[15]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[16]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[17]  J. Theeuwes,et al.  Response selection modulates visual search within and across dimensions. , 2005, Journal of experimental psychology. Human perception and performance.

[18]  X. Wang,et al.  Synaptic Basis of Cortical Persistent Activity: the Importance of NMDA Receptors to Working Memory , 1999, The Journal of Neuroscience.

[19]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[20]  T. Sejnowski,et al.  Dopamine D1/D5 receptor modulation of excitatory synaptic inputs to layer V prefrontal cortex neurons. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[21]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[22]  H. Müller,et al.  Searching for unknown feature targets on more than one dimension: Investigating a “dimension-weighting” account , 1996, Perception & psychophysics.

[23]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[24]  Lucia Melloni,et al.  Interaction between bottom-up saliency and top-down control: how saliency maps are created in the human brain. , 2012, Cerebral cortex.

[25]  M. Hawken,et al.  Gain Modulation by Nicotine in Macaque V1 , 2007, Neuron.

[26]  Matthew W Self,et al.  Different glutamate receptors convey feedforward and recurrent processing in macaque V1 , 2012, Proceedings of the National Academy of Sciences.

[27]  Christof Koch,et al.  Visual Saliency Computations: Mechanisms, Constraints, and the Effect of Feedback , 2010, The Journal of Neuroscience.

[28]  R. Barth,et al.  The shift-effect in retinal ganglion cells of the rhesus monkey , 1975, Experimental Brain Research.

[29]  Zhaoping Li,et al.  Neural Activities in V1 Create a Bottom-Up Saliency Map , 2012, Neuron.

[30]  J. Gallant,et al.  Goal-Related Activity in V4 during Free Viewing Visual Search Evidence for a Ventral Stream Visual Salience Map , 2003, Neuron.

[31]  Ken Nakayama,et al.  Attentional requirements in a ‘preattentive’ feature search task , 1997, Nature.

[32]  Laurent Itti,et al.  An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  Rakesh V. Vohra,et al.  Simultaneous selection , 2016, Discret. Appl. Math..

[34]  J. Bullier,et al.  Feedforward and feedback connections between areas V1 and V2 of the monkey have similar rapid conduction velocities. , 2001, Journal of neurophysiology.

[35]  J. Braun Visual search among items of different salience: removal of visual attention mimics a lesion in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  R. Andersen,et al.  Visual receptive field organization and cortico‐cortical connections of the lateral intraparietal area (area LIP) in the macaque , 1990, The Journal of comparative neurology.

[37]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[38]  N. P. Bichot,et al.  A visual salience map in the primate frontal eye field. , 2005, Progress in brain research.

[39]  N. P. Bichot,et al.  Frontal eye field activity before visual search errors reveals the integration of bottom-up and top-down salience. , 2005, Journal of neurophysiology.

[40]  B. Julesz,et al.  Withdrawing attention at little or no cost: Detection and discrimination tasks , 1998, Perception & psychophysics.

[41]  C. Cepeda,et al.  Dopaminergic modulation of NMDA-induced whole cell currents in neostriatal neurons in slices: contribution of calcium conductances. , 1998, Journal of neurophysiology.

[42]  Peter König,et al.  Dissociation between saliency signals and activity in early visual cortex. , 2013, Journal of vision.

[43]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[44]  P. Roelfsema,et al.  Simultaneous selection by object-based attention in visual and frontal cortex , 2014, Proceedings of the National Academy of Sciences.

[45]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[46]  T. Moore,et al.  CONTROL OF VISUAL CORTICAL SIGNALS BY PREFRONTAL DOPAMINE , 2011, Nature.

[47]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[48]  J. Morrison,et al.  NMDA Receptors Subserve Persistent Neuronal Firing during Working Memory in Dorsolateral Prefrontal Cortex , 2013, Neuron.

[49]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[50]  E. Miller,et al.  Response to Comment on "Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices" , 2007, Science.

[51]  J. Movshon,et al.  Time Course and Time-Distance Relationships for Surround Suppression in Macaque V1 Neurons , 2003, The Journal of Neuroscience.

[52]  P. Roelfsema,et al.  Bottom-Up Dependent Gating of Frontal Signals in Early Visual Cortex , 2008, Science.

[53]  C. Constantinidis,et al.  Early involvement of prefrontal cortex in visual bottom up attention , 2012, Nature Neuroscience.

[54]  Tirin Moore,et al.  Dissociable dopaminergic control of saccadic target selection and its implications for reward modulation , 2013, Proceedings of the National Academy of Sciences.

[55]  J. Theeuwes,et al.  Top-down versus bottom-up attentional control: a failed theoretical dichotomy , 2012, Trends in Cognitive Sciences.

[56]  J. Bullier,et al.  Topography of visual cortex connections with frontal eye field in macaque: convergence and segregation of processing streams , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[58]  S. Hochstein,et al.  Task difficulty and the specificity of perceptual learning , 1997, Nature.

[59]  P. H. Schiller,et al.  The role of the primate extrastriate area V4 in vision. , 1991, Science.

[60]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  C. Schroeder,et al.  Intermodal selective attention in monkeys. II: physiological mechanisms of modulation. , 2000, Cerebral cortex.

[62]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[63]  V. Bringuier,et al.  Horizontal propagation of visual activity in the synaptic integration field of area 17 neurons. , 1999, Science.

[64]  A Pooresmaeili,et al.  Time course of attentional modulation in the frontal eye field during curve tracing. , 2009, Journal of neurophysiology.

[65]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[66]  J. Gottlieb,et al.  Distinct neural mechanisms of distractor suppression in the frontal and parietal lobe , 2012, Nature Neuroscience.

[67]  Hideo Tsukada,et al.  Chronic NMDA Antagonism Impairs Working Memory, Decreases Extracellular Dopamine, and Increases D1 Receptor Binding in Prefrontal Cortex of Conscious Monkeys , 2005, Neuropsychopharmacology.

[68]  A. Treisman,et al.  Conjunction search revisited. , 1990, Journal of experimental psychology. Human perception and performance.

[69]  Alexander Thiele,et al.  Attention-Induced Variance and Noise Correlation Reduction in Macaque V1 Is Mediated by NMDA Receptors , 2013, Neuron.

[70]  A. Sampson,et al.  Dopamine transporter immunoreactivity in monkey cerebral cortex: Regional, laminar, and ultrastructural localization , 2001, The Journal of comparative neurology.

[71]  S. Shipp The brain circuitry of attention , 2004, Trends in Cognitive Sciences.

[72]  Louise S. Delicato,et al.  Acetylcholine contributes through muscarinic receptors to attentional modulation in V1 , 2008, Nature.

[73]  Henry Kennedy,et al.  Pathways of Attention: Synaptic Relationships of Frontal Eye Field to V4, Lateral Intraparietal Cortex, and Area 46 in Macaque Monkey , 2011, The Journal of Neuroscience.

[74]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[75]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[76]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[77]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[78]  W. Levick,et al.  Lateral geniculate neurons of cat: retinal inputs and physiology. , 1972, Investigative ophthalmology.

[79]  Stefan Bode,et al.  Orientation pop-out processing in human visual cortex , 2013, NeuroImage.

[80]  R. Desimone,et al.  A backward progression of attentional effects in the ventral stream , 2009, Proceedings of the National Academy of Sciences.

[81]  M. Merzenich,et al.  Cortical remodelling induced by activity of ventral tegmental dopamine neurons , 2001, Nature.

[82]  M. Goldberg,et al.  A Rapid and Precise On-Response in Posterior Parietal Cortex , 2004, The Journal of Neuroscience.

[83]  Tim C Kietzmann,et al.  Investigating task-dependent top-down effects on overt visual attention. , 2010, Journal of vision.

[84]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[85]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[86]  Jay Hegdé,et al.  How Selective Are V1 Cells for Pop-Out Stimuli? , 2003, The Journal of Neuroscience.

[87]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[88]  Joseph Krummenacher,et al.  Visual search for dimensionally redundant pop-out targets: parallel-coactive processing of dimensions is location specific. , 2002, Journal of experimental psychology. Human perception and performance.