Bridging the gap between physiology and behavior: evidence from the sSoTS model of human visual attention.

We present the case for a role of biologically plausible neural network modeling in bridging the gap between physiology and behavior. We argue that spiking-level networks can allow "vertical" translation between physiological properties of neural systems and emergent "whole-system" performance-enabling psychological results to be simulated from implemented networks and also inferences to be made from simulations concerning processing at a neural level. These models also emphasize particular factors (e.g., the dynamics of performance in relation to real-time neuronal processing) that are not highlighted in other approaches and that can be tested empirically. We illustrate our argument from neural-level models that select stimuli by biased competition. We show that a model with biased competition dynamics can simulate data ranging from physiological studies of single-cell activity (Study 1) to whole-system behavior in human visual search (Study 2), while also capturing effects at an intermediate level, including performance breakdown after neural lesion (Study 3) and data from brain imaging (Study 4). We also show that, at each level of analysis, novel predictions can be derived from the biologically plausible parameters adopted, which we proceed to test (Study 5). We argue that, at least for studying the dynamics of visual attention, the approach productively links single-cell to psychological data.

[1]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[2]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[3]  Stephen J. Boies,et al.  Components of attention. , 1971 .

[4]  J. Townsend SOME RESULTS CONCERNING THE IDENTIFIABILITY OF PARALLEL AND SERIAL PROCESSES , 1972 .

[5]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[6]  R. Luce,et al.  The Choice Axiom after Twenty Years , 1977 .

[7]  K. Heilman,et al.  Mechanisms underlying hemispatial neglect , 1979, Annals of neurology.

[8]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[9]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[10]  F. J. Friedrich,et al.  Effects of parietal injury on covert orienting of attention , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  J. Morton,et al.  On reducing language to biology , 1984 .

[12]  R. Nicoll,et al.  Control of the repetitive discharge of rat CA 1 pyramidal neurones in vitro. , 1984, The Journal of physiology.

[13]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[14]  G. Humphreys,et al.  A case of integrative visual agnosia. , 1987, Brain : a journal of neurology.

[15]  Hans-Otto Karnath,et al.  Deficits of attention in acute and recovered visual hemi-neglect , 1988, Neuropsychologia.

[16]  Lynn C. Robertson,et al.  Visual Search Performance in the Neglect Syndrome , 1989, Journal of Cognitive Neuroscience.

[17]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[18]  M. Mozer,et al.  On the Interaction of Selective Attention and Lexical Knowledge: A Connectionist Account of Neglect Dyslexia , 1990, Journal of Cognitive Neuroscience.

[19]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[20]  C. Stevens,et al.  Voltage dependence of NMDA-activated macroscopic conductances predicted by single-channel kinetics , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[22]  T. M. Mayhew,et al.  Anatomy of the Cortex: Statistics and Geometry. , 1991 .

[23]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[24]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[25]  Glyn W. Humphreys,et al.  Attention to within-object and between-object spatial representations: multiple sites for visual selection , 1994 .

[26]  S. Yantis,et al.  Object continuity in apparent motion and attention. , 1994, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[27]  Jon Driver,et al.  Grouping reduces visual extinction: Neuropsychological evidence for weight-linkage in visual selection , 1994 .

[28]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[29]  P S Goldman-Rakic,et al.  Functional synergism between putative gamma-aminobutyrate-containing neurons and pyramidal neurons in prefrontal cortex. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Glyn W. Humphreys,et al.  Visual marking : prioritising selection for new objects by top-down attentional inhibition , 1994 .

[31]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[32]  G. Humphreys,et al.  Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects. , 1997, Psychological review.

[33]  J. Mattingley,et al.  Preattentive Filling-in of Visual Surfaces in Parietal Extinction , 1997, Science.

[34]  J. Duncan,et al.  Competitive brain activity in visual attention , 1997, Current Opinion in Neurobiology.

[35]  S. Grossberg,et al.  Cortical Synchronization and Perceptual Framing , 1997, Journal of Cognitive Neuroscience.

[36]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[37]  G W Humphreys,et al.  Neural representation of objects in space: a dual coding account. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[38]  J. Mattingley,et al.  Phasic alerting of neglect patients overcomes their spatial deficit in visual awareness , 1998, Nature.

[39]  R. Desimone,et al.  Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4 , 1999, The Journal of Neuroscience.

[40]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[41]  B. Bunney,et al.  Opposite modulation of cortical N-methyl-d-aspartate receptor-mediated responses by low and high concentrations of dopamine , 1999, Neuroscience.

[42]  J. Cohen,et al.  The role of locus coeruleus in the regulation of cognitive performance. , 1999, Science.

[43]  Derrick G. Watson,et al.  Visual marking: Evidence for inhibition using a probe-dot detection paradigm , 2000, Perception & psychophysics.

[44]  M. Corbetta,et al.  Voluntary orienting is dissociated from target detection in human posterior parietal cortex , 2000, Nature Neuroscience.

[45]  Richard B. Ivry,et al.  Task switching and multitask performance. , 2000 .

[46]  D. Heeger,et al.  Activity in primary visual cortex predicts performance in a visual detection task , 2000, Nature Neuroscience.

[47]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[48]  A. T. Smith,et al.  Attentional suppression of activity in the human visual cortex , 2000, Neuroreport.

[49]  J. Driver,et al.  Control of Cognitive Processes: Attention and Performance XVIII , 2000 .

[50]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[51]  G. Deco,et al.  Top-down selective visual attention: A neurodynamical approach , 2001 .

[52]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[53]  A. Treisman,et al.  Attention, Space, and Action: Studies in Cognitive Neuroscience , 2001 .

[54]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[55]  Refractor Vision , 2000, The Lancet.

[56]  S. Treue,et al.  Attentional Modulation Strength in Cortical Area MT Depends on Stimulus Contrast , 2002, Neuron.

[57]  Eddy J. Davelaar,et al.  Neuromodulation of decision and response selection , 2002, Neural Networks.

[58]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[59]  Jonathan D. Cohen,et al.  Simplified dynamics in a model of noradrenergic modulation of cognitive performance , 2002, Neural Networks.

[60]  Derrick G. Watson,et al.  Fractionating the preview benefit in search: dual-task decomposition of visual marking by timing and modality. , 2002, Journal of experimental psychology. Human perception and performance.

[61]  Melina A. Kunar,et al.  History Matters , 2003, Psychological science.

[62]  G. Humphreys,et al.  Attention, spatial representation, and visual neglect: simulating emergent attention and spatial memory in the selective attention for identification model (SAIM). , 2003, Psychological review.

[63]  Glyn W. Humphreys,et al.  Separating distractor rejection and target detection in posterior parietal cortex—an event-related fMRI study of visual marking , 2003, NeuroImage.

[64]  R. Desimone,et al.  Interacting Roles of Attention and Visual Salience in V4 , 2003, Neuron.

[65]  Glyn W. Humphreys,et al.  Visual marking inhibits singleton capture , 2003, Cognitive Psychology.

[66]  G. Humphreys,et al.  Seeing the action: neuropsychological evidence for action-based effects on object selection , 2003, Nature Neuroscience.

[67]  Glyn W. Humphreys,et al.  Visual marking: using time in visual selection , 2003, Trends in Cognitive Sciences.

[68]  G. Humphreys,et al.  Inhibition and anticipation in visual search: Evidence from effects of color foreknowledge on preview search , 2003, Perception & psychophysics.

[69]  G. Humphreys,et al.  An analysis of the time course of attention in preview search , 2004, Perception & psychophysics.

[70]  D. Mumford On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[71]  Xiao-Jing Wang,et al.  Spike-Frequency Adaptation of a Generalized Leaky Integrate-and-Fire Model Neuron , 2004, Journal of Computational Neuroscience.

[72]  Xiao-Jing Wang,et al.  Effects of Neuromodulation in a Cortical Network Model of Object Working Memory Dominated by Recurrent Inhibition , 2004, Journal of Computational Neuroscience.

[73]  Olaf B. Paulson,et al.  Parieto–Occipital Areas Involved in Efficient Filtering in Search: A Time Course Analysis of Visual Marking using Behavioural and Functional Imaging Procedures , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[74]  Christian N L Olivers,et al.  Spatiotemporal segregation in visual search: evidence from parietal lesions. , 2004, Journal of experimental psychology. Human perception and performance.

[75]  Gustavo Deco,et al.  Integrating fMRI and single-cell data of visual working memory , 2004, Neurocomputing.

[76]  Gustavo Deco,et al.  Feature-based Attention in Human Visual Cortex: Simulation of Fmri Data , 2003 .

[77]  Gustavo Deco,et al.  Neurons and the synaptic basis of the fMRI signal associated with cognitive flexibility , 2005, NeuroImage.

[78]  Glyn W. Humphreys,et al.  Color-based grouping and inhibition in visual search: Evidence from a probe detection analysis of preview search , 2005, Perception & psychophysics.

[79]  T. Egner,et al.  Cognitive control mechanisms resolve conflict through cortical amplification of task-relevant information , 2005, Nature Neuroscience.

[80]  C. Bundesen,et al.  A neural theory of visual attention: bridging cognition and neurophysiology. , 2005, Psychological review.

[81]  Robert T. Knight,et al.  Top-down Enhancement and Suppression of the Magnitude and Speed of Neural Activity , 2005, Journal of Cognitive Neuroscience.

[82]  Stephen Smith,et al.  Prioritizing new over old: An fMRI study of the preview search task , 2005, Human brain mapping.

[83]  E. Rolls,et al.  Neurodynamics of biased competition and cooperation for attention: a model with spiking neurons. , 2005, Journal of neurophysiology.

[84]  Gustavo Deco,et al.  Sequential Memory: A Putative Neural and Synaptic Dynamical Mechanism , 2005, Journal of Cognitive Neuroscience.

[85]  Mark S. Gilzenrat,et al.  The role of the locus coeruleus in mediating the attentional blink: a neurocomputational theory. , 2005, Journal of experimental psychology. General.

[86]  Mieke Donk,et al.  Prioritized selection in visual search through onset capture and color inhibition: evidence from a probe-dot detection task. , 2005, Journal of experimental psychology. Human perception and performance.

[87]  Christian N. L. Olivers,et al.  The time course of preview search with color-defined, not luminance-defined, stimuli , 2006, Perception & psychophysics.

[88]  M. Husain,et al.  Noradrenergic modulation of space exploration in visual neglect , 2006, Annals of neurology.

[89]  Dietmar Heinke,et al.  A computational model of visual marking using an inter-connected network of spiking neurons: The spiking search over time & space model (sSoTS) , 2006, Journal of Physiology-Paris.

[90]  Marisa Carrasco,et al.  When sustained attention impairs perception , 2006, Nature Neuroscience.

[91]  Dietmar Heinke,et al.  Top-down guidance of visual search: A computational account , 2006 .

[92]  Pieter R. Roelfsema,et al.  Different Processing Phases for Features, Figures, and Selective Attention in the Primary Visual Cortex , 2007, Neuron.

[93]  Alexandre Pouget,et al.  Paying Attention to Neurons with Discriminating Taste , 2007, Neuron.

[94]  M. Corbetta,et al.  Right TPJ deactivation during visual search: functional significance and support for a filter hypothesis. , 2007, Cerebral cortex.

[95]  G. Humphreys,et al.  Previewing distracters reduces their effective contrast , 2007, Vision Research.

[96]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[97]  P. Matthews,et al.  A neural marker of content-specific active ignoring. , 2008, Journal of experimental psychology. Human perception and performance.

[98]  Ralph Weidner,et al.  Dimensional weighting of primary and secondary target-defining dimensions in visual search for singleton conjunction targets , 2009, Psychological research.

[99]  Stephen Grossberg,et al.  Running as fast as it can: How spiking dynamics form object groupings in the laminar circuits of visual cortex , 2010, Journal of Computational Neuroscience.

[100]  Dietmar Heinke,et al.  Simulating posterior parietal damage in a biologically plausible framework: Neuropsychological tests of the search over time and space model , 2009, Cognitive neuropsychology.

[101]  Glyn W. Humphreys,et al.  Author ' s personal copy Decomposing the neural mechanisms of visual search through model-based analysis of fMRI : Top-down excitation , active ignoring and the use of saliency by the right TPJ , 2012 .

[102]  Motion induced blindness: The more you attend the less you see , 2010 .

[103]  Harriet A. Allen,et al.  Active Ignoring in Early Visual Cortex , 2010, Journal of Cognitive Neuroscience.