Belief states as a framework to explain extra-retinal influences in visual cortex

The activity of sensory neurons is modulated by non-sensory influences, but the role of these influences in cognition is only partially understood. Here we review how the large-scale recording of neuronal activity within and across brain regions allows researchers to examine the interactions between simultaneously recorded neurons as they are jointly influenced by fluctuations in an animal's mental state. We focus on studies on the visual cortex of non-human primates to examine the relationship between extra-retinal influences and beliefs about the state of the sensory world. We explore how these influences can be understood within theoretical frameworks that propose how the continuous updating of belief states supports perceptual inference.

[1]  H. Helmholtz.  Handbuch der physiologischen Optik , 2015 .

[2]  S. Denéve,et al.  Neural processing as causal inference , 2011, Current Opinion in Neurobiology.

[3]  R. Gregory,et al.  Perceptual illusions and brain models , 1968, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[5]  H. Spitzer,et al.  Increased attention enhances both behavioral and neuronal performance. , 1988, Science.

[6]  J. Movshon,et al.  Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[7]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[8]  Pieter R. Roelfsema,et al.  Distinct Roles of the Cortical Layers of Area V1 in Figure-Ground Segregation , 2013, Current Biology.

[9]  R. Reid,et al.  Attention Modulates the Responses of Simple Cells in Monkey Primary Visual Cortex , 2005, The Journal of Neuroscience.

[10]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[11]  C. Gilbert,et al.  Attention Modulates Contextual Influences in the Primary Visual Cortex of Alert Monkeys , 1999, Neuron.

[12]  A. Yuille,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Vision as Bayesian inference: analysis by synthesis? , 2022 .

[13]  B. C. Motter.  Focal attention produces spatially selective processing in visual cortical areas V1, V2, and V4 in the presence of competing stimuli. , 1993, Journal of neurophysiology.

[14]  Scott O. Murray,et al.  Object-Centered Shifts of Receptive Field Positions in Monkey Primary Visual Cortex , 2014, Current Biology.

[15]  Dora E Angelaki,et al.  Reduced choice-related activity and correlated noise accompany perceptual deficits following unilateral vestibular lesion , 2013, Proceedings of the National Academy of Sciences.

[16]  Stefan Treue,et al.  Temporal dynamics of neuronal modulation during exogenous and endogenous shifts of visual attention in macaque area MT , 2008, Proceedings of the National Academy of Sciences.

[17]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[18]  Pieter R Roelfsema,et al.  Neuronal Activity in the Visual Cortex Reveals the Temporal Order of Cognitive Operations , 2010, The Journal of Neuroscience.

[19]  C. Pennartz,et al.  A unified selection signal for attention and reward in primary visual cortex , 2013, Proceedings of the National Academy of Sciences.

[20]  J. Assad,et al.  Neural coding of behavioral relevance in parietal cortex , 2003, Current Opinion in Neurobiology.

[21]  Bruce G. Cumming,et al.  Decision-Related Activity in Sensory Neurons May Depend on the Columnar Architecture of Cerebral Cortex , 2014, The Journal of Neuroscience.

[22]  Wolfgang Maass,et al.  Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[23]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[24]  W. Newsome,et al.  Correlation between Speed Perception and Neural Activity in the Middle Temporal Visual Area , 2005, The Journal of Neuroscience.

[25]  P. Roelfsema,et al.  Simultaneous selection by object-based attention in visual and frontal cortex , 2014, Proceedings of the National Academy of Sciences.

[26]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  H. Spekreijse,et al.  Two distinct modes of sensory processing observed in monkey primary visual cortex (V1) , 2001, Nature Neuroscience.

[28]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[29]  M. Bethge,et al.  Inferring decoding strategies from choice probabilities in the presence of correlated variability , 2013, Nature Neuroscience.

[30]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[31]  Xiao-Jing Wang,et al.  A Tweaking Principle for Executive Control: Neuronal Circuit Mechanism for Rule-Based Task Switching and Conflict Resolution , 2013, The Journal of Neuroscience.

[32]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[33]  Dario L Ringach,et al.  Spontaneous and driven cortical activity: implications for computation , 2009, Current Opinion in Neurobiology.

[34]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[35]  W. Newsome,et al.  Context-Dependent Changes in Functional Circuitry in Visual Area MT , 2008, Neuron.

[36]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[37]  B. Cumming,et al.  Psychophysically measured task strategy for disparity discrimination is reflected in V2 neurons , 2007, Nature Neuroscience.

[38]  R. Gregory.  Perceptions as hypotheses. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[39]  U. Ernst,et al.  Perceptual Inference Predicts Contextual Modulations of Sensory Responses , 2012, The Journal of Neuroscience.

[40]  Pieter R. Roelfsema,et al.  The Representation of Erroneously Perceived Stimuli in the Primary Visual Cortex , 2001, Neuron.

[41]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[42]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  A. Parker,et al.  Perceptually Bistable Three-Dimensional Figures Evoke High Choice Probabilities in Cortical Area MT , 2001, The Journal of Neuroscience.

[44]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[45]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[46]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[47]  P. H. Schiller,et al.  State dependent activity in monkey visual cortex , 2004, Experimental Brain Research.

[48]  C. Gilbert,et al.  Contour Saliency in Primary Visual Cortex , 2006, Neuron.

[49]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[50]  H. Neumann,et al.  The Role of Attention in Figure-Ground Segregation in Areas V1 and V4 of the Visual Cortex , 2012, Neuron.

[51]  G. DeAngelis,et al.  Contribution of Area MT to Stereoscopic Depth Perception Choice-Related Response Modulations Reflect Task Strategy , 2004, Neuron.

[52]  B. Cumming,et al.  Macaque V2 Neurons, But Not V1 Neurons, Show Choice-Related Activity , 2006, The Journal of Neuroscience.

[53]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[54]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[55]  Yong Gu,et al.  Perceptual Learning Reduces Interneuronal Correlations in Macaque Visual Cortex , 2011, Neuron.

[56]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[57]  Jakob H. Macke,et al.  Using sequential dependencies in neural activity and behavior to dissect choice related activity in V2 , 2014 .

[58]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[59]  J. Maunsell.  Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[60]  K. Rockland,et al.  Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey , 1979, Brain Research.

[61]  D. Kersten,et al.  The representation of perceived angular size in human primary visual cortex , 2006, Nature Neuroscience.

[62]  J. Assad,et al.  Neural Activity in the Middle Temporal Area and Lateral Intraparietal Area during Endogenously Cued Shifts of Attention , 2009, The Journal of Neuroscience.

[63]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  J. Maunsell,et al.  A Neuronal Population Measure of Attention Predicts Behavioral Performance on Individual Trials , 2010, The Journal of Neuroscience.

[65]  H. Spekreijse,et al.  A gradual spread of attention during mental curve tracing. , 2003, Perception & psychophysics.

[66]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.