Reward modulates the effect of visual cortical microstimulation on perceptual decisions

Effective perceptual decisions rely upon combining sensory information with knowledge of the rewards available for different choices. However, it is not known where reward signals interact with the multiple stages of the perceptual decision-making pathway and by what mechanisms this may occur. We combined electrical microstimulation of functionally specific groups of neurons in visual area V5/MT with performance-contingent reward manipulation, while monkeys performed a visual discrimination task. Microstimulation was less effective in shifting perceptual choices towards the stimulus preferences of the stimulated neurons when available reward was larger. Psychophysical control experiments showed this result was not explained by a selective change in response strategy on microstimulated trials. A bounded accumulation decision model, applied to analyse behavioural performance, revealed that the interaction of expected reward with microstimulation can be explained if expected reward modulates a sensory representation stage of perceptual decision-making, in addition to the better-known effects at the integration stage. DOI: http://dx.doi.org/10.7554/eLife.07832.001

[1]  N. Logothetis,et al.  The effects of electrical microstimulation on cortical signal propagation , 2010, Nature Neuroscience.

[2]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[3]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[4]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.

[5]  John T Serences,et al.  Value-Based Modulations in Human Visual Cortex , 2008, Neuron.

[6]  Leslie G. Ungerleider,et al.  Multiple visual areas in the caudal superior temporal sulcus of the macaque , 1986, The Journal of comparative neurology.

[7]  Andrew J. Parker,et al.  A Causal Role for V5/MT Neurons Coding Motion-Disparity Conjunctions in Resolving Perceptual Ambiguity , 2013, Current Biology.

[8]  Wyeth Bair,et al.  Long-range clustered connections within extrastriate visual area V5/MT of the rhesus macaque. , 2012, Cerebral Cortex.

[9]  W. Newsome,et al.  Microstimulation in visual area MT: effects on direction discrimination performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  Dino J. Levy,et al.  The root of all value: a neural common currency for choice , 2012, Current Opinion in Neurobiology.

[11]  James L. McClelland,et al.  Integration of Sensory and Reward Information during Perceptual Decision-Making in Lateral Intraparietal Cortex (LIP) of the Macaque Monkey , 2010, PloS one.

[12]  C. Summerfield,et al.  Economic Value Biases Uncertain Perceptual Choices in the Parietal and Prefrontal Cortices , 2010, Front. Hum. Neurosci..

[13]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[14]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[15]  R. Ratcliff,et al.  Bias in the Brain: A Diffusion Model Analysis of Prior Probability and Potential Payoff , 2012, The Journal of Neuroscience.

[16]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[17]  A. Parker,et al.  Comparing perceptual signals of single V5/MT neurons in two binocular depth tasks. , 2004, Journal of neurophysiology.

[18]  Nikos K Logothetis,et al.  Interpreting the BOLD signal. , 2004, Annual review of physiology.

[19]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[20]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[21]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[22]  Kristine Krug,et al.  Playing the electric light orchestra—how electrical stimulation of visual cortex elucidates the neural basis of perception , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  G. Boynton.  Spikes, BOLD, attention, and awareness: a comparison of electrophysiological and fMRI signals in V1. , 2011, Journal of vision.

[24]  G. DeAngelis,et al.  Organization of Disparity-Selective Neurons in Macaque Area MT , 1999, The Journal of Neuroscience.

[25]  Wolfram Schultz,et al.  Reward Magnitude Coding in Primate Amygdala Neurons , 2010, Journal of neurophysiology.

[26]  Philip Holmes,et al.  Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards? , 2009, PLoS Comput. Biol..

[27]  Samuel M. McClure,et al.  Short-term memory traces for action bias in human reinforcement learning , 2007, Brain Research.

[28]  R. Andersen,et al.  Integration of motion and stereopsis in middle temporal cortical area of macaques , 1995, Nature.

[29]  Philip L. Smith,et al.  An integrated theory of attention and decision making in visual signal detection. , 2009, Psychological review.

[30]  S. Zeki.  Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[31]  A. Parker,et al.  Perceptually Bistable Three-Dimensional Figures Evoke High Choice Probabilities in Cortical Area MT , 2001, The Journal of Neuroscience.

[32]  M. Shadlen,et al.  The effect of stimulus strength on the speed and accuracy of a perceptual decision. , 2005, Journal of vision.

[33]  J. Maunsell.  Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[34]  Jeremiah Y. Cohen,et al.  Serotonergic neurons signal reward and punishment on multiple timescales , 2015, eLife.

[35]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[36]  James L. McClelland,et al.  Dynamic Integration of Reward and Stimulus Information in Perceptual Decision-Making , 2011, PloS one.

[37]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[38]  W. Schultz.  Getting Formal with Dopamine and Reward , 2002, Neuron.

[39]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[40]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[41]  Yusuke Murayama,et al.  esfMRI of the upper STS: further evidence for the lack of electrically induced polysynaptic propagation of activity in the neocortex. , 2011, Magnetic resonance imaging.

[42]  K. Nelissen,et al.  Dopaminergic Reward Signals Selectively Decrease fMRI Activity in Primate Visual Cortex , 2013, Neuron.

[43]  R. Andersen,et al.  Encoding of three-dimensional structure-from-motion by primate area MT neurons , 1998, Nature.

[44]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[45]  G. DeAngelis,et al.  Linking Neural Representation to Function in Stereoscopic Depth Perception: Roles of the Middle Temporal Area in Coarse versus Fine Disparity Discrimination , 2006, The Journal of Neuroscience.

[46]  A. Diederich,et al.  Modeling the effects of payoff on response bias in a perceptual discrimination task: Bound-change, drift-rate-change, or two-stage-processing hypothesis , 2006, Perception & psychophysics.

[47]  Adele Diederich,et al.  A further test of sequential-sampling models that account for payoff effects on response bias in perceptual decision tasks , 2008, Perception & psychophysics.

[48]  J. Aloimonos,et al.  On the kinetic depth effect , 1989, Biological Cybernetics.

[49]  A. Parker,et al.  Neuronal mechanisms for the perception of ambiguous stimuli , 2003, Current Opinion in Neurobiology.

[50]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[51]  G. DeAngelis,et al.  Neural Correlates of Prior Expectations of Motion in the Lateral Intraparietal and Middle Temporal Areas , 2012, The Journal of Neuroscience.

[52]  J. Driver,et al.  Rewarding Feedback After Correct Visual Discriminations Has Both General and Specific Influences on Visual Cortex , 2010, Journal of neurophysiology.

[53]  G. Boynton,et al.  Rapid and reflexive feature-based attention. , 2011, Journal of vision.

[54]  J. Maunsell,et al.  Effects of Attention on the Processing of Motion in Macaque Middle Temporal and Medial Superior Temporal Visual Cortical Areas , 1999, The Journal of Neuroscience.

[55]  R. Dolan,et al.  Reward Facilitates Tactile Judgments and Modulates Hemodynamic Responses in Human Primary Somatosensory Cortex , 2008, The Journal of Neuroscience.

[56]  Timothy E. J. Behrens,et al.  Choice, uncertainty and value in prefrontal and cingulate cortex , 2008, Nature Neuroscience.

[57]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[58]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[59]  C. Pennartz,et al.  A unified selection signal for attention and reward in primary visual cortex , 2013, Proceedings of the National Academy of Sciences.

[60]  Stefan Treue,et al.  Human perception of structure from motion , 1991, Vision Research.

[61]  John T Serences,et al.  Population response profiles in early visual cortex are biased in favor of more valuable stimuli. , 2010, Journal of neurophysiology.

[62]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[63]  Michael N. Shadlen,et al.  Effects of Cortical Microstimulation on Confidence in a Perceptual Decision , 2014, Neuron.

[64]  G. Boynton,et al.  Global effects of feature-based attention in human visual cortex , 2002, Nature Neuroscience.

[65]  R. Desimone,et al.  Local precision of visuotopic organization in the middle temporal area (MT) of the macaque , 2004, Experimental Brain Research.

[66]  John H. R. Maunsell,et al.  The middle temporal visual area in the macaque: Myeloarchitecture, connections, functional properties and topographic organization , 1981, The Journal of comparative neurology.

[67]  M Nawrot,et al.  Neural integration of information specifying structure from stereopsis and motion. , 1989, Science.

[68]  John H. R. Maunsell,et al.  Attention to both space and feature modulates neuronal responses in macaque area V4. , 2000, Journal of neurophysiology.

[69]  A. Parker,et al.  Neurons in Dorsal Visual Area V5/MT Signal Relative Disparity , 2011, The Journal of Neuroscience.

[70]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[71]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.