Functional dissection of signal and noise in MT and LIP during decision-making

During perceptual decision-making, responses in the middle temporal (MT) and lateral intraparietal (LIP) areas appear to map onto theoretically defined quantities, with MT representing instantaneous motion evidence and LIP reflecting the accumulated evidence. However, several aspects of the transformation between the two areas have not been empirically tested. We therefore performed multistage systems identification analyses of the simultaneous activity of MT and LIP during individual decisions. We found that monkeys based their choices on evidence presented in early epochs of the motion stimulus and that substantial early weighting of motion was present in MT responses. LIP responses recapitulated MT early weighting and contained a choice-dependent buildup that was distinguishable from motion integration. Furthermore, trial-by-trial variability in LIP did not depend on MT activity. These results identify important deviations from idealizations of MT and LIP and motivate inquiry into sensorimotor computations that may intervene between MT and LIP.

[1]  David W Tank,et al.  Sources of noise during accumulation of evidence in unrestrained and voluntarily head-restrained rats , 2015, eLife.

[2]  Il Memming Park,et al.  Encoding and decoding in parietal cortex during sensorimotor decision-making , 2014, Nature Neuroscience.

[3]  David J. Freedman,et al.  Independent Category and Spatial Encoding in Parietal Cortex , 2013, Neuron.

[4]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[5]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[6]  P. Cisek,et al.  Decisions in Changing Conditions: The Urgency-Gating Model , 2009, The Journal of Neuroscience.

[7]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[8]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[9]  Christopher C. Pack,et al.  Hierarchical processing of complex motion along the primate dorsal visual pathway , 2012, Proceedings of the National Academy of Sciences.

[10]  Bingni W. Brunton,et al.  Distinct relationships of parietal and prefrontal cortices to evidence accumulation , 2014, Nature.

[11]  John H. R. Maunsell,et al.  The visual field representation in striate cortex of the macaque monkey: Asymmetries, anisotropies, and individual variability , 1984, Vision Research.

[12]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[13]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[14]  Bruce G Cumming,et al.  Reward modulates the effect of visual cortical microstimulation on perceptual decisions , 2015, eLife.

[15]  Anne E. Urai,et al.  Sensory integration dynamics in a hierarchical network explains choice probabilities in cortical area MT , 2015, Nature Communications.

[16]  Jonathan W. Pillow,et al.  Dissociated functional significance of decision-related activity in the primate dorsal stream , 2016, Nature.

[17]  Yutaka Komura,et al.  Responses of pulvinar neurons reflect a subject's confidence in visual categorization , 2013, Nature Neuroscience.

[18]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[19]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[20]  Timothy D. Hanks,et al.  Elapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task , 2011, The Journal of Neuroscience.

[21]  T. Albright.  Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[22]  Alexander Huk,et al.  PLDAPS: A Hardware Architecture and Software Toolbox for Neurophysiology Requiring Complex Visual Stimuli and Online Behavioral Control , 2012, Front. Neuroinform..

[23]  Paul Cisek,et al.  Evidence against perfect integration of sensory information during perceptual decision making. , 2016, Journal of neurophysiology.

[24]  Paul Cisek,et al.  Decision making by urgency gating: theory and experimental support. , 2012, Journal of neurophysiology.

[25]  Bingni W. Brunton,et al.  Rats and Humans Can Optimally Accumulate Evidence for Decision-Making , 2013, Science.

[26]  Jonathan W. Pillow,et al.  Single-trial spike trains in parietal cortex reveal discrete steps during decision-making , 2015, Science.

[27]  Constant D. Beugré,et al.  The neural basis of decision making , 2018 .

[28]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[29]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[30]  Sung Jun Joo,et al.  Decision-related perturbations of decision-irrelevant eye movements , 2016, Proceedings of the National Academy of Sciences.

[31]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[32]  Yuwei Cui,et al.  Diverse Suppressive Influences in Area MT and Selectivity to Complex Motion Features , 2013, The Journal of Neuroscience.

[33]  Douglas A Ruff,et al.  Attention Increases Spike Count Correlations between Visual Cortical Areas , 2016, The Journal of Neuroscience.

[34]  Mehrdad Jazayeri,et al.  Representation of Accumulating Evidence for a Decision in Two Parietal Areas , 2015, The Journal of Neuroscience.

[35]  Dario L Ringach,et al.  Enhanced Spatial Resolution During Locomotion and Heightened Attention in Mouse Primary Visual Cortex , 2016, The Journal of Neuroscience.

[36]  Gustavo Deco,et al.  Task-driven intra- and interarea communications in primate cerebral cortex , 2014, Proceedings of the National Academy of Sciences.

[37]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[38]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[39]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[40]  K. H. Britten,et al.  Responses of neurons in macaque MT to stochastic motion signals , 1993, Visual Neuroscience.

[41]  Jay A. Hennig,et al.  Signal Multiplexing and Single-Neuron Computations in Lateral Intraparietal Area During Decision-Making , 2013, The Journal of Neuroscience.

[42]  Jochen Ditterich,et al.  Stochastic models of decisions about motion direction: Behavior and physiology , 2006, Neural Networks.

[43]  J. Gold,et al.  Distinct Representations of a Perceptual Decision and the Associated Oculomotor Plan in the Monkey Lateral Intraparietal Area , 2011, The Journal of Neuroscience.

[44]  Michael N. Shadlen,et al.  A Neural Mechanism for Sensing and Reproducing a Time Interval , 2015, Current Biology.

[45]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque , 2008 .

[47]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[48]  J. Movshon,et al.  Adaptive Temporal Integration of Motion in Direction-Selective Neurons in Macaque Visual Cortex , 2004, The Journal of Neuroscience.

[49]  C. Summerfield,et al.  Rhythmic Fluctuations in Evidence Accumulation during Decision Making in the Human Brain , 2012, Neuron.

[50]  L. Ding.  Distinct dynamics of ramping activity in the frontal cortex and caudate nucleus in monkeys. , 2015, Journal of neurophysiology.

[51]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[52]  Matthew T. Kaufman,et al.  A category-free neural population supports evolving demands during decision-making , 2014, Nature Neuroscience.

[53]  Leslie G. Ungerleider,et al.  Cortical connections of visual area MT in the macaque , 1986, The Journal of comparative neurology.

[54]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[55]  R. Andersen,et al.  Motor intention activity in the macaque's lateral intraparietal area. I. Dissociation of motor plan from sensory memory. , 1996, Journal of neurophysiology.

[56]  G. DeAngelis,et al.  Neural Correlates of Prior Expectations of Motion in the Lateral Intraparietal and Middle Temporal Areas , 2012, The Journal of Neuroscience.

[57]  R. Wurtz,et al.  Signal transformations from cerebral cortex to superior colliculus for the generation of saccades , 2001, Vision Research.

[58]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[59]  Kenway Louie,et al.  Separating Value from Choice: Delay Discounting Activity in the Lateral Intraparietal Area , 2010, The Journal of Neuroscience.

[60]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.