Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making

Decision-making often requires the accumulation and maintenance of evidence over time. Although the neural signals underlying sensory processing have been studied extensively, little is known about how the brain accrues and holds these sensory signals to guide later actions. Previous work has suggested that neural activity in the lateral intraparietal area (LIP) of the monkey brain reflects the formation of perceptual decisions in a random dot direction-discrimination task in which monkeys communicate their decisions with eye-movement responses. We tested the hypothesis that decision-related neural activity in LIP represents the time integral of the momentary motion “evidence.” By briefly perturbing the strength of the visual motion stimulus during the formation of perceptual decisions, we tested whether this LIP activity reflected a persistent, integrated “memory” of these brief sensory events. We found that the responses of LIP neurons reflected substantial temporal integration. Brief pulses had persistent effects on both the monkeys' choices and the responses of neurons in LIP, lasting up to 800 ms after appearance. These results demonstrate that LIP is involved in neural time integration underlying the accumulation of evidence in this task. Additional analyses suggest that decision-related LIP responses, as well as behavioral choices and reaction times, can be explained by near-perfect time integration that stops when a criterion amount of evidence has been accumulated. Temporal integration may be a fundamental computation underlying higher cognitive functions that are dissociated from immediate sensory inputs or motor outputs.

[1]  M. Stone Models for choice-reaction time , 1960 .

[2]  D. LaBerge A recruitment theory of simple behavior , 1962 .

[3]  R. Audley,et al.  SOME ALTERNATIVE STOCHASTIC MODELS OF CHOICE1 , 1965 .

[4]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[5]  S. Link The relative judgment theory of two choice response time , 1975 .

[6]  S. Link,et al.  A sequential theory of psychological discrimination , 1975 .

[7]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[8]  Donald Laming,et al.  A critical comparison of two random-walk models for two-choice reaction time , 1979 .

[9]  A. Watson Probability summation over time , 1979, Vision Research.

[10]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. , 1983, Journal of neurophysiology.

[11]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[12]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[13]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[14]  D. Robinson,et al.  Loss of the neural integrator of the oculomotor system from brain stem lesions in monkey. , 1987, Journal of neurophysiology.

[15]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  R. Andersen,et al.  Visual receptive field organization and cortico‐cortical connections of the lateral intraparietal area (area LIP) in the macaque , 1990, The Journal of comparative neurology.

[17]  Edward H. Adelson,et al.  Motion without movement , 1991, SIGGRAPH.

[18]  Scott N. J. Watamaniuk,et al.  Temporal and spatial integration in dynamic random-dot stimuli , 1992, Vision Research.

[19]  W. Newsome,et al.  Microstimulation in visual area MT: effects on direction discrimination performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  Michael N. Shadlen,et al.  Dichoptic activation of the early motion system , 1993, Vision Research.

[21]  S. Watamaniuk Ideal observer for discrimination of the global direction of dynamic random-dot stimuli. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[22]  K. H. Britten,et al.  Responses of neurons in macaque MT to stochastic motion signals , 1993, Visual Neuroscience.

[23]  P. Goldman-Rakic,et al.  Coactivation of prefrontal cortex and inferior parietal cortex in working memory tasks revealed by 2DG functional mapping in the rhesus monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[25]  Philip L. Smith Psychophysically principled models of visual simple reaction time. , 1995 .

[26]  J. Bullier,et al.  Topography of visual cortex connections with frontal eye field in macaque: convergence and segregation of processing streams , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  S. McKee,et al.  Temporal coherence theory for the detection and measurement of visual motion , 1995, Vision Research.

[28]  M. Goldberg,et al.  Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. , 1996, Journal of neurophysiology.

[29]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[30]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[31]  R. Andersen,et al.  Motor intention activity in the macaque's lateral intraparietal area. I. Dissociation of motor plan from sensory memory. , 1996, Journal of neurophysiology.

[32]  J. Anthony Movshon,et al.  Reconstructing Stimulus Velocity from Neuronal Responses in Area MT , 1996, NIPS.

[33]  C. Kaneko,et al.  Eye movement deficits after ibotenic acid lesions of the nucleus prepositus hypoglossi in monkeys. I. Saccades and fixation. , 1997, Journal of neurophysiology.

[34]  D G Pelli,et al.  Pixel independence: measuring spatial interactions on a CRT display. , 1997, Spatial vision.

[35]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[36]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[37]  W T Newsome,et al.  Tuning bandwidths for near-threshold stimuli in area MT. , 1998, Journal of neurophysiology.

[38]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[39]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[40]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[41]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[42]  R. Andersen,et al.  Effect of reversible inactivation of macaque lateral intraparietal area on visual and memory saccades. , 1999, Journal of neurophysiology.

[43]  C. Kaneko,et al.  Eye movement deficits following ibotenic acid lesions of the nucleus prepositus hypoglossi in monkeys II. Pursuit, vestibular, and optokinetic responses. , 1999, Journal of neurophysiology.

[44]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[45]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[46]  Philip L. Smith,et al.  Stochastic Dynamic Models of Response Time and Accuracy: A Foundational Primer. , 2000, Journal of mathematical psychology.

[47]  D. V. van Essen,et al.  Mapping of architectonic subdivisions in the macaque monkey, with emphasis on parieto‐occipital cortex , 2000, The Journal of comparative neurology.

[48]  Paul R. Schrater,et al.  Mechanisms of visual motion detection , 2000, Nature Neuroscience.

[49]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[50]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[51]  R. Carpenter,et al.  The influence of urgency on decision time , 2000, Nature Neuroscience.

[52]  Vivian M Ciaramitaro,et al.  Stimulus probability directs spatial attention: an enhancement of sensitivity in humans and monkeys , 2001, Vision Research.

[53]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[54]  D. Burr,et al.  Dependency of reaction times to motion onset on luminance and chromatic contrast , 2001, Vision Research.

[55]  Jeffrey D. Schall,et al.  Pre-excitatory pause in frontal eye field responses , 2001, Experimental Brain Research.

[56]  W T Newsome,et al.  Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task. , 2001, Journal of neurophysiology.

[57]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[58]  W T Newsome,et al.  Target selection for saccadic eye movements: direction-selective visual responses in the superior colliculus. , 2001, Journal of neurophysiology.

[59]  H. Seung,et al.  In vivo intracellular recording and perturbation of persistent activity in a neural integrator , 2001, Nature Neuroscience.

[60]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[61]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[62]  D. Burr,et al.  Temporal integration of optic flow, measured by contrast and coherence thresholds , 2001, Vision Research.

[63]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[64]  R. Wurtz,et al.  Progression in neuronal processing for saccadic eye movements from parietal cortex area lip to superior colliculus. , 2001, Journal of neurophysiology.

[65]  M. Goldberg,et al.  The Role of the Lateral Intraparietal Area of the Monkey in the Generation of Saccades and Visuospatial Attention , 2002, Annals of the New York Academy of Sciences.

[66]  Geoffrey M. Ghose,et al.  Attentional modulation in visual cortex depends on task timing , 2002, Nature.

[67]  M. Platt,et al.  Neural correlates of decisions , 2002, Current Opinion in Neurobiology.

[68]  H. Seung,et al.  Linear regression of eye velocity on eye position and head velocity suggests a common oculomotor neural integrator. , 2002, Journal of neurophysiology.

[69]  A. Koulakov,et al.  Model for a robust neural integrator , 2002, Nature Neuroscience.

[70]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[71]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[72]  Timothy J Ebner,et al.  What Do Complex Spikes Signal about Limb Movements? , 2002, Annals of the New York Academy of Sciences.

[73]  M. Shadlen,et al.  Microstimulation of visual cortex affects the speed of perceptual decisions , 2003, Nature Neuroscience.

[74]  H. Seung,et al.  Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. , 2003, Cerebral cortex.

[75]  Emilio Salinas,et al.  Cognitive neuroscience: Flutter Discrimination: neural codes, perception, memory and decision making , 2003, Nature Reviews Neuroscience.

[76]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[77]  J. Gold,et al.  The Influence of Behavioral Context on the Representation of a Perceptual Decision in Developing Oculomotor Commands , 2003, The Journal of Neuroscience.

[78]  M. Shadlen,et al.  Representation of Time by Neurons in the Posterior Parietal Cortex of the Macaque , 2003, Neuron.

[79]  P. Glimcher The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[80]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[81]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[82]  M. Goldberg,et al.  A Rapid and Precise On-Response in Posterior Parietal Cortex , 2004, The Journal of Neuroscience.

[83]  Stephen C. Cannon,et al.  An improved neural-network model for the neural integrator of the oculomotor system: More realistic neuron behavior , 1985, Biological Cybernetics.

[84]  Alexander Borst,et al.  Visual information processing in the fly's landing system , 1988, Journal of Comparative Physiology A.

[85]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[86]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[87]  Stephen C. Cannon,et al.  A proposed neural network for the integrator of the oculomotor system , 1983, Biological Cybernetics.

[88]  J. Maunsell,et al.  Attentional Modulation of Motion Integration of Individual Neurons in the Middle Temporal Visual Area , 2004, The Journal of Neuroscience.

[89]  D. Tank,et al.  Persistent neural activity: prevalence and mechanisms , 2004, Current Opinion in Neurobiology.

[90]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[91]  J. Movshon,et al.  Adaptive Temporal Integration of Motion in Direction-Selective Neurons in Macaque Visual Cortex , 2004, The Journal of Neuroscience.

[92]  D. A. Robinson,et al.  A learning network model of the neural integrator of the oculomotor system , 1991, Biological Cybernetics.

[93]  D. W. Tank,et al.  Spontaneous eye movements in goldfish: oculomotor integrator performance, plasticity, and dependence on visual feedback , 2004, Vision Research.

[94]  H Sebastian Seung,et al.  Plasticity and tuning by visual feedback of the stability of a neural integrator. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[95]  X. J. Wang,et al.  How is a choice outcome read out by neurons downstream from a decision network? A recurrent neural network model , 2004 .

[96]  Mingsha Zhang,et al.  Persistent LIP activity in memory antisaccades: working memory for a sensorimotor transformation. , 2004, Journal of neurophysiology.

[97]  M. Shadlen,et al.  The effect of stimulus strength on the speed and accuracy of a perceptual decision. , 2005, Journal of vision.

[98]  J. Schall Decision making , 2005, Current Biology.

[99]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[100]  Ranulfo Romo,et al.  Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination , 2005, Science.

[101]  Jochen Ditterich Computational approaches to visual decision making. , 2006, Novartis Foundation symposium.

[102]  Mathew E. Diamond,et al.  Percept, decision, action : bridging the gaps , 2006 .