Neurocognitive Modeling of Perceptual Decision Making

Mathematical psychology and systems neuroscience have converged on stochastic accumulator models to explain decision making. We examined saccade decisions in monkeys while neurophysiological recordings were made within their frontal eye field. Accumulator models were tested on how well they fit response probabilities and distributions of response times to make saccades. We connected these models with neurophysiology. To test the hypothesis that visually responsive neurons represented perceptual evidence driving accumulation, we replaced perceptual processing time and drift rate parameters with recorded neurophysiology from those neurons. To test the hypothesis that movement related neurons instantiated the accumulator, we compared measures of neural dynamics with predicted measures of accumulator dynamics. Thus, neurophysiology both provides a constraint on model assumptions and data for model selection. We highlight a gated accumulator model that accounts for saccade behavior during visual search, predicts neurophysiology during search, and provides insights into the locus of cognitive control over decisions.

[1]  N. P. Bichot,et al.  Visual feature selectivity in frontal eye fields induced by experience in mature macaques , 1996, Nature.

[2]  Michael L. Mack,et al.  Modeling categorization of scenes containing consistent versus inconsistent objects. , 2010, Journal of vision.

[3]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[4]  R. Ratcliff,et al.  Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability , 2002, Psychonomic bulletin & review.

[5]  D. Meyer,et al.  Neuroeconomics: The Consilience of Brain and Decision , 2004 .

[6]  Eric Chown,et al.  Cognitive Modeling , 2014, Computing Handbook, 3rd ed..

[7]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[8]  Richard P. Heitz,et al.  Neural basis of the set-size effect in frontal eye field: timing of attention during visual search. , 2009, Journal of neurophysiology.

[9]  Thomas J. Palmeri,et al.  Memory systems and perceptual categorization , 2002 .

[10]  Simon Farrell,et al.  Computational Modeling in Cognition: Principles and Practice , 2010 .

[11]  Jeremy M Wolfe,et al.  What are the shapes of response time distributions in visual search? , 2011, Journal of experimental psychology. Human perception and performance.

[12]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[13]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[14]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[15]  G. Woodman,et al.  The Effect of Visual Search Efficiency on Response Preparation , 2008, Psychological science.

[16]  P. Cisek,et al.  Decisions in Changing Conditions: The Urgency-Gating Model , 2009, The Journal of Neuroscience.

[17]  N. P. Bichot,et al.  Effects of similarity and history on neural mechanisms of visual selection , 1999, Nature Neuroscience.

[18]  Richard P. Heitz,et al.  Neurally constrained modeling of perceptual decision making. , 2010, Psychological review.

[19]  Scott D. Brown,et al.  Neural Correlates of Trial-to-Trial Fluctuations in Response Caution , 2011, The Journal of Neuroscience.

[20]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[21]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[22]  C. White,et al.  Perceptual Criteria in the Human Brain , 2012, The Journal of Neuroscience.

[23]  G. Logan,et al.  Response inhibition in the stop-signal paradigm , 2008, Trends in Cognitive Sciences.

[24]  Philip L. Smith From Poisson shot noise to the integrated Ornstein–Uhlenbeck process: Neurally principled models of information accumulation in decision-making and response time , 2010 .

[25]  G. Logan Toward an instance theory of automatization. , 1988 .

[26]  Birte U. Forstmann,et al.  A Bayesian framework for simultaneously modeling neural and behavioral data , 2013, NeuroImage.

[27]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[28]  J. Schall On building a bridge between brain and behavior. , 2004, Annual review of psychology.

[29]  Richard P. Heitz,et al.  Neural Mechanisms of Speed-Accuracy Tradeoff , 2012, Neuron.

[30]  M. Carandini From circuits to behavior: a bridge too far? , 2012, Nature Neuroscience.

[31]  Roger Ratcliff,et al.  Parameter variability and distributional assumptions in the diffusion model. , 2013, Psychological review.

[32]  C. Bruce,et al.  Topography of projections to posterior cortical areas from the macaque frontal eye fields , 1995, The Journal of comparative neurology.

[33]  Ehtibar N Dzhafarov,et al.  Unfalsifiability and mutual translatability of major modeling schemes for choice reaction time. , 2014, Psychological review.

[34]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[35]  G. D. Logan,et al.  Dynamics of saccade target selection: Race model analysis of double step and search step saccade production in human and macaque , 2007, Vision Research.

[36]  P. Goldman-Rakic,et al.  The primate mediodorsal (MD) nucleus and its projection to the frontal lobe , 1985, The Journal of comparative neurology.

[37]  Chung-Chuan Lo,et al.  Proactive Inhibitory Control and Attractor Dynamics in Countermanding Action: A Spiking Neural Circuit Model , 2009, The Journal of Neuroscience.

[38]  Gordon D Logan,et al.  Selecting a response in task switching: testing a model of compound cue retrieval. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[39]  R. Nosofsky,et al.  An exemplar-based random walk model of speeded classification. , 1997, Psychological review.

[40]  T. Palmeri Exemplar similarity and the development of automaticity. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[41]  C. Eriksen,et al.  Use of a delayed signal to stop a visual reaction-time response. , 1966 .

[42]  T. Palmeri An exemplar of model-based cognitive neuroscience , 2014, Trends in Cognitive Sciences.

[43]  G. Logan,et al.  On the ability to inhibit thought and action: general and special theories of an act of control. , 2014, Psychological review.

[44]  S. Liversedge,et al.  Oxford handbook of eye movements , 2011 .

[45]  Richard P. Heitz,et al.  Neural chronometry and coherency across speed–accuracy demands reveal lack of homomorphism between computational and neural mechanisms of evidence accumulation , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[46]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[47]  R. Wurtz,et al.  Interaction of the frontal eye field and superior colliculus for saccade generation. , 2001, Journal of neurophysiology.

[48]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[49]  Patrick G. Bissett,et al.  Balancing Cognitive Demands: Control Adjustments in the Stop-signal Paradigm Stop-signal Paradigm Post-stop-signal Slowing , 2011 .

[50]  Richard P. Heitz,et al.  Response variability of frontal eye field neurons modulates with sensory input and saccade preparation but not visual search salience. , 2012, Journal of neurophysiology.

[51]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[52]  Jochen Ditterich,et al.  Stochastic models of decisions about motion direction: Behavior and physiology , 2006, Neural Networks.

[53]  A. Pouget,et al.  Variance as a Signature of Neural Computations during Decision Making , 2011, Neuron.

[54]  David S. Brée,et al.  Linking Propositions , 1986, COLING.

[55]  Philip L. Smith,et al.  Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. , 2007, Journal of neurophysiology.

[56]  G. Cottrell,et al.  Modeling Perceptual Expertise , 2009 .

[57]  C. Bruce,et al.  Primate frontal eye fields. II. Physiological and anatomical correlates of electrically evoked eye movements. , 1985, Journal of neurophysiology.

[58]  Ashby,et al.  A Stochastic Version of General Recognition Theory. , 2000, Journal of mathematical psychology.

[59]  J T Townsend,et al.  Truth and consequences of ordinal differences in statistical distributions: toward a theory of hierarchical inference. , 1990, Psychological bulletin.

[60]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[61]  Aditya Murthy,et al.  Neural control of visual search by frontal eye field: effects of unexpected target displacement on visual selection and saccade preparation. , 2009, Journal of neurophysiology.

[62]  Jochen Ditterich,et al.  New advances in understanding decisions among multiple alternatives , 2012, Current Opinion in Neurobiology.

[63]  Thomas J. Palmeri,et al.  Visual Object Perception and Long-term Memory , 2008 .

[64]  G. Logan On the ability to inhibit thought and action , 1984 .

[65]  W. Becker,et al.  An analysis of the saccadic system by means of double step stimuli , 1979, Vision Research.

[66]  KongFatt Wong-Lin,et al.  Neural Circuit Dynamics Underlying Accumulation of Time-Varying Evidence During Perceptual Decision Making , 2007, Frontiers Comput. Neurosci..

[67]  Braden A. Purcell,et al.  From Salience to Saccades: Multiple-Alternative Gated Stochastic Accumulator Model of Visual Search , 2012, The Journal of Neuroscience.

[68]  Takashi R Sato,et al.  Effects of Stimulus-Response Compatibility on Neural Selection in Frontal Eye Field , 2003, Neuron.

[69]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[70]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[71]  Jeremiah Y. Cohen,et al.  The neural basis of saccade target selection , 1995 .

[72]  J. Schall,et al.  Visual and Motor Connectivity and the Distribution of Calcium-Binding Proteins in Macaque Frontal Eye Field: Implications for Saccade Target Selection , 2009, Front. Neuroanat..

[73]  G. Logan,et al.  Inhibitory control in mind and brain: an interactive race model of countermanding saccades. , 2007, Psychological review.

[74]  I. Gauthier,et al.  Computational approaches to the development of perceptual expertise , 2004, Trends in Cognitive Sciences.

[75]  Jeffrey D. Schall,et al.  CONCURRENT, DISTRIBUTED CONTROL OF SACCADE INITIATION IN THE FRONTAL EYE FIELD AND SUPERIOR COLLICULUS , 2003 .

[76]  Gordon D Logan,et al.  An instance theory of attention and memory. , 2002, Psychological review.

[77]  R. D. Gordon,et al.  Executive control of visual attention in dual-task situations. , 2001, Psychological review.

[78]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[79]  Leanne Boucher,et al.  Neural Basis of Adaptive Response Time Adjustment during Saccade Countermanding , 2011, The Journal of Neuroscience.

[80]  D. Sparks The brainstem control of saccadic eye movements , 2002, Nature Reviews Neuroscience.

[81]  T. Zandt,et al.  Time-dependent Poisson counter models of response latency in simple judgment. , 2000, The British journal of mathematical and statistical psychology.

[82]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[83]  M. Carandini,et al.  Normalization as a canonical neural computation , 2013, Nature Reviews Neuroscience.

[84]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. , 1983, Journal of neurophysiology.

[85]  Scott D. Brown,et al.  Domain General Mechanisms of Perceptual Decision Making in Human Cortex , 2009, The Journal of Neuroscience.

[86]  Jochen Ditterich,et al.  A Comparison between Mechanisms of Multi-Alternative Perceptual Decision Making: Ability to Explain Human Behavior, Predictions for Neurophysiology, and Relationship with Decision Theory , 2010, Front. Neurosci..

[87]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[88]  Evan M. Palmer,et al.  Reaction time distributions constrain models of visual search , 2010, Vision Research.

[89]  Birte U. Forstmann,et al.  Reciprocal relations between cognitive neuroscience and formal cognitive models: opposites attract? , 2011, Trends in Cognitive Sciences.

[90]  Philip L. Smith,et al.  An integrated theory of attention and decision making in visual signal detection. , 2009, Psychological review.

[91]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[92]  B. Love,et al.  Learning the exception to the rule: model-based FMRI reveals specialized representations for surprising category members. , 2012, Cerebral cortex.

[93]  Leanne Boucher,et al.  Nonindependent and nonstationary response times in stopping and stepping saccade tasks , 2010, Attention, perception & psychophysics.

[94]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[95]  Konstantinos V. Katsikopoulos "How to model it?" [Review of the book Cognitive modeling by J. R. Busemeyer & A. Diederich, Los Angeles: Sage, 2010] , 2011 .

[96]  T. Zandt,et al.  How to fit a response time distribution , 2000, Psychonomic bulletin & review.

[97]  Leanne Boucher,et al.  Stopping eye and hand movements: Are the processes independent? , 2007, Perception & psychophysics.

[98]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[99]  G. Logan,et al.  Inhibitory control in mind and brain 2.0: blocked-input models of saccadic countermanding. , 2015, Psychological review.

[100]  Xiao-Jing Wang,et al.  Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks , 2006, Nature Neuroscience.

[101]  D. Teller Linking propositions , 1984, Vision Research.

[102]  Takashi R Sato,et al.  Search Efficiency but Not Response Interference Affects Visual Selection in Frontal Eye Field , 2001, Neuron.

[103]  Darryl W. Schneider,et al.  Modeling task switching without switching tasks: a short-term priming account of explicitly cued performance. , 2005, Journal of experimental psychology. General.

[104]  Braden A Purcell,et al.  Response times from ensembles of accumulators , 2014, Proceedings of the National Academy of Sciences.

[105]  GrossbergS. Adaptive pattern classification and universal recoding , 1976 .

[106]  J. Schall,et al.  Role of frontal eye fields in countermanding saccades: visual, movement, and fixation activity. , 1998, Journal of neurophysiology.

[107]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[108]  E. Wagenmakers,et al.  An Introduction to Model-Based Cognitive Neuroscience , 2015, Springer New York.

[109]  J. Bullier,et al.  Topography of visual cortex connections with frontal eye field in macaque: convergence and segregation of processing streams , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[110]  Takashi R Sato,et al.  Neuronal Basis of Covert Spatial Attention in the Frontal Eye Field , 2005, The Journal of Neuroscience.

[111]  D. P. Hanes,et al.  Controlled Movement Processing: Superior Colliculus Activity Associated with Countermanded Saccades , 2003, The Journal of Neuroscience.

[112]  David Ferrier,et al.  The localization of function in the brain , 1874, Proceedings of the Royal Society of London.

[113]  James T. Townsend Truth and consequences of ordinal differences in statistical distributions: toward a theory of hierarchical inference. , 1990 .

[114]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[115]  A. Fuchs,et al.  The brainstem burst generator for saccadic eye movements , 2002, Experimental Brain Research.

[116]  P. Glimcher,et al.  Neuroeconomics: The Consilience of Brain and Decision , 2004, Science.

[117]  N. P. Bichot,et al.  Reliability of Macaque Frontal Eye Field Neurons Signaling Saccade Targets during Visual Search , 2001, The Journal of Neuroscience.

[118]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[119]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[120]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[121]  Michael L. Mack,et al.  The Timing of Visual Object Categorization , 2011, Front. Psychology.