Rational Decision-Making in Inhibitory Control

An important aspect of cognitive flexibility is inhibitory control, the ability to dynamically modify or cancel planned actions in response to changes in the sensory environment or task demands. We formulate a probabilistic, rational decision-making framework for inhibitory control in the stop signal paradigm. Our model posits that subjects maintain a Bayes-optimal, continually updated representation of sensory inputs, and repeatedly assess the relative value of stopping and going on a fine temporal scale, in order to make an optimal decision on when and whether to go on each trial. We further posit that they implement this continual evaluation with respect to a global objective function capturing the various reward and penalties associated with different behavioral outcomes, such as speed and accuracy, or the relative costs of stop errors and go errors. We demonstrate that our rational decision-making model naturally gives rise to basic behavioral characteristics consistently observed for this paradigm, as well as more subtle effects due to contextual factors such as reward contingencies or motivational factors. Furthermore, we show that the classical race model can be seen as a computationally simpler, perhaps neurally plausible, approximation to optimal decision-making. This conceptual link allows us to predict how the parameters of the race model, such as the stopping latency, should change with task parameters and individual experiences/ability.

[1]  M. Stone Models for choice-reaction time , 1960 .

[2]  Michael J. Kofler,et al.  Attention-Deficit/Hyperactivity Disorder and Behavioral Inhibition: A Meta-Analytic Review of the Stop-signal Paradigm , 2007, Journal of abnormal child psychology.

[3]  J. Nigg On inhibition/disinhibition in developmental psychopathology: views from cognitive and personality psychology and a working inhibition taxonomy. , 2000, Psychological bulletin.

[4]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[5]  J. Schall,et al.  Role of frontal eye fields in countermanding saccades: visual, movement, and fixation activity. , 1998, Journal of neurophysiology.

[6]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[7]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[8]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[9]  G. Logan,et al.  Proactive adjustments of response strategies in the stop-signal paradigm. , 2009, Journal of experimental psychology. Human perception and performance.

[10]  D. P. Hanes,et al.  Controlled Movement Processing: Superior Colliculus Activity Associated with Countermanded Saccades , 2003, The Journal of Neuroscience.

[11]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[12]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[13]  P. Michie,et al.  Acts of control in schizophrenia: dissociating the components of inhibition , 2002, Psychological Medicine.

[14]  Karl J. Friston,et al.  Observing the Observer (II): Deciding When to Decide , 2010, PloS one.

[15]  Leanne Boucher,et al.  Influence of history on saccade countermanding performance in humans and macaque monkeys , 2007, Vision Research.

[16]  Chi-Hua Chen,et al.  Neurocognitive endophenotypes of obsessive-compulsive disorder. , 2007, Brain : a journal of neurology.

[17]  Robert A Zucker,et al.  Poor response inhibition as a predictor of problem drinking and illicit drug use in adolescents at risk for alcoholism and other substance use disorders. , 2006, Journal of the American Academy of Child and Adolescent Psychiatry.

[18]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[19]  A. Miyake,et al.  The relations among inhibition and interference control functions: a latent-variable analysis. , 2004, Journal of experimental psychology. General.

[20]  KongFatt Wong-Lin,et al.  Optimal performance in a countermanding saccade task , 2010, Brain Research.

[21]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[22]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[23]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[24]  G. Logan,et al.  Inhibitory control in mind and brain: an interactive race model of countermanding saccades. , 2007, Psychological review.

[25]  R. Barkley Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. , 1997, Psychological bulletin.

[26]  J. Schall,et al.  Countermanding saccades in macaque , 1995, Visual Neuroscience.

[27]  H. Amièva,et al.  Inhibitory Breakdown and Dementia of the Alzheimer Type: A General Phenomenon? , 2002, Journal of clinical and experimental neuropsychology.

[28]  R. Carpenter,et al.  Countermanding saccades in humans , 1999, Vision Research.

[29]  P. Sherman,et al.  The Utility of the Proximate-Ultimate Dichotomy in Ethology , 2010 .

[30]  G. Simons Great Expectations: Theory of Optimal Stopping , 1973 .

[31]  G. Logan On the ability to inhibit thought and action , 1984 .

[32]  Timothy Edward John Behrens,et al.  Triangulating a Cognitive Control Network Using Diffusion-Weighted Magnetic Resonance Imaging (MRI) and Functional MRI , 2007, The Journal of Neuroscience.

[33]  G. Logan,et al.  Models of response inhibition in the stop-signal and stop-change paradigms , 2009, Neuroscience & Biobehavioral Reviews.

[34]  G. Logan,et al.  Converging Evidence for a Fronto-Basal-Ganglia Network for Inhibitory Control of Action and Cognition , 2007, The Journal of Neuroscience.

[35]  M. Rieger,et al.  Inhibition of ongoing responses in patients with Parkinson’s disease , 2004, Journal of Neurology, Neurosurgery & Psychiatry.

[36]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[37]  R Bellman,et al.  On the Theory of Dynamic Programming. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[38]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[39]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[40]  T. Wager,et al.  Motivational influences on response inhibition measures. , 2010, Journal of experimental psychology. Human perception and performance.

[41]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[42]  Angela J. Yu,et al.  Dynamics of attentional selection under conflict: toward a rational Bayesian account. , 2009, Journal of experimental psychology. Human perception and performance.