A Cautionary Note on Evidence-Accumulation Models of Response Inhibition in the Stop-Signal Paradigm

The stop-signal paradigm is a popular procedure to investigate response inhibition—the ability to stop ongoing responses. It consists of a choice response time (RT) task that is occasionally interrupted by a stop stimulus signaling participants to withhold their response. Performance in the stop-signal paradigm is often formalized as race between a set of go runners triggered by the choice stimulus and a stop runner triggered by the stop signal. We investigated whether evidence-accumulation processes, which have been widely used in choice RT analysis, can serve as the runners in the stop-signal race model and support the estimation of psychologically meaningful parameters. We examined two types of the evidence-accumulation architectures: the racing Wald model (Logan et al. 2014 ) and a novel proposal based on the lognormal race (Heathcote and Love 2012 ). Using a series of simulation studies and fits to empirical data, we found that these models are not measurement models in the sense that the data-generating parameters cannot be recovered in realistic experimental designs.

[1]  Andrew Heathcote,et al.  Linear Deterministic Accumulator Models of Simple Choice , 2012, Front. Psychology.

[2]  G. Logan.  On the ability to inhibit thought and action , 1984 .

[3]  Cajo J. F. ter Braak,et al.  A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces , 2006, Stat. Comput..

[4]  Birte U. Forstmann,et al.  Parameter recovery for the Leaky Competing Accumulator model , 2017 .

[5]  Neeraj J Gandhi,et al.  Behavioral evaluation of movement cancellation. , 2006, Journal of neurophysiology.

[6]  R. Carpenter,et al.  Countermanding saccades in humans , 1999, Vision Research.

[7]  A. Gupta,et al.  A Bayesian Approach to , 1997 .

[8]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[9]  G. Logan,et al.  Impulsivity and Inhibitory Control in Normal Development and Childhood Psychopathology , 1990 .

[10]  Andrew Heathcote,et al.  The Lognormal Race: A Cognitive-Process Model of Choice and Latency with Desirable Psychometric Properties , 2015, Psychometrika.

[11]  Russell A. Poldrack,et al.  Decomposing Decision Components in the Stop-signal Task: A Model-based Approach to Individual Differences in Inhibitory Control , 2014, Journal of Cognitive Neuroscience.

[12]  R. Luce,et al.  Evidence from auditory simple reaction times for both change and level detectors , 1982, Perception & psychophysics.

[13]  M. Fillmore,et al.  Acute effects of oral cocaine on inhibitory control of behavior in humans. , 2002, Drug and alcohol dependence.

[14]  F. Verbruggen,et al.  Proactive and Reactive Stopping When Distracted: An Attentional Account , 2014, Journal of experimental psychology. Human perception and performance.

[15]  M. J. Emerson,et al.  The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis , 2000, Cognitive Psychology.

[16]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[17]  Hans Colonius,et al.  A Note on the Stop-Signal Paradigm, or How to Observe the Unobservable , 1990 .

[18]  D. F. Fisher,et al.  Eye movements : cognition and visual perception , 1982 .

[19]  Simple reaction time with markovian evolution of gaussian discriminal processes , 1970 .

[20]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[21]  A. Heathcote,et al.  Reply to Speckman and Rouder: A theoretical basis for QML , 2004 .

[22]  W. Schwarz.  The ex-Wald distribution as a descriptive model of response times , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[23]  R. Thouless.  Experimental Psychology , 1939, Nature.

[24]  A. Heathcote,et al.  Cognitive modeling suggests that attentional failures drive longer stop-signal reaction time estimates in ADHD , 2019 .

[25]  G. Logan,et al.  Testing the validity of conflict drift-diffusion models for use in estimating cognitive processes: A parameter-recovery study , 2018, Psychonomic bulletin & review.

[26]  A. Heathcote,et al.  Reliability of triggering inhibitory process is a better predictor of impulsivity than SSRT. , 2018, Acta psychologica.

[27]  Andrew Heathcote,et al.  Fitting Wald and ex-Wald distributions to response time data: An example using functions for the S-PLUS package , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[28]  Philip L. Smith.  Psychophysically principled models of visual simple reaction time. , 1995 .

[29]  Marius Usher,et al.  Disentangling decision models: from independence to competition. , 2013, Psychological review.

[30]  Russell C. H. Cheng,et al.  Estimating Parameters in Continuous Univariate Distributions with a Shifted Origin , 1983 .

[31]  Brandon M. Turner,et al.  A method for efficiently sampling from distributions with correlated dimensions. , 2013, Psychological methods.

[32]  G. Logan,et al.  In search of the point of no return: the control of response processes. , 1990, Journal of experimental psychology. Human perception and performance.

[33]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[34]  Russell A. Poldrack,et al.  Author response: A consensus guide to capturing the ability to inhibit actions and impulsive behaviors in the stop-signal task , 2019 .

[35]  Andrew Heathcote,et al.  Dynamic models of choice , 2018, Behavior Research Methods.

[36]  R. Ratcliff,et al.  Retrieval Processes in Recognition Memory , 1976 .

[37]  Jonathon Love,et al.  Decision processes and the slowing of simple choices in schizophrenia. , 2015, Journal of abnormal psychology.

[38]  P. Michie,et al.  Stop-signal response inhibition in schizophrenia: Behavioural, event-related potential and functional neuroimaging data , 2012, Biological Psychology.

[39]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[40]  Jeffrey N. Rouder,et al.  The fallacy of placing confidence in confidence intervals , 2015, Psychonomic bulletin & review.

[41]  Patrick G. Bissett,et al.  Balancing Cognitive Demands: Control Adjustments in the Stop-signal Paradigm Stop-signal Paradigm Post-stop-signal Slowing , 2011 .

[42]  G. Logan,et al.  Impulsivity and Inhibitory Control , 1997 .

[43]  Scott D. Brown,et al.  Bayesian parametric estimation of stop-signal reaction time distributions. , 2013, Journal of experimental psychology. General.

[44]  T. Robbins,et al.  Inhibition and the right inferior frontal cortex: one decade on , 2014, Trends in Cognitive Sciences.

[45]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[46]  E. Wagenmakers,et al.  An Introduction to Model-Based Cognitive Neuroscience , 2015, Springer New York.

[47]  Frederick Verbruggen,et al.  The Stop‐Signal Paradigm , 2018 .

[48]  Jeffrey N. Rouder,et al.  Are unshifted distributional models appropriate for response time? , 2005 .

[49]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[50]  G. Logan,et al.  On the ability to inhibit thought and action: general and special theories of an act of control. , 2014, Psychological review.

[51]  Andrew Heathcote,et al.  Cognitive workload measurement and modeling under divided attention. , 2019, Journal of experimental psychology. Human perception and performance.

[52]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[53]  R. Poldrack,et al.  Cortical and Subcortical Contributions to Stop Signal Response Inhibition: Role of the Subthalamic Nucleus , 2006, The Journal of Neuroscience.

[54]  P. Michie,et al.  Acts of control in schizophrenia: dissociating the components of inhibition , 2002, Psychological Medicine.

[55]  A. Raftery.  Bayesian Model Selection in Social Research , 1995 .

[56]  G. Logan,et al.  Inhibitory control in mind and brain: an interactive race model of countermanding saccades. , 2007, Psychological review.

[57]  Gordon D. Logan,et al.  Confirmation of an Inhibitory Control Deficit in Attention-Deficit/Hyperactivity Disorder , 2000, Journal of abnormal child psychology.

[58]  R. Ratcliff,et al.  Modeling reaction time and accuracy of multiple-alternative decisions , 2010, Attention, perception & psychophysics.

[59]  F. Verbruggen.  Capturing the ability to inhibit actions and impulsive behaviors: A consensus guide to the stop-signal task , 2019 .

[60]  G. Larry Bretthorst,et al.  Estimating the Parameters , 1988 .

[61]  Hans Colonius,et al.  Countermanding saccades with auditory stop signals: testing the race model , 2001, Vision Research.

[62]  Andrew Heathcote,et al.  Failures of cognitive control or attention? The case of stop-signal deficits in schizophrenia , 2017, Attention, Perception, & Psychophysics.

[63]  Thomas V. Wiecki,et al.  Estimating across-trial variability parameters of the Diffusion Decision Model: Expert advice and recommendations , 2018, Journal of Mathematical Psychology.

[64]  Andrew Heathcote,et al.  Inhibiting responses to difficult choices. , 2019, Journal of experimental psychology. General.

[65]  Scott D. Brown,et al.  The overconstraint of response time models: Rethinking the scaling problem , 2009, Psychonomic bulletin & review.

[66]  G. Mandler,et al.  Retrieval processes in recognition , 1974, Memory & cognition.

[67]  R. Ulrich,et al.  Effects of truncation on reaction time analysis. , 1994, Journal of experimental psychology. General.

[68]  A. Heathcote,et al.  Cognitive Modeling Suggests That Attentional Failures Drive Longer Stop-Signal Reaction Time Estimates in Attention Deficit/Hyperactivity Disorder , 2019, Clinical psychological science : a journal of the Association for Psychological Science.

[69]  T. Zandt,et al.  A comparison of two response time models applied to perceptual matching , 2000, Psychonomic bulletin & review.

[70]  Pierre-Louis Bazin,et al.  Cortico-subthalamic white matter tract strength predicts interindividual efficacy in stopping a motor response , 2012, NeuroImage.

[71]  K. R. Ridderinkhof,et al.  Neurocognitive mechanisms of cognitive control: The role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning , 2004, Brain and Cognition.

[72]  G. Logan,et al.  Inhibitory control in mind and brain 2.0: blocked-input models of saccadic countermanding. , 2015, Psychological review.

[73]  E. Wagenmakers,et al.  Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis , 2009, Psychonomic bulletin & review.

[74]  Nathan J Evans,et al.  A parameter recovery assessment of time-variant models of decision-making , 2019, Behavior research methods.

[75]  Phillip L. Emerson,et al.  Simple reaction time with markovian evolution of gaussian discriminal processes , 1970 .

[76]  D. Vickers.  Decision processes in visual perception , 1979 .

[77]  Aditya Murthy,et al.  Voluntary control of multisaccade gaze shifts during movement preparation and execution. , 2010, Journal of neurophysiology.

[78]  Andrew Heathcote,et al.  An introduction to good practices in cognitive modeling , 2015 .

[79]  G. Logan,et al.  Development of inhibitory control across the life span. , 1999, Developmental psychology.

[80]  Jonathon Love,et al.  A Bayesian approach for estimating the probability of trigger failures in the stop-signal paradigm , 2016, Behavior research methods.

[81]  W. Schwarz.  ON THE CONVOLUTION OF INVERSE GAUSSIAN AND EXPONENTIAL RANDOM VARIABLES , 2002 .