Time-evolving psychological processes over repeated decisions.

Many psychological experiments have subjects repeat a task to gain the statistical precision required to test quantitative theories of psychological performance. In such experiments, time-on-task can have sizable effects on performance, changing the psychological processes under investigation. Most research has either ignored these changes, treating the underlying process as static, or sacrificed some psychological content of the models for statistical simplicity. We use particle Markov chain Monte-Carlo methods to study psychologically plausible time-varying changes in model parameters. Using data from three highly cited experiments, we find strong evidence in favor of a hidden Markov switching process as an explanation of time-varying effects. This embodies the psychological assumption of "regime switching," with subjects alternating between different cognitive states representing different modes of decision-making. The switching model explains key long- and short-term dynamic effects in the data. The central idea of our approach can be applied quite generally to quantitative psychological theories, beyond the models and datasets that we investigate. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

[1]  Birte U. Forstmann,et al.  A new model of decision processing in instrumental learning tasks , 2020, bioRxiv.

[2]  Michael J. Frank,et al.  Simultaneous Hierarchical Bayesian Parameter Estimation for Reinforcement Learning and Drift Diffusion Models: a Tutorial and Links to Neural Data , 2020, Computational brain & behavior.

[3]  Robert Kohn,et al.  Robustly estimating the marginal likelihood for cognitive models via importance sampling , 2019, Behavior Research Methods.

[4]  Scott D. Brown,et al.  New estimation approaches for the hierarchical Linear Ballistic Accumulator model , 2018, Journal of Mathematical Psychology.

[5]  Guy E. Hawkins,et al.  When humans behave like monkeys: Feedback delays and extensive practice increase the efficiency of speeded decisions , 2019, Cognition.

[6]  Robert Kohn,et al.  New Estimation Approaches For The Linear Ballistic Accumulator Model , 2019 .

[7]  Andrew Heathcote,et al.  Refining the Law of Practice , 2018, Psychological review.

[8]  Scott D. Brown,et al.  Response Times and Decision‐Making , 2018 .

[9]  Tung D Phan,et al.  The Variability Puzzle in Human Memory , 2017, bioRxiv.

[10]  M. Frank,et al.  The drift diffusion model as the choice rule in reinforcement learning , 2017, Psychonomic bulletin & review.

[11]  R. Kohn,et al.  Efficient Bayesian estimation for flexible panel models for multivariate outcomes: Impact of life events on mental health and excessive alcohol consumption , 2017, 1706.03953.

[12]  M. Walsh,et al.  Computational cognitive modeling of the temporal dynamics of fatigue from sleep loss , 2017, Psychonomic bulletin & review.

[13]  Jeromy Anglim,et al.  Abrupt Strategy Change Underlies Gradual Performance Change: Bayesian Hierarchical Models of Component and Aggregate Strategy Use , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[14]  Peter F. Craigmile,et al.  A Bayesian Race Model for Recognition Memory , 2017 .

[15]  Zachary C. Irving,et al.  Mind-wandering as spontaneous thought: a dynamic framework , 2016, Nature Reviews Neuroscience.

[16]  Birte U. Forstmann,et al.  A Neural Model of Mind Wandering , 2016, Trends in Cognitive Sciences.

[17]  Scott D. Brown,et al.  Diffusion Decision Model: Current Issues and History , 2016, Trends in Cognitive Sciences.

[18]  Avinash Barnwal,et al.  Generalising the drift rate distribution for linear ballistic accumulators , 2015 .

[19]  Fredrik Lindsten,et al.  Particle Gibbs with refreshed backward simulation , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  J. Smallwood,et al.  The science of mind wandering: empirically navigating the stream of consciousness. , 2015, Annual review of psychology.

[21]  Brandon M. Turner,et al.  When the Brain Takes a Break: A Model-Based Analysis of Mind Wandering , 2014, The Journal of Neuroscience.

[22]  Scott D. Brown,et al.  The hare and the tortoise: emphasizing speed can change the evidence used to make decisions. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[23]  B. Newell,et al.  Degraded conditions: Confounds in the study of decision making , 2014, Behavioral and Brain Sciences.

[24]  Thomas V. Wiecki,et al.  HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python , 2013, Front. Neuroinform..

[25]  Brandon M. Turner,et al.  A method for efficiently sampling from distributions with correlated dimensions. , 2013, Psychological methods.

[26]  Ingmar Visser,et al.  Seven things to remember about hidden Markov models: A tutorial on Markovian models for time series , 2011 .

[27]  R. Ratcliff,et al.  Diffusion model for one-choice reaction-time tasks and the cognitive effects of sleep deprivation , 2011, Proceedings of the National Academy of Sciences.

[28]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[29]  M. Kane,et al.  Does mind wandering reflect executive function or executive failure? Comment on Smallwood and Schooler (2006) and Watkins (2008). , 2010, Psychological bulletin.

[30]  Ellen L. Hamaker,et al.  Regime-switching models to study psychological processes , 2010 .

[31]  Scott D. Brown,et al.  The overconstraint of response time models: Rethinking the scaling problem , 2009, Psychonomic bulletin & review.

[32]  J. Busemeyer,et al.  Empirical Comparison of Markov and Quantum models of decision-making , 2009 .

[33]  Relative judgment and knowledge of the category structure , 2009, Psychonomic bulletin & review.

[34]  Andrew Heathcote,et al.  Anticipatory reconfiguration elicited by fully and partially informative cues that validly predict a switch in task , 2009, Cognitive, affective & behavioral neuroscience.

[35]  Han L. J. van der Maas,et al.  Hidden Markov Models for Individual Time Series , 2009 .

[36]  K. R. Ridderinkhof,et al.  Striatum and pre-SMA facilitate decision-making under time pressure , 2008, Proceedings of the National Academy of Sciences.

[37]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[38]  Andrew Heathcote,et al.  An integrated model of choices and response times in absolute identification. , 2008, Psychological review.

[39]  R. Ratcliff,et al.  A Diffusion Model Account of Criterion Shifts in the Lexical Decision Task. , 2008, Journal of memory and language.

[40]  Adam Fletcher,et al.  Simulated train driving: fatigue, self-awareness and cognitive disengagement. , 2007, Applied ergonomics.

[41]  Peter F. Craigmile,et al.  An Autocorrelated Mixture Model for Sequences of Response Time Data , 2006 .

[42]  Gordon D. A. Brown,et al.  Absolute identification by relative judgment. , 2005, Psychological review.

[43]  A. Voss,et al.  Interpreting the parameters of the diffusion model: An empirical validation , 2004, Memory & cognition.

[44]  M. Frese,et al.  Mental fatigue and the control of cognitive processes: effects on perseveration and planning. , 2003, Acta psychologica.

[45]  M. Peruggia,et al.  Was it a car or a cat I saw? An Analysis of Response Times for Word Recognition , 2002 .

[46]  S. Chib,et al.  Marginal Likelihood From the Metropolis–Hastings Output , 2001 .

[47]  Scott D. Brown,et al.  The power law repealed: The case for an exponential law of practice , 2000, Psychonomic bulletin & review.

[48]  Richard A. Heath,et al.  Nonlinear Dynamics: Techniques and Applications in Psychology , 2000 .

[49]  Douglas Vickers,et al.  Dynamic Models of Simple Judgments: II. Properties of a Self-Organizing PAGAN (Parallel, Adaptive, Generalized Accumulator Network) Model for Multi-Choice Tasks , 2000 .

[50]  Thomas J. Palmeri,et al.  Theories of automaticity and the power law of practice. , 1999 .

[51]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[52]  Douglas Vickers,et al.  Dynamic Models of Simple Judgments: I. Properties of a Self-Regulating Accumulator Module , 1998 .

[53]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[54]  T. Hesterberg,et al.  Weighted Average Importance Sampling and Defensive Mixture Distributions , 1995 .

[55]  L. Giambra,et al.  A Laboratory Method for Investigating Influences on Switching Attention to Task-Unrelated Imagery and Thought , 1995, Consciousness and Cognition.

[56]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .

[57]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[58]  G. D. Logan Task Switching , 2022 .