Parameter estimation approaches for multinomial processing tree models: A comparison for models of memory and judgment

Abstract Multinomial processing tree (MPT) models are commonly used in cognitive psychology to disentangle and measure the psychological processes underlying behavior. Various estimation approaches have been developed to estimate the parameters of MPT models for a group of participants. These approaches are implemented in various programs (e.g., MPTinR, TreeBUGS) and differ with regard to how data are pooled across participants (no pooling, complete pooling, or partial pooling). The partial-pooling approaches differ with regard to whether correlations between individual-level parameters are explicitly modeled (latent-trait MPT) or not (beta-MPT). However, it is currently unclear whether the theoretical advantages of the partial-pooling approaches actually yield the best results in standard practice (i.e., with typical parameter values and amounts of data). We conducted parameter recovery analyses comparing the accuracy and precision of four estimation approaches for two MPT models: the source-monitoring model and the hindsight-bias model. For essential (“core”) parameters of the two models, the partial-pooling approaches yielded the best results overall. Importantly, there were also model-specific differences between the approaches. For the source-monitoring model, the latent-trait approach achieved the best results. For more complex hindsight-bias model, the latent-trait approach appeared to be overparameterized for typical amounts of data; here, the beta-MPT approach was better. We derive recommendations for applications of the two MPT models.

[1]  B. Hilbig,et al.  Multinomial processing tree models: A review of the literature. , 2009 .

[2]  U. Bayen,et al.  A multiprocess account of hindsight bias in children. , 2010, Developmental psychology.

[3]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[4]  William H. Batchelder,et al.  The statistical analysis of a model for storage and retrieval processes in human memory , 1986 .

[5]  K. C. Klauer,et al.  Hierarchical Multinomial Processing Tree Models: A Latent-Trait Approach , 2006 .

[6]  Morten Moshagen,et al.  multiTree: A computer program for the analysis of multinomial processing tree models , 2010, Behavior research methods.

[7]  K. Rothermund,et al.  Estimating the contributions of associations and recoding in the Implicit Association Test: the ReAL model for the IAT. , 2013, Journal of personality and social psychology.

[8]  Thorsten Pachur,et al.  How does aging affect recognition-based inference? A hierarchical Bayesian modeling approach. , 2015, Acta psychologica.

[9]  Hierarchical modeling of contingency-based source monitoring: A test of the probability-matching account , 2013, Psychonomic bulletin & review.

[10]  Richard A. Chechile,et al.  Pooling data versus averaging model fits for some prototypical multinomial processing tree models , 2009 .

[11]  A. Bröder,et al.  RECOLLECTION BIASES IN HINDSIGHT JUDGMENTS , 2007 .

[12]  Andrew Heathcote,et al.  An introduction to good practices in cognitive modeling , 2015 .

[13]  Daniel W. Heck,et al.  TreeBUGS: An R package for hierarchical multinomial-processing-tree modeling , 2017, Behavior Research Methods.

[14]  Michael D. Lee,et al.  A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods , 2008, Cogn. Sci..

[15]  Beatrice G. Kuhlmann,et al.  Is knowledge reliance in source guessing a cognitive trait? Examining stability across time and domain , 2020, Memory & cognition.

[16]  William H. Batchelder,et al.  Assessing individual differences in categorical data , 2008, Psychonomic bulletin & review.

[17]  Arndt Bröder,et al.  Memory for multidimensional source information. , 2002 .

[18]  David M. Riefer,et al.  Multinomial processing models of source monitoring. , 1990 .

[19]  Edgar Erdfelder,et al.  Decomposing the hindsight bias: A multinomial processing tree model for separating recollection and reconstruction in hindsight. , 1998 .

[20]  U. Bayen,et al.  Adult age differences in hindsight bias: The role of recall ability. , 2015, Psychology and aging.

[21]  U. Bayen,et al.  When is schematic knowledge used in source monitoring? , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[22]  U. Bayen,et al.  Source monitoring deficits in patients with schizophrenia; a multinomial modelling analysis , 1999, Psychological Medicine.

[23]  J. Vandekerckhove,et al.  The EZ diffusion model provides a powerful test of simple empirical effects , 2016, Psychonomic bulletin & review.

[24]  Nina R. Arnold,et al.  Is prospective memory related to depression and anxiety? A hierarchical MPT modelling approach , 2015, Memory.

[25]  G. V. Nakamura,et al.  The use of schematic knowledge about sources in source monitoring , 2000, Memory & cognition.

[26]  Adam N. Sanborn,et al.  Model evaluation using grouped or individual data , 2008, Psychonomic bulletin & review.

[27]  Stephan Lewandowsky,et al.  Using Parameter Sensitivity and Interdependence to Predict Model Scope and Falsifiability , 1996 .

[28]  U. Bayen,et al.  Effects of dysphoria and induced negative mood on the processes underlying hindsight bias , 2017, Cognition & emotion.

[29]  W. Batchelder,et al.  Beta-MPT: Multinomial processing tree models for addressing individual differences , 2010 .

[30]  E. Wagenmakers,et al.  Bayesian Estimation of Multinomial Processing Tree Models with Heterogeneity in Participants and Items , 2013, Psychometrika.

[31]  Edgar Erdfelder,et al.  Do smarter people employ better decision strategies? The influence of intelligence on adaptive use of the recognition heuristic , 2018 .

[32]  E. Wagenmakers,et al.  Cognitive model decomposition of the BART: Assessment and application , 2011 .

[33]  M. S. Spektor,et al.  The relative merit of empirical priors in non-identifiable and sloppy models: Applications to models of learning and decision-making , 2018, Psychonomic bulletin & review.

[34]  Edgar Erdfelder,et al.  Explaining individual differences in cognitive processes underlying hindsight bias , 2015, Psychonomic bulletin & review.

[35]  E. Erdfelder,et al.  The interplay of memory and judgment processes in effects of aging on hindsight bias. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[36]  E. Erdfelder,et al.  What kind of bias is hindsight bias? , 1998 .

[37]  David M. Riefer,et al.  Theoretical and empirical review of multinomial process tree modeling , 1999, Psychonomic bulletin & review.

[38]  W. Batchelder,et al.  The statistical analysis of general processing tree models with the EM algorithm , 1994 .

[39]  Beatrice G. Kuhlmann,et al.  The impact of age stereotypes on source monitoring in younger and older adults. , 2016, Psychology and Aging.

[40]  Thorsten Pachur,et al.  Age Differences in Hindsight Bias: A Meta-Analysis , 2019, Psychology and aging.

[41]  Xiangen Hu,et al.  Measuring memory factors in source monitoring: Reply to Kinchla. , 1994 .

[42]  Nina R. Arnold,et al.  Hierarchical Multinomial Modeling Approaches: An Application to Prospective Memory and Working Memory. , 2015, Experimental psychology.

[43]  Thorsten Pachur,et al.  The development of adaptive decision making: Recognition-based inference in children and adolescents. , 2016, Developmental psychology.

[44]  K. C. Klauer,et al.  Applying processing trees in social psychology , 2016 .

[45]  Nina R. Arnold,et al.  Age Differences in Processes Underlying Hindsight Bias: A Life-Span Study , 2018 .

[46]  R. Pohl,et al.  HINDSIGHT BIAS: ON BEING WISE AFTER THE EVENT , 2007 .

[47]  Beatrice G. Kuhlmann,et al.  Metamemory Expectancy Illusion and Schema-Consistent Guessing in Source Monitoring , 2019, Journal of experimental psychology. Learning, memory, and cognition.

[48]  E. Erdfelder,et al.  Inhibitory control underlies individual differences in older adults' hindsight bias. , 2016, Psychology and aging.

[49]  Thorsten Pachur,et al.  Using Bayesian hierarchical parameter estimation to assess the generalizability of cognitive models of choice , 2015, Psychonomic bulletin & review.

[50]  E. Erdfelder,et al.  Source discrimination, item detection, and multinomial models of source monitoring. , 1996 .

[51]  Edgar Erdfelder,et al.  Individual differences in use of the recognition heuristic are stable across time, choice objects, domains, and presentation formats , 2015, Memory & Cognition.

[52]  Edgar Erdfelder,et al.  One-reason decision making unveiled: a measurement model of the recognition heuristic. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[53]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[54]  Henrik Singmann,et al.  MPTinR: Analysis of multinomial processing tree models in R , 2013, Behavior research methods.

[55]  Jun Lu,et al.  An introduction to Bayesian hierarchical models with an application in the theory of signal detection , 2005, Psychonomic bulletin & review.

[56]  K C Klauer,et al.  Unraveling social categorization in the "who said what?" paradigm. , 1998, Journal of personality and social psychology.