Bayesian methods applied to the generalized matching law.

We demonstrate the usefulness of Bayesian methods in developing, evaluating, and using psychological models in the experimental analysis of behavior. We do this through a case study, involving new experimental data that measure the response count and time allocation behavior in pigeons under concurrent random-ratio random-interval schedules of reinforcement. To analyze these data, we implement a series of behavioral models, based on the generalized matching law, as graphical models, and use computational methods to perform fully Bayesian inference. We demonstrate how Bayesian methods, implemented in this way, make inferences about parameters representing psychological variables, how they test the descriptive adequacy of models as accounts of behavior, and how they compare multiple competing models. We also demonstrate how the Bayesian graphical modeling approach allows for more complicated modeling structures, including hierarchical, common cause, and latent mixture structures, to formalize more complicated behavioral models. As part of the case study, we demonstrate how the statistical properties of Bayesian methods allow them to provide more direct and intuitive tests of theories and hypotheses, and how they support the creative and exploratory development of new theories and models.

[1]  W M Baum,et al.  Matching, statistics, and common sense. , 1983, Journal of the experimental analysis of behavior.

[2]  William H Batchelder,et al.  Hierarchical Bayesian Modeling for Test Theory Without an Answer Key , 2015, Psychometrika.

[3]  Ben Taskar,et al.  Graphical Models in a Nutshell , 2007 .

[4]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[5]  Eric-Jan Wagenmakers,et al.  An encompassing prior generalization of the Savage-Dickey density ratio , 2010, Comput. Stat. Data Anal..

[6]  W M Baum,et al.  Optimization and the matching law as accounts of instrumental behavior. , 1981, Journal of the experimental analysis of behavior.

[7]  M. Lee,et al.  Bayesian Cognitive Modeling: A Practical Course , 2014 .

[8]  Jeffrey N. Rouder,et al.  The fallacy of placing confidence in confidence intervals , 2015, Psychonomic bulletin & review.

[9]  John K. Kruschke,et al.  Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan , 2014 .

[10]  M. Lee,et al.  A Bayesian hierarchical mixture approach to individual differences: Case studies in selective attention and representation in category learning ☆ , 2014 .

[11]  J J McDowell,et al.  Toward a contemporary quantitative model of punishment. , 2018, Journal of the experimental analysis of behavior.

[12]  P. Kop Reinforcement, choice and response strength , 1990 .

[13]  Michael D. Lee,et al.  Bayesian Methods in Cognitive Modeling , 2016 .

[14]  R. Feynman The Character of Physical Law , 1965 .

[15]  J. Kruschke Doing Bayesian Data Analysis: A Tutorial with R and BUGS , 2010 .

[16]  M. Lee,et al.  Determining informative priors for cognitive models , 2018, Psychonomic bulletin & review.

[17]  M. Lee,et al.  Bayesian Benefits for the Pragmatic Researcher , 2016 .

[18]  Michael D. Lee,et al.  A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods , 2008, Cogn. Sci..

[19]  W. Baum Dynamics of choice: a tutorial. , 2010, Journal of the experimental analysis of behavior.

[20]  Judea Pearl,et al.  Graphical Models for Probabilistic and Causal Reasoning , 1997, The Computer Science and Engineering Handbook.

[21]  M. Davison,et al.  The matching law: A research review. , 1988 .

[22]  I. J. Myung,et al.  Toward a method of selecting among computational models of cognition. , 2002, Psychological review.

[23]  J. Nevin,et al.  Response strength in extreme multiple schedules. , 2012, Journal of the experimental analysis of behavior.

[24]  C. Shimp What Behavioral Variability Means in Molecular, Molar, and Unified Analyses , 2014 .

[25]  M. Davison,et al.  Choice with frequently changing food rates and food ratios. , 2014, Journal of the experimental analysis of behavior.

[26]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[27]  Peter R Killeen,et al.  The logistics of choice. , 2015, Journal of the experimental analysis of behavior.

[28]  Martyn Plummer,et al.  JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling , 2003 .

[29]  Jeffrey N. Rouder,et al.  A hierarchical bayesian statistical framework for response time distributions , 2003 .

[30]  J. Kagel,et al.  Maximization theory in behavioral psychology , 1981, Behavioral and Brain Sciences.

[31]  Maarten Speekenbrink,et al.  Uncertainty and Exploration in a Restless Bandit Problem , 2015, Top. Cogn. Sci..

[32]  Mark Steyvers,et al.  Topics in semantic representation. , 2007, Psychological review.

[33]  S. S. Stevens On the psychophysical law. , 1957, Psychological review.

[34]  Joachim Vandekerckhove,et al.  Editorial: Bayesian methods for advancing psychological science , 2018, Psychonomic bulletin & review.

[35]  M. Lee,et al.  Bayesian statistical inference in psychology: comment on Trafimow (2003). , 2005, Psychological review.

[36]  G. S. Reynolds,et al.  An analysis of response and time matching to reinforcement in concurrent ratio-interval schedules. , 1973, Journal of the experimental analysis of behavior.

[37]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[38]  E Mullins,et al.  On the analysis of studies of choice. , 1982, Journal of the experimental analysis of behavior.

[39]  R. T. Cox,et al.  The Algebra of Probable Inference , 1962 .

[40]  Jacob K. Goeree,et al.  Quantal Response Equilibrium , 2018 .

[41]  Arturo Bouzas,et al.  Hierarchical Bayesian modeling of intertemporal choice , 2017, Judgment and Decision Making.

[42]  J D Findley,et al.  Preference and Switching under Concurrent Scheduling. , 1958, Journal of the experimental analysis of behavior.

[43]  Joachim Vandekerckhove,et al.  Modeling when people quit: Bayesian censored geometric models with hierarchical and latent-mixture extensions , 2018, Behavior research methods.

[44]  Jun Lu,et al.  An introduction to Bayesian hierarchical models with an application in the theory of signal detection , 2005, Psychonomic bulletin & review.

[45]  Matthew D. Zeigenfuse,et al.  A general latent assignment approach for modeling psychological contaminants , 2010 .

[46]  Michael I. Jordan Graphical Models , 2003 .

[47]  L. M. M.-T. Theory of Probability , 1929, Nature.

[48]  W. Baum,et al.  Matching, undermatching, and overmatching in studies of choice. , 1979, Journal of the experimental analysis of behavior.

[49]  Daniel W. Heck,et al.  From information processing to decisions: Formalizing and comparing psychologically plausible choice models , 2017, Cognitive Psychology.

[50]  W. Baum,et al.  Concurrent variable-interval variable-ratio schedules in a dynamic choice environment. , 2017, Journal of the experimental analysis of behavior.

[51]  R. Royall On the Probability of Observing Misleading Statistical Evidence , 2000 .

[52]  Michael D. Lee,et al.  Bayesian outcome-based strategy classification , 2016, Behavior research methods.

[53]  Michael E. Young,et al.  Discounting: A practical guide to multilevel analysis of choice data. , 2018, Journal of the experimental analysis of behavior.

[54]  C. Gallistel,et al.  The Importance of Proving the Null , 2022 .

[55]  Herbert Hoijtink,et al.  Bayesian model selection using encompassing priors , 2005 .

[56]  David Lindley,et al.  Bayesian Statistics, a Review , 1987 .

[57]  B. Newell,et al.  Using hierarchical Bayesian methods to examine the tools of decision-making , 2011, Judgment and Decision Making.

[58]  W. Baum,et al.  Limits to preference and the sensitivity of choice to rate and amount of food. , 2016, Journal of the experimental analysis of behavior.

[59]  W M Baum,et al.  On two types of deviation from the matching law: bias and undermatching. , 1974, Journal of the experimental analysis of behavior.

[60]  R. Herrnstein On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[61]  Jeffrey N. Rouder,et al.  Robust misinterpretation of confidence intervals , 2013, Psychonomic bulletin & review.

[62]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[63]  Derek D. Reed,et al.  The Matching Law: A Tutorial for Practitioners , 2011, Behavior analysis in practice.

[64]  J. E. Mazur,et al.  Mathematical models and the experimental analysis of behavior. , 2006, Journal of the experimental analysis of behavior.

[65]  M. Lee How cognitive modeling can benefit from hierarchical Bayesian models. , 2011 .

[66]  Benjamin T Vincent,et al.  Hierarchical Bayesian estimation and hypothesis testing for delay discounting tasks , 2015, Behavior Research Methods.

[67]  J. Staddon,et al.  OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR SPACED RESPONDING AND CHOICE : A PRELIMINARY ANALYSIS ' , 2005 .

[68]  I. J. Myung,et al.  Applying Occam’s razor in modeling cognition: A Bayesian approach , 1997 .