SSL: a theory of how people learn to select strategies.

The assumption that people possess a repertoire of strategies to solve the inference problems they face has been raised repeatedly. However, a computational model specifying how people select strategies from their repertoire is still lacking. The proposed strategy selection learning (SSL) theory predicts a strategy selection process on the basis of reinforcement learning. The theory assumes that individuals develop subjective expectations for the strategies they have and select strategies proportional to their expectations, which are then updated on the basis of subsequent experience. The learning assumption was supported in 4 experimental studies. Participants substantially improved their inferences through feedback. In all 4 studies, the best-performing strategy from the participants' repertoires most accurately predicted the inferences after sufficient learning opportunities. When testing SSL against 3 models representing extensions of SSL and against an exemplar model assuming a memory-based inference process, the authors found that SSL predicted the inferences most accurately.

[1]  L. L. Thurstone,et al.  The Learning Function , 1930 .

[2]  E. Hilgard,et al.  Theories of Learning , 1981 .

[3]  O. H. Brownlee,et al.  ACTIVITY ANALYSIS OF PRODUCTION AND ALLOCATION , 1952 .

[4]  K. R. Hammond Probabilistic functioning and the clinical method. , 1955, Psychological review.

[5]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[6]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[7]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[8]  F RESTLE,et al.  The selection of strategies in cue learning. , 1962, Psychological review.

[9]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[10]  Thomas S. Wallsten,et al.  Failure of predictions from subjectively expected utility theory in a Bayesian decision task , 1968 .

[11]  A. Tversky Intransitivity of preferences. , 1969 .

[12]  C. Vlek Multiple probability learning: Associating events with their probabilities of occurrence , 1970 .

[13]  H. J. Einhorn The use of nonlinear, noncompensatory models in decision making. , 1970, Psychological bulletin.

[14]  T. Wallsten,et al.  Individual Decision Behavior , 1972 .

[15]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[16]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[17]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[18]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[19]  W. Estes The cognitive side of probability learning. , 1976 .

[20]  Howard Wainer,et al.  Estimating Coefficients in Linear Models: It Don't Make No Nevermind , 1976 .

[21]  L. Beach,et al.  A Contingency Model for the Selection of Decision Strategies , 1978 .

[22]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[23]  Jay J.J. Christensen-Szalanski,et al.  Problem solving strategies: A selection mechanism, some implications, and some data. , 1978 .

[24]  H. J. Einhorn,et al.  Linear regression and process-tracing models of judgment. , 1979 .

[25]  H. J. Einhorn,et al.  Cognitive processes in choice and decision behavior , 1979 .

[26]  O. Svenson Process descriptions of decision making. , 1979 .

[27]  Oswald Huber,et al.  The influence of some task variables on cognitive operations in an information-processing decision model , 1980 .

[28]  B. Brehmer In one word: Not from experience. , 1980 .

[29]  Peter C. Fishburn,et al.  Lexicographic additive differences , 1980 .

[30]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[31]  Naveed Gilani,et al.  Information search in judgment tasks: A regression model and some preliminary findings , 1982 .

[32]  C A Becker,et al.  Semantic context effects in visual word recognition, sentence processing, and reading: evidence for semantic strategies. , 1982, Journal of experimental psychology. Human perception and performance.

[33]  Mark W. Altom,et al.  Given versus induced category representations: use of prototype and exemplar information in classification. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[34]  G. Pitz,et al.  Judgment and decision: theory and application. , 1984, Annual review of psychology.

[35]  John W. Payne,et al.  Effort and Accuracy in Choice , 1985 .

[36]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[37]  Yaacov Trope,et al.  Problem solving in judgment under uncertainty. , 1987 .

[38]  G. Logan Toward an instance theory of automatization. , 1988 .

[39]  T. Connolly,et al.  Information mispurchase in judgment tasks: A task-driven causal mechanism , 1988 .

[40]  Douglas L. Hintzman,et al.  Judgments of frequency and recognition memory in a multiple-trace memory model. , 1988 .

[41]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[42]  R. Nosofsky Similarity, frequency, and category representations. , 1988 .

[43]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988 .

[44]  Thomas D. Wickens,et al.  Multiway contingency table analysis for the social sciences. , 1989 .

[45]  T. Wickens Multiway Contingency Tables Analysis for the Social Sciences , 1989 .

[46]  M. Doherty,et al.  Effects of cognitive feedback on performance. , 1989 .

[47]  R. Nosofsky,et al.  Rules and exemplars in categorization, identification, and recognition. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[48]  D. Massaro,et al.  Models of integration given multiple sources of information. , 1990, Psychological review.

[49]  John R. Anderson Is human cognition adaptive? , 1991, Behavioral and Brain Sciences.

[50]  David R. Shanks,et al.  CATEGORIZATION BY A CONNECTIONIST NETWORK , 1991 .

[51]  F. Gregory Ashby,et al.  Complex decision rules in categorization : contrasting novice and experienced performance , 1992 .

[52]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[53]  A. Fiske The four elementary forms of sociality: framework for a unified theory of social relations. , 1992, Psychological review.

[54]  O. Svenson Differentiation and consolidation theory of human decision making: A frame of reference for the study of pre- and post-decision processes , 1992 .

[55]  R. Nosofsky Exemplars, prototypes, and similarity rules. , 1992 .

[56]  R. Nosofsky,et al.  Combining exemplar-based category representations and connectionist learning rules. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[57]  Jerome R. Busemeyer,et al.  An adaptive approach to human decision making: Learning theory, decision theory, and human performance. , 1992 .

[58]  Jerome R. Busemeyer,et al.  Violations of the Speed-Accuracy Tradeoff Relation , 1993 .

[59]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[60]  Ola Svenson,et al.  Time pressure and stress in human judgment and decision making , 1993 .

[61]  V. Smith Monetary Rewards and Decision Cost in Experimental Economics: An Extension , 1993 .

[62]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[63]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[64]  G. Myles Journal of Economic Theory: J.-M. Grandmont, 1992, Transformations of the commodity space, behavioural heterogeneity, and the aggregation problem 57, 1-35 , 1993 .

[65]  B. Mellers,et al.  Similarity and Choice. , 1994 .

[66]  W. Estes Toward a Statistical Theory of Learning. , 1994 .

[67]  R. Siegler,et al.  Four aspects of strategic change: Contributions to children's learning of multiplication. , 1995 .

[68]  R. Siegler,et al.  Variation, selection, and cognitive change. , 1995 .

[69]  N. Brown Estimation strategies and the judgment of event frequency. , 1995 .

[70]  D. Stahl Boundedly rational rule learning in a guessing game , 1996 .

[71]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[72]  Daniel Friedman,et al.  Individual Learning in Normal Form Games: Some Laboratory Results☆☆☆ , 1997 .

[73]  Tilman Börgers,et al.  Learning Through Reinforcement and Replicator Dynamics , 1997 .

[74]  I. J. Myung,et al.  Applying Occam’s razor in modeling cognition: A Bayesian approach , 1997 .

[75]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[76]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[77]  Thomas R. Coyle,et al.  Giftedness and variability in strategic processing on a multitrial memory task: Evidence for stability in gifted cognition , 1998 .

[78]  J. Kruschke,et al.  Rules and exemplars in category learning. , 1998, Journal of experimental psychology. General.

[79]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[80]  Ido Erev Signal detection by human observers: a cutoff reinforcement learning model of categorization decisions under uncertainty. , 1998 .

[81]  Auble,et al.  Resource-Allocation Strategies: A Verbal Protocol Analysis. , 1998, Organizational behavior and human decision processes.

[82]  I. Erev,et al.  Games and Human Behavior , 1999 .

[83]  Ulrich Hoffrage,et al.  When do people use simple heuristics, and how can we tell? , 1999 .

[84]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[85]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[86]  Colin Camerer,et al.  Experience‐weighted Attraction Learning in Normal Form Games , 1999 .

[87]  C. Gettys,et al.  MINERVA-DM: A memory processes model for judgments of likelihood. , 1999 .

[88]  P. Tetlock,et al.  Accounting for the effects of accountability. , 1999, Psychological bulletin.

[89]  Kathryn B. Laskey,et al.  Bayesian benchmarks for fast and frugal heuristics , 1999 .

[90]  Dale O. Stahl,et al.  Rule Learning in Symmetric Normal-Form Games: Theory and Evidence , 2000, Games Econ. Behav..

[91]  A. Bröder Assessing the empirical validity of the "take-the-best" heuristic as a model of human probabilistic inference. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[92]  H Pashler,et al.  How persuasive is a good fit? A comment on theory testing. , 2000, Psychological review.

[93]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[94]  Raanan Lipshitz Two cheers for bounded rationality , 2000 .

[95]  K. Lamberts Information-accumulation theory of speeded categorization. , 2000, Psychological review.

[96]  H. Bozdogan,et al.  Akaike's Information Criterion and Recent Developments in Information Complexity. , 2000, Journal of mathematical psychology.

[97]  Browne,et al.  Cross-Validation Methods. , 2000, Journal of mathematical psychology.

[98]  Mark K. Johansen,et al.  Exemplar-based accounts of "multiple-system" phenomena in perceptual categorization. , 2000, Psychonomic bulletin & review.

[99]  Nick Chater How smart can simple heuristics be? , 2000, Behavioral and Brain Sciences.

[100]  J Jonides,et al.  PET evidence for multiple strategies of categorization , 2001, Cognitive, affective & behavioral neuroscience.

[101]  Winston R. Sieck,et al.  Overconfidence effects in category learning: a comparison of connectionist and exemplar memory models. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[102]  A. Roth,et al.  Simple reinforcement learning models and reciprocation in the prisoner's dilemma game. , 2001 .

[103]  Gordon D Logan,et al.  An instance theory of attention and memory. , 2002, Psychological review.

[104]  Norman R. Brown,et al.  Applied Cognitive Psychology Estimating National Populations: Cross-cultural Differences and Availability Effects , 2022 .

[105]  C. González-Vallejo Making trade-offs: a probabilistic and context-sensitive model of choice behavior. , 2002, Psychological review.

[106]  Magnus Persson,et al.  PROBabilities from EXemplars (PROBEX): a "lazy" algorithm for probabilistic inference from generic knowledge , 2002 .

[107]  Dieter Wallach,et al.  Whether skill acquisition is rule or instance based is determined by the structure of the task. , 2002 .

[108]  Mark A. Pitt,et al.  Toward a method of selecting among computational models of cognition. , 2002 .

[109]  I. J. Myung,et al.  When a good fit can be bad , 2002, Trends in Cognitive Sciences.

[110]  Cleotilde Gonzalez,et al.  Instance-based learning in dynamic decision making , 2003 .

[111]  Jörg Rieskamp,et al.  How do people learn to allocate resources? Comparing two learning theories. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[112]  A. Bröder Decision making with the "adaptive toolbox": influence of environmental structure, intelligence, and working memory load. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[113]  P. C. Chu,et al.  Perceptions of accuracy and effort of decision strategies , 2003 .

[114]  B. Newell,et al.  Take the best or look at the rest? Factors influencing "one-reason" decision making. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[115]  B. Newell,et al.  Empirical tests of a fast-and-frugal heuristic: Not everyone "takes-the-best" , 2003 .

[116]  Henrik Olsson,et al.  Cue abstraction and exemplar memory in categorization. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[117]  A. Bröder,et al.  Take the best versus simultaneous feature matching: probabilistic inferences from memory and effects of representation format. , 2003, Journal of experimental psychology. General.

[118]  P. Juslin,et al.  Exemplar effects in categorization and multiple-cue judgment. , 2003, Journal of experimental psychology. General.

[119]  Theories of Learning , 2005 .

[120]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[121]  B. Newell,et al.  Evaluating three criteria for establishing cue-search hierarchies in inferential judgment. , 2005, Journal of experimental psychology. Learning, memory, and cognition.