Strategy Selection Versus Strategy Blending: A Predictive Perspective on Single‐ and Multi‐Strategy Accounts in Multiple‐Cue Estimation

The claim that a person can use different strategies or processes to solve the same task is pervasive in decision making, categorization, estimation, reasoning, and other research fields. Yet such multi-strategy approaches differ widely in how they envision that the different strategies are coordinated and therefore do not represent one unitary approach. Toolbox models, for example, assume that people shift from one strategy to another as they adapt to specific task environments based on past experience. Unlike such multi-strategy selection approaches, multi-strategy blending approaches assume that the outputs of different strategies are blended into a joint, hybrid response (i.e., “wisdom of strategies” in one mind). The goal of this article is twofold. First, we discuss strategy blending as a conceptual alternative to strategy selection for modeling human judgment. Second, we investigate the predictive performance of the different approaches in synthetic and real-world environments. Taking a normative perspective, we study the coordination of rule-based and exemplar-based processes in estimation tasks. Our simulations using synthetic and real-world environments indicate that, for medium-sized samples, multi-strategy blending approaches lead to more accurate estimates than relying on a single strategy or selecting a strategy based on past experience—possibly because neither rule- nor exemplar-based processes in isolation are sufficient to capture statistical regularities that enable accurate estimates. This suggests that multi-strategy blending approaches can be advantageous to the degree that they rely on qualitatively different strategies. Copyright © 2016 John Wiley & Sons, Ltd.

[1]  John R. Anderson,et al.  A General Instance-Based Learning Framework for Studying Intuitive Decision-Making in a Cognitive Architecture (Open Access, Publisher's Version) , 2014 .

[2]  R. Ratcliff,et al.  CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Comparing Exemplar- and Rule- Based Theories of Categorization , 2022 .

[3]  Jörg Rieskamp,et al.  Testing adaptive toolbox models: a Bayesian hierarchical approach. , 2013, Psychological review.

[4]  J. Rieskamp,et al.  Models of quantitative estimations: rule-based and exemplar-based processes compared. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Stefan M. Herzog,et al.  The Wisdom of Many in One Mind , 2009, Psychological science.

[6]  Emmanuel M. Pothos,et al.  Exemplar similarity and rule application , 2010, Cognition.

[7]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[8]  Magnus Persson,et al.  PROBabilities from EXemplars (PROBEX): a "lazy" algorithm for probabilistic inference from generic knowledge , 2002 .

[9]  Jörg Rieskamp,et al.  The mapping model: a cognitive theory of quantitative estimation. , 2008, Journal of experimental psychology. General.

[10]  A. Bröder,et al.  When the Rule is Ruled Out: Exemplars and Rules in Decisions from Memory , 2013 .

[11]  J. Rieskamp,et al.  Pillars of judgment: how memory abilities affect performance in rule-based and exemplar-based judgments. , 2014, Journal of experimental psychology. General.

[12]  D. Shanks,et al.  Learning in a changing environment. , 2010, Journal of experimental psychology. General.

[13]  David W. Aha,et al.  Case-Based Reasoning Integrations , 2002, AI Mag..

[14]  Mark K. Johansen,et al.  Exemplar-based accounts of "multiple-system" phenomena in perceptual categorization. , 2000, Psychonomic bulletin & review.

[15]  Arndt Bröder,et al.  Stimulus format and working memory in fast and frugal strategy selection , 2006 .

[16]  A. Bröder,et al.  Single-process versus multiple-strategy models of decision making: evidence from an information intrusion paradigm. , 2014, Acta psychologica.

[17]  G. Owen,et al.  Thirteen theorems in search of the truth , 1983 .

[18]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[19]  J. Kruschke,et al.  Rules and exemplars in category learning. , 1998, Journal of experimental psychology. General.

[20]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[21]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[22]  Lee R Brooks,et al.  Instantiated features and the use of "rules.". , 2006, Journal of experimental psychology. General.

[23]  M. Lee,et al.  The wisdom of the crowd playing The Price Is Right , 2010, Memory & cognition.

[24]  Robyn M. Dawes,et al.  The Superiority of Simple Alternatives to Regression for Social Science Predictions , 2004 .

[25]  E. Pothos The rules versus similarity distinction. , 2005, The Behavioral and brain sciences.

[26]  Richard P. Larrick,et al.  The wisdom of select crowds. , 2014, Journal of personality and social psychology.

[27]  David L. Faigman,et al.  Human category learning. , 2005, Annual review of psychology.

[28]  B. Brehmer The psychology of linear judgement models , 1994 .

[29]  David V. Budescu,et al.  When is a crowd wise? , 2014, ArXiv.

[30]  G. Gigerenzer,et al.  The bias bias , 2015 .

[31]  Richard P. Larrick,et al.  Strategies for revising judgment: how (and how well) people use others' opinions. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[32]  R. Nosofsky,et al.  Rule-plus-exception model of classification learning. , 1994, Psychological review.

[33]  Gregory Ashby,et al.  A neuropsychological theory of multiple systems in category learning. , 1998, Psychological review.

[34]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[35]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[36]  N. Chater,et al.  Ten years of the rational analysis of cognition , 1999, Trends in Cognitive Sciences.

[37]  A. Bröder,et al.  Take the best versus simultaneous feature matching: probabilistic inferences from memory and effects of representation format. , 2003, Journal of experimental psychology. General.

[38]  Linnéa Karlsson,et al.  Why does cue polarity information provide benefits in inference problems? The role of strategy selection and knowledge of cue importance. , 2013, Acta psychologica.

[39]  Thorsten Pachur,et al.  Type of learning task impacts performance and strategy selection in decision making , 2012, Cognitive Psychology.

[40]  A. Timmermann Chapter 4 Forecast Combinations , 2006 .

[41]  John K. Kruschke,et al.  The Cambridge Handbook of Computational Psychology: Models of Categorization , 2008 .

[42]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[43]  Julian N. Marewski,et al.  Strategy selection: An introduction to the modeling challenge. , 2014, Wiley interdisciplinary reviews. Cognitive science.

[44]  Stefan M. Herzog,et al.  Haunted by a doppelgänger: irrelevant facial similarity affects rule-based judgments. , 2014, Experimental psychology.

[45]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[46]  Richard P. Larrick,et al.  Intuitions About Combining Opinions: Misappreciation of the Averaging Principle , 2006, Manag. Sci..

[47]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[48]  D. Homa,et al.  The Modulating Influence of Category Size on the Classification of Exception Patterns , 2008, Quarterly journal of experimental psychology.

[49]  Reid Hastie,et al.  The robust beauty of majority rules in group decisions. , 2005, Psychological review.

[50]  Jack B. Soll Intuitive Theories of Information: Beliefs about the Value of Redundancy , 1999, Cognitive Psychology.

[51]  Pierre Geurts,et al.  Bias vs Variance Decomposition for Regression and Classification , 2005, Data Mining and Knowledge Discovery Handbook.

[52]  R. Jacobs Computational studies of the development of functionally specialized neural modules , 1999, Trends in Cognitive Sciences.

[53]  A. Wills,et al.  Processes of overall similarity sorting in free classification. , 2008, Journal of experimental psychology. Human perception and performance.

[54]  David W. Aha,et al.  Special Issue on Lazy Learning , 1997 .

[55]  H. Pashler,et al.  Measuring the Crowd Within , 2008, Psychological science.

[56]  John R. Anderson,et al.  A hybrid model of categorization , 2001, Psychonomic bulletin & review.

[57]  A. Raftery Bayesian Model Selection in Social Research , 1995 .

[58]  Stefan Krause,et al.  Swarm intelligence in animals and humans. , 2010, Trends in ecology & evolution.

[59]  Robert M. Nosofsky,et al.  Dissociations Between Categorization and Recognition in Amnesic and Normal Individuals: An Exemplar-Based Interpretation , 1998 .

[60]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[61]  B. Newell,et al.  The Effectiveness of Feedback in Multiple-Cue Probability Learning , 2009, Quarterly journal of experimental psychology.

[62]  J. Rieskamp,et al.  SSL: a theory of how people learn to select strategies. , 2006, Journal of experimental psychology. General.

[63]  Stefan M. Herzog,et al.  Think twice and then: combining or choosing in dialectical bootstrapping? , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[64]  J B Haldane,et al.  A MATHEMATICAL THEORY OF NATURAL AND ARTIFICIAL SELECTION. PART II THE INFLUENCE OF PARTIAL SELF‐FERTILISATION, INBREEDING, ASSORTATIVE MATING, AND SELECTIVE FERTILISATION ON THE COMPOSITION OF MENDELIAN POPULATIONS, AND ON NATURAL SELECTION. , 1924, Mathematical Proceedings of the Cambridge Philosophical Society.

[65]  M. A. Erickson,et al.  Executive attention and task switching in category learning: Evidence for stimulus-dependent representation , 2008, Memory & cognition.

[66]  Jacob Feldman,et al.  Conceptual complexity and the bias/variance tradeoff , 2011, Cognition.

[67]  Mandeep K. Dhami,et al.  The role of representative design in an ecological approach to cognition. , 2004, Psychological bulletin.

[68]  N. Chater,et al.  Similarity and rules: distinct? exhaustive? empirically distinguishable? , 1998, Cognition.

[69]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[70]  Stefan M. Herzog,et al.  Harnessing the wisdom of the inner crowd , 2014, Trends in Cognitive Sciences.

[71]  J. Rieskamp,et al.  Deliberation’s Blindsight , 2013, Psychological science.

[72]  Mark K. Johansen,et al.  Are there representational shifts during category learning? , 2002, Cognitive Psychology.

[73]  P. Juslin,et al.  Information integration in multiple cue judgment: A division of labor hypothesis , 2008, Cognition.

[74]  R. Nosofsky American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[75]  Aaron B. Hoffman,et al.  Thirty-something categorization results explained: selective attention, eyetracking, and models of category learning. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[76]  Jeffrey S. Simonoff,et al.  Tree Induction Vs Logistic Regression: A Learning Curve Analysis , 2001, J. Mach. Learn. Res..

[77]  Henrik Olsson,et al.  Adaptive changes between cue abstraction and exemplar memory in a multiple-cue judgment task with continuous cues , 2007, Psychonomic bulletin & review.

[78]  Ben R. Newell,et al.  Cue integration vs. exemplar-based reasoning in multi-attribute decisions from memory: A matter of cue representation , 2010, Judgment and Decision Making.

[79]  W. Vanpaemel,et al.  In search of abstraction: The varying abstraction model of categorization , 2008, Psychonomic bulletin & review.

[80]  Jerome R. Busemeyer,et al.  A comparison of models for learning how to dynamically integrate multiple cues in order to forecast continuous criteria , 2008 .

[81]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .