Verbalization of Decision Strategies in Multiple-Cue Probabilistic Inference

In multiple-cue probabilistic inference, people choose between alternatives based on several cues, each of which is differentially associated with an alternative's overall value. Various strategies have been proposed for probabilistic inference (e.g., weighted additive, tally, and take-the-best). These strategies differ in how many cue values they require to enact and in how they weight each cue. Do decision makers actually use any of these strategies? Ways to investigate this question include analyzing people's choices and the cues that they reveal. However, different strategies often predict the same decisions, and search behavior says nothing about whether or how people use the information that they acquire. In this research, we attempt to elucidate which strategies participants use in a multiple-cue probabilistic inference task by examining verbal protocols, a high-density source of process data. The promise of verbal data is in their utility for testing detailed information processing models. To that end, we apply protocol analysis in conjunction with computational simulations. We find converging evidence across outcome measures, search measures, and verbal reports that most participants use simplifying heuristics, namely take-the-best.

[1]  Daniel M. Oppenheimer,et al.  Heuristics made easy: an effort-reduction framework. , 2008, Psychological bulletin.

[2]  Andreas Glöckner,et al.  Accounting for critical evidence while being precise and avoiding the strategy selection problem in a parallel constraint satisfaction approach – A reply to Marewski , 2010 .

[3]  Edward T. Cokely,et al.  Cognitive abilities and superior decision making under risk: A protocol analysis and process model evaluation , 2009, Judgment and Decision Making.

[4]  H. Simon,et al.  What is an “Explanation” of Behavior? , 1992 .

[5]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[6]  S. Ayal,et al.  Ignorance or integration: the cognitive processes underlying choice behavior , 2009 .

[7]  Ulrich Hoffrage,et al.  Identifying decision strategies in a consumer choice situation , 2008, Judgment and Decision Making.

[8]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[9]  Jacob L. Orquin,et al.  Attention and choice: a review on eye movements in decision making. , 2013, Acta psychologica.

[10]  Mark C. Fox,et al.  Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. , 2011, Psychological bulletin.

[11]  L. Schooler,et al.  The aging decision maker: cognitive aging and the adaptive selection of decision strategies. , 2007, Psychology and aging.

[12]  Jonathan W Schooler,et al.  Introspecting in the spirit of William James: comment on Fox, Ericsson, and Best (2011). , 2011, Psychological bulletin.

[13]  A. K. Basu A Theory of Decision-Making , 1973, The Journal of Sociology & Social Welfare.

[14]  Pieter Koele,et al.  Modelling and describing human judgement processes: The multiattribute evaluation case , 2001 .

[15]  B. Newell,et al.  Take the best or look at the rest? Factors influencing "one-reason" decision making. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[16]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[17]  K. A. Ericsson,et al.  Protocol analysis: Verbal reports as data, Rev. ed. , 1993 .

[18]  A. Bröder Assessing the empirical validity of the "take-the-best" heuristic as a model of human probabilistic inference. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[19]  Eric J. Johnson,et al.  Bias in utility assessments: further evidence and explanations , 1989 .

[20]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[21]  A. Bröder Decision making with the "adaptive toolbox": influence of environmental structure, intelligence, and working memory load. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[22]  R. Hogarth,et al.  Unit weighting schemes for decision making , 1975 .

[23]  P. Todd,et al.  The Quest for Take The Best - Insights and Outlooks from Experimental Research , 2011 .

[24]  Jörg Rieskamp,et al.  Testing adaptive toolbox models: a Bayesian hierarchical approach. , 2013, Psychological review.

[25]  Tobias Richter,et al.  Homo heuristicus Outnumbered: Comment on Gigerenzer and Brighton (2009) , 2011, Top. Cogn. Sci..

[26]  Michael Schulte-Mecklenbeck,et al.  The role of process data in the development and testing of process models of judgment and decision making , 2011 .

[27]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[28]  Eric J. Johnson,et al.  Mindful judgment and decision making. , 2009, Annual review of psychology.

[29]  Thora Tenbrink,et al.  The verbalization of multiple strategies in a variant of the traveling salesperson problem , 2009, Cognitive Processing.

[30]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[31]  Ulrich Hoffrage,et al.  Inferences under time pressure: how opportunity costs affect strategy selection. , 2008, Acta psychologica.

[32]  Nick Chater,et al.  Fast, frugal, and rational: How rational norms explain behavior , 2003 .

[33]  Joke Harte,et al.  Process models of decision making , 1994 .

[34]  A. Bröder,et al.  Single-process versus multiple-strategy models of decision making: evidence from an information intrusion paradigm. , 2014, Acta psychologica.

[35]  Ralph Hertwig,et al.  The robust beauty of ordinary information. , 2010, Psychological review.

[36]  Alan R. Boobis,et al.  Explanation , 2017, Encyclopedia of Machine Learning and Data Mining.

[37]  R. Hogarth,et al.  Heuristic and linear models of judgment: matching rules and environments. , 2007, Psychological review.

[38]  Ulrich Hoffrage,et al.  Why does one-reason decision making work? A case study in ecological rationality , 1999 .

[39]  Simon Farrell,et al.  Computational Modeling in Cognition: Principles and Practice , 2010 .

[40]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[41]  B. Newell,et al.  Evaluating three criteria for establishing cue-search hierarchies in inferential judgment. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[42]  Eduard Brandstätter,et al.  The Cognitive Processes Underlying Risky Choice , 2013 .

[43]  B. Newell,et al.  Empirical tests of a fast-and-frugal heuristic: Not everyone "takes-the-best" , 2003 .

[44]  B. Newell Re-visions of rationality? , 2005, Trends in Cognitive Sciences.

[45]  Eric J. Johnson,et al.  Compensatory Choice Models of Noncompensatory Processes: The Effect of Varying Context , 1984 .

[46]  Danielle R.M. Timmermans,et al.  The impact of task complexity on information use in multi‐attribute decision making , 1993 .

[47]  Philip L. Smith,et al.  Comparing time-accuracy curves: Beyond goodness-of-fit measures , 2009, Psychonomic bulletin & review.

[48]  Wayne D. Gray,et al.  The soft constraints hypothesis: a rational analysis approach to resource allocation for interactive behavior. , 2006, Psychological review.

[49]  Kevin A. Gluck,et al.  The Right Tool for the Job: Information-Processing Analysis in Categorization , 2001 .

[50]  E. Wagenmakers A practical solution to the pervasive problems ofp values , 2007, Psychonomic bulletin & review.

[51]  A. Glöckner,et al.  Multiple-reason decision making based on automatic processing. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[52]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[53]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[54]  M. Lee,et al.  Evidence accumulation in decision making: Unifying the “take the best” and the “rational” models , 2004, Psychonomic bulletin & review.

[55]  Rick P. Thomas,et al.  Psychological plausibility of the theory of probabilistic mental models and the fast and frugal heuristics. , 2008, Psychological review.

[56]  Gerald L. Lohse,et al.  A Comparison of Two Process Tracing Methods for Choice Tasks , 1996 .

[57]  Thorsten Pachur,et al.  Expert Intuitions: How to Model the Decision Strategies of Airport Customs Officers? ☆ , 2022 .

[58]  J. Rieskamp,et al.  SSL: a theory of how people learn to select strategies. , 2006, Journal of experimental psychology. General.

[59]  R. Hertwig,et al.  A lack of appetite for information and computation. Simple heuristics in food choice , 2013, Appetite.

[60]  A. Maule,et al.  A componential investigation of the relation between structural modelling and cognitive accounts of human judgement. , 1994, Acta psychologica.

[61]  Andreas Glöckner,et al.  Decisions beyond boundaries: when more information is processed faster than less. , 2012, Acta psychologica.

[62]  D. Goldstein,et al.  How good are simple heuristics , 1999 .

[63]  W. Gaissmaier,et al.  Sequential processing of cues in memory-based multiattribute decisions , 2007, Psychonomic bulletin & review.

[64]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.