On Heuristic and Linear Models of Judgment: Mapping the Demand for Knowledge

Research on judgment and decision making presents a confusing picture of human abilities. For example, much research has emphasized the dysfunctional aspects of judgmental heuristics, and yet, other findings suggest that these can be highly effective. A further line of research has modeled judgment as resulting from “as if” linear models. This paper illuminates the distinctions in these approaches by providing a common analytical framework based on the central theoretical premise that understanding human performance requires specifying how characteristics of the decision rules people use interact with the demands of the tasks they face. Our work synthesizes the analytical tools of “lens model” research with novel methodology developed to specify the effectiveness of heuristics in different environments and allows direct comparisons between the different approaches. We illustrate with both theoretical analyses and simulations. We further link our results to the empirical literature by a meta-analysis of lens model studies and estimate both human and heuristic performance in the same tasks. Our results highlight the trade-off between linear models and heuristics. Whereas the former are cognitively demanding, the latter are simple to use. However, they require knowledge – and thus “maps” – of when and which heuristic to employ.

[1]  K. R. Hammond,et al.  COGNITIVE DEPENDENCE ON LINEAR AND NONLINEAR CUES. , 1965, Psychological review.

[2]  P M Todd,et al.  Précis of Simple heuristics that make us smart , 2000, Behavioral and Brain Sciences.

[3]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[4]  K. R. Hammond,et al.  ANALYZING THE COMPONENTS OF CLINICAL INFERENCE. , 1964, Psychological review.

[5]  Robin M. Hogarth,et al.  Ignoring information in binary choice with continuous variables: When is less “more”? , 2005 .

[6]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[7]  Derick O. Steinmann Transfer of lens model training , 1974 .

[8]  R. Ashton A Descriptive Study Of Information Evaluation , 1981 .

[9]  B. Brehmer,et al.  Human judgment : the SJT view , 1988 .

[10]  K. R. Hammond,et al.  A research paradigm for the study of interpersonal learning. , 1966, Psychological bulletin.

[11]  Robin M. Hogarth,et al.  Take-the-Best and Other Simple Strategies: Why and When They Work Well in Binary Choice , 2004 .

[12]  L. Ross The Intuitive Psychologist And His Shortcomings: Distortions in the Attribution Process1 , 1977 .

[13]  Juan A. Carrasco,et al.  Cumulative dominance and heuristic performance in binary multi-attribute choice , 2006 .

[14]  Berndt Brehmer,et al.  Use of experts in complex decision making: A paradigm for the study of staff work , 1986 .

[15]  H. A. Wallace,et al.  What is in the Corn Judge's Mind?1 , 1923 .

[16]  K. R. Hammond Probabilistic functioning and the clinical method. , 1955, Psychological review.

[17]  Kenneth M. York,et al.  The influence of cue unreliability on judgment in a multiple cue probability learning task , 1987 .

[18]  R. Hogarth,et al.  Unit weighting schemes for decision making , 1975 .

[19]  B. Newell,et al.  Empirical tests of a fast-and-frugal heuristic: Not everyone "takes-the-best" , 2003 .

[20]  Robin M. Hogarth,et al.  Regions of Rationality: Maps for Bounded Agents , 2005, Decis. Anal..

[21]  Kenneth R. Hammond,et al.  Human Judgment and Social Policy: Irreducible Uncertainty, Inevitable Error, Unavoidable Injustice , 2000 .

[22]  P. Todd,et al.  Escaping the tyranny of choice: when fewer attributes make choice easier , 2007 .

[23]  L. Ross,et al.  The intuitive psychologist and his shortcomings: Distortions in the attribution process”, in Ed), Advances in Experimental Social New York, pp. . , 1977 .

[24]  Kenneth R. Hammond,et al.  Negative effects of outcome-feedback in multiple-cue probability learning. , 1973 .

[25]  Michael K. Lindell Cognitive and Outcome Feedback in Multiple-Cue Probability Learning Tasks. , 1976 .

[26]  H. J. Einhorn,et al.  Accepting error to make less error. , 1986, Journal of personality assessment.

[27]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  F. Hansford-Miller 13. Judgement and Choice: The Psychology of Decision , 1988 .

[29]  R. Ashton,et al.  Feedback And Prediction Achievement In Financial Analysis , 1981 .

[30]  Derick O. Steinmann,et al.  A lens model analysis of a bookbag and poker chip experiment: A methodological note , 1972 .

[31]  Reid Hastie,et al.  The robust beauty of majority rules in group decisions. , 2005, Psychological review.

[32]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[33]  B. Armelius,et al.  The use of redundancy in multiple-cue judgments: Data from a suppressor-variable task. , 1974 .

[34]  Paul E. Meehl,et al.  Clinical versus Statistical Prediction. , 1955 .

[35]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[36]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[37]  R. Hogarth,et al.  Determinants of Linear Judgment: A Meta-Analysis of Lens Model Studies , 2007, Psychological bulletin.

[38]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[39]  T. R. Stewart,et al.  The Importance of the Task in Analyzing Expert Judgment , 1997 .

[40]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .

[41]  M. F. Luce,et al.  Emotional Trade-Off Difficulty and Choice: , 1999 .

[42]  T. R. Stewart,et al.  Aging and multiple cue probability learning: the case of inverse relationships. , 1997, Acta psychologica.

[43]  Magnus Persson,et al.  PROBabilities from EXemplars (PROBEX): a "lazy" algorithm for probabilistic inference from generic knowledge , 2002, Cogn. Sci..

[44]  R. Hogarth,et al.  Learning from feedback: exactingness and incentives. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[45]  P. Meehl,et al.  Clinical versus Statistical Prediction. , 1955 .

[46]  A. Bröder Decision making with the "adaptive toolbox": influence of environmental structure, intelligence, and working memory load. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[47]  E. Mullet,et al.  Functional learning among children, adolescents, and young adults. , 2004, Journal of experimental child psychology.

[48]  James Shanteau,et al.  Fast and frugal heuristics: What about unfriendly environments? , 2000 .

[49]  Juan A. Carrasco,et al.  Cumulative Dominance and Heuristic Performance in Binary Multiattribute Choice , 2008, Oper. Res..

[50]  K. R. Hammond Functionalism and illusionism: Can integration be usefully achieved? , 1990 .

[51]  Robin M. Hogarth,et al.  Simple Models for Multiattribute Choice with Many Alternatives: When It Does and Does Not Pay to Face Trade-offs with Binary Attributes , 2005, Manag. Sci..

[52]  R. Tweney,et al.  The Role of Data and Feedback Error in Inference and Prediction , 1998 .

[53]  J. Edward Russo,et al.  Winning Decisions: Getting It Right the First Time , 2001 .

[54]  Paul Slovic,et al.  Multidimensional functional learning (MFL) and some new conceptions of feedback , 1981 .

[55]  J. Frank Yates,et al.  How Quantity Judgment Changes as the Number of Cues Increases: An Analytical Framework and Review , 1992 .

[56]  H. J. Einhorn,et al.  Linear regression and process-tracing models of judgment. , 1979 .

[57]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[58]  T. R. Stewart,et al.  The essential brunswik: Beginnings, explications, applications. , 2001 .

[59]  Paul Slovic,et al.  The affect heuristic , 2007, Eur. J. Oper. Res..

[60]  N. Anderson Foundations of information integration theory , 1981 .

[61]  Colin F. Camerer,et al.  General conditions for the success of bootstrapping models , 1981 .

[62]  Gerd Gigerenzer,et al.  Models of ecological rationality: the recognition heuristic. , 2002, Psychological review.

[63]  Hillel J. Einhorn,et al.  Expert measurement and mechanical combination , 1972 .

[64]  Ulrich Hoffrage,et al.  Why does one-reason decision making work? A case study in ecological rationality , 1999 .

[65]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[66]  S. Epstein Integration of the cognitive and the psychodynamic unconscious. , 1994, The American psychologist.

[67]  W. Thorngate Efficient decision heuristics. , 1980 .

[68]  U. Hoffrage,et al.  Fast, frugal, and fit: Simple heuristics for paired comparison , 2002 .

[69]  P. Hoffman The paramorphic representation of clinical judgment. , 1960, Psychological bulletin.

[70]  R. Youmans,et al.  To thy own self be true: finding the utility of cognitive information feedback , 2005 .

[71]  Jordan J. Louviere,et al.  Analyzing Decision Making: Metric Conjoint Analysis , 1988 .

[72]  L. Tucker A SUGGESTED ALTERNATIVE FORMULATION IN THE DEVELOPMENTS BY HURSCH, HAMMOND, AND HURSCH, AND BY HAMMOND, HURSCH, AND TODD. , 1964, Psychological review.

[73]  Natalia Karelaia,et al.  Thirst for confirmation in multi-attribute choice: Does search for consistency impair decision performance? , 2006 .

[74]  Lewis R. Goldberg,et al.  Man versus model of man: A rationale, plus some evidence, for a method of improving on clinical inferences. , 1970 .

[75]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[76]  G. Gigerenzer On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky (1996) , 1996 .

[77]  Donald H. Deane,et al.  Acquisition and application of knowledge in complex inference tasks. , 1972 .

[78]  E. Brunswik,et al.  The Conceptual Framework of Psychology , 1954 .

[79]  Ray W. Cooksey,et al.  Judgment analysis : theory, methods, and applications , 1996 .

[80]  S. Chaiken,et al.  Dual-process theories in social psychology , 1999 .

[81]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[82]  Keith E. Stanovich,et al.  Individual differences in rational thought. , 1998 .

[83]  Konstantinos V. Katsikopoulos,et al.  Naïve heuristics for paired comparisons: Some results on their relative accuracy , 2006 .

[84]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[85]  A. Bröder Assessing the empirical validity of the "take-the-best" heuristic as a model of human probabilistic inference. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[86]  B Kleinmuntz,et al.  Why we still use our heads instead of formulas: toward an integrative approach. , 1990, Psychological bulletin.

[87]  Ulrich Hoffrage,et al.  When do people use simple heuristics, and how can we tell? , 1999 .

[88]  Rita C. Summers,et al.  Judgments Based on Different Functional Relationships between Interacting Cues and a Criterion , 1969 .

[89]  K. Rudestam,et al.  Effects of Amounts and Units of Information on the Judgmental Process , 1976 .

[90]  Robin M. Hogarth,et al.  "Take-the-best" and other simple strategies: Why and when they work "well" with binary cues , 2006 .

[91]  B. Brehmer The psychology of linear judgement models , 1994 .

[92]  P. Slovic,et al.  The affect heuristic , 2007, European Journal of Operational Research.

[93]  P. Muchinsky,et al.  Human inference behavior in abstract and meaningful environments , 1975 .

[94]  A. Bröder,et al.  Take the best versus simultaneous feature matching: probabilistic inferences from memory and effects of representation format. , 2003, Journal of experimental psychology. General.

[95]  Mandeep K. Dhami,et al.  The role of representative design in an ecological approach to cognition. , 2004, Psychological bulletin.

[96]  Howard Wainer,et al.  Estimating Coefficients in Linear Models: It Don't Make No Nevermind , 1976 .

[97]  H. Rothstein The effects of time pressure on judgment in multiple cue probability learning , 1986 .

[98]  E. Mullet,et al.  How well do elderly people cope with uncertainty in a learning task? , 1999, Acta psychologica.

[99]  D Kahneman,et al.  On the reality of cognitive illusions. , 1996, Psychological review.

[100]  B. Newell,et al.  Take the best or look at the rest? Factors influencing "one-reason" decision making. , 2003, Journal of experimental psychology. Learning, memory, and cognition.