Conditions for intuitive expertise: a failure to disagree.

This article reports on an effort to explore the differences between two approaches to intuition and expertise that are often viewed as conflicting: heuristics and biases (HB) and naturalistic decision making (NDM). Starting from the obvious fact that professional intuition is sometimes marvelous and sometimes flawed, the authors attempt to map the boundary conditions that separate true intuitive skill from overconfident and biased impressions. They conclude that evaluating the likely quality of an intuitive judgment requires an assessment of the predictability of the environment in which the judgment is made and of the individual's opportunity to learn the regularities of that environment. Subjective experience is not a reliable indicator of judgment accuracy.

[1]  Paul E. Meehl,et al.  Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence , 1996 .

[2]  Jerome S. Bruner,et al.  Contemporary approaches to cognition , 1958 .

[3]  S. Mednick The associative basis of the creative process. , 1962, Psychological review.

[4]  Lewis R. Goldberg,et al.  Man versus model of man: A rationale, plus some evidence, for a method of improving on clinical inferences. , 1970 .

[5]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[6]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[7]  P. Meehl Why I Do Not Attend Case Conferences , 1973 .

[8]  P. Meehl Psychodiagnosis: Selected Papers , 1973 .

[9]  W. Chase,et al.  Visual information processing. , 1974 .

[10]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[11]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[12]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[13]  A. D. D. Groot Thought and Choice in Chess , 1978 .

[14]  D. H. Peterson,et al.  Autobiography , 1985, Steroids.

[15]  J. Rassmusen,et al.  Information Processing and Human - Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[16]  Thomas H. Rockwell,et al.  Modeling Fault Diagnosis as the Activation and Use of a Frame System , 1986 .

[17]  Gary Klein,et al.  Rapid Decision Making on the Fire Ground , 1986 .

[18]  David Woods,et al.  Human factors challenges in process control: The case of nuclear power plants. , 1987 .

[19]  T. Pearson,et al.  Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  P. Slovic Perception of risk. , 1987, Science.

[21]  D. M. Georgoff,et al.  Harvard Business Review: David M. Georgoff and Robert G. Murdick, manager's guide to forecasting, 64 (Jan-Feb.) (1986) 110-120 , 1988 .

[22]  Herbert A. Simon,et al.  THE MIND'S EYE IN CHESS , 1988 .

[23]  N. Pennington,et al.  Back to the future: Temporal perspective in the explanation of events , 1989 .

[24]  Hylton Boothroyd Image Theory: Decision Making in Personal and Organizational Contexts. , 1990 .

[25]  M. Bazerman Judgment in Managerial Decision Making , 1990 .

[26]  Jim Q. Smith,et al.  Image Theory: Decision Making in Personal and Organizational Contexts. , 1991 .

[27]  J. Shanteau Competence in experts: The role of task characteristics , 1992 .

[28]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[29]  H. Simon,et al.  What is an “Explanation” of Behavior? , 1992 .

[30]  N. Sanders,et al.  Journal of behavioral decision making: "The need for contextual and technical knowledge in judgmental forecasting", 5 (1992) 39-52 , 1992 .

[31]  G. Klein,et al.  A recognition-primed decision (RPD) model of rapid decision making. , 1993 .

[32]  Raanan Lipshitz,et al.  Converging themes in the study of decision making in realistic settings. , 1993 .

[33]  B Crandall,et al.  Critical decision method: A technique for eliciting concrete assessment indicators from the intuition of NICU nurses , 1993, ANS. Advances in nursing science.

[34]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[35]  Henry Montgomery The search for a dominance structure in decision making: Examining the evidence. , 1993 .

[36]  T. Connolly,et al.  The reinvention of decision making. , 1993 .

[37]  Caroline E. Zsambok,et al.  Characteristics of Skilled Option Generation in Chess , 1995 .

[38]  D. Kahneman,et al.  Measures of Anchoring in Estimation Tasks , 1995 .

[39]  T. R. Stewart,et al.  The Importance of the Task in Analyzing Expert Judgment , 1997 .

[40]  Stanley C. Collyer,et al.  Tactical decision making under stress: History and overview. , 1998 .

[41]  Eduardo Salas,et al.  Making decisions under stress: Implications for individual and team training. , 1998 .

[42]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[43]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[44]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[45]  Gerd Gigerenzer,et al.  The recognition heuristic: How ignorance makes us smart , 1999 .

[46]  Ulrich Hoffrage,et al.  Quick estimation : Letting the environment do the work , 1999 .

[47]  Valerie L. Shalin,et al.  Cognitive task analysis , 2000 .

[48]  Kathleen L. Mosier,et al.  Accountability and automation bias , 2000, Int. J. Hum. Comput. Stud..

[49]  W. Grove,et al.  Clinical versus mechanical prediction: a meta-analysis. , 2000, Psychological assessment.

[50]  Cass R. Sunstein,et al.  Behavioral Law and Economics: Acknowledgments , 2000 .

[51]  F. Strack,et al.  The use of category and exemplar knowledge in the solution of anchoring tasks. , 2000, Journal of personality and social psychology.

[52]  Hal R. Arkes,et al.  Overconfidence in Judgmental Forecasting , 2001 .

[53]  J. Scott Armstrong,et al.  Principles of forecasting : a handbook for researchers and practitioners , 2001 .

[54]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[55]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[56]  Atul A. Gawande,et al.  Complications: A Surgeon's Notes on an Imperfect Science , 2002 .

[57]  D. Myers Intuition: Its Powers and Perils , 2002 .

[58]  Joseph G. Johnson,et al.  Take The First: Option-generation and resulting choices , 2003 .

[59]  J. Shanteau,et al.  Emerging Perspectives on Judgment and Decision Research: List of Contributors , 2003 .

[60]  Elizabeth S. Veinott,et al.  Hard decisions, bad decisions: On decision quality and decision aiding , 2003 .

[61]  S. Frederick Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .

[62]  T. Maclennan Moneyball: The Art of Winning an Unfair Game , 2005 .

[63]  P. Tetlock Expert Political Judgment: How Good Is It? How Can We Know? , 2005 .

[64]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[65]  S. Huffmon Expert Political Judgment: How Good Is It? How Can We Know? , 2006 .

[66]  S. Huffmon Expert Political Judgment: How Good Is It? How Can We Know? , 2006 .

[67]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[68]  K. A. Ericsson,et al.  The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance , 2006 .

[69]  P. Rosenzweig The halo effect : -- and the eight other business delusions that deceive managers , 2007 .

[70]  Chris Guthrie,et al.  Blinking on the Bench: How Judges Decide Cases , 2007 .

[71]  Jonathan Evans Hypothetical Thinking: Dual Processes in Reasoning and Judgement , 2007 .

[72]  Gary Klein,et al.  Performing a Project Premortem , 2008, IEEE Engineering Management Review.

[73]  R. Hogarth,et al.  Determinants of Linear Judgment: A Meta-Analysis of Lens Model Studies , 2007, Psychological bulletin.

[74]  Geoff Norman,et al.  Overconfidence in clinical decision making. , 2008, The American journal of medicine.

[75]  Chenjie Xia,et al.  How Doctors Think , 2008, McGill Journal of Medicine : MJM.

[76]  David F. Feldon,et al.  Cognitive task analysis , 2009 .

[77]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[78]  R Smith Halo Effect , 1988, Encyclopedia of Biometrics.

[79]  K. Jellinger,et al.  In two minds: Dual processes and beyond. , 2009 .