Focus Article: Taking Stock of Naturalistic Decision Making

We review the progress of naturalistic decision making (NDM) in the decade since the ®rst conference on the subject in 1989. After setting out a brief history of NDM we identify its essential characteristics and consider ®ve of its main contributions: recognition primed decisions, coping with uncertainty, team decision making, decision errors, and methodology. NDM helped identify important areas of inquiry previously neglected (e.g. the use of expertise in sizing up situations and generating options), it introduced new models, conceptualizations, and methods, and recruited applied investigators into the ®eld. Above all, NDM contributed a new perspective on how decisions (broadly de®ned as committing oneself to a certain course of action) are made. NDM still faces signi®cant challenges, including improvement of the quantity and rigor of its empirical research, and con®rming the validity of its prescriptive models. The study of decision making is studded by three-letter acronyms designating sub-disciplines which evolved partly as extensions of preceding sub-disciplines, and partly as a reaction to them: the once-popular CDM emergence of each sub-discipline can be conveniently traced to the publication of books or papers signifying the time at which theory and research pursued more or less in isolation gathered suf®cient mass and coherence to attract wider attention.

[1]  L. G. White,et al.  Administrative Behavior , 2019, Managing Development in the Third World.

[2]  David Woods,et al.  Operating at the Sharp End: The Complexity of Human Error , 2018 .

[3]  E. Salas,et al.  Stress and naturalistic decision making: Strengthening the weak links , 2017 .

[4]  J. Schreiber Foundations Of Statistics , 2016 .

[5]  Gary Klein,et al.  Naturalistic Decision Making Perspectives on Decision Errors , 2014 .

[6]  Caroline E. Zsambok,et al.  Naturalistic Decision Making: Where Are We Now? , 2014 .

[7]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[8]  Steven Pinker,et al.  The mystery of consciousness. , 2007, Time.

[9]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[10]  D. Read Judgment and Choice , 2005 .

[11]  E. Salas,et al.  Taking stock of naturalistic decision making , 2001 .

[12]  D. Hantula Sources of Power: How People Make Decisions , 2001 .

[13]  Ethné Swartz Decision Making Under Stress: Emerging Themes and Applications , 2000 .

[14]  D. Woods Perspectives on Human Error: Hindsight Biases and Local Rationality , 2000 .

[15]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[16]  Ute Fischer,et al.  How do Flight Crews Detect and Prevent Errors? Findings from a Flight Simulation Study , 1998 .

[17]  Florian Jentsch,et al.  Evidence for the Validity of PC-based Simulations in Studying Aircrew Coordination , 1998 .

[18]  Eduardo Salas,et al.  Making decisions under stress: Implications for individual and team training. , 1998 .

[19]  Stanley C. Collyer,et al.  Tactical decision making under stress: History and overview. , 1998 .

[20]  Jared Freeman,et al.  Critical thinking skills in tactical decision making: A model and a training strategy. , 1998 .

[21]  Eduardo Salas,et al.  Broadening the Measurement of Situation Awareness through Cognitive Engineering Methods , 1997 .

[22]  E. Salas,et al.  A Framework for Developing Team Performance Measures in Training , 1997 .

[23]  R. Lipshitz,et al.  Coping with Uncertainty: A Naturalistic Decision-Making Analysis , 1997 .

[24]  M. Endsley The role of situation awareness in naturalistic decision making , 1997 .

[25]  Herbert H. Bell,et al.  4 Situation Assessment and Decision Making in Skilled Fighter Pilots , 1997 .

[26]  E. Salas,et al.  How can you turn a team of experts into an expert team?: Emerging Training Strategies , 1997 .

[27]  Rhona H. Flin Sitting in the Hot Seat: Leaders and Teams for Critical Incident Management , 1996 .

[28]  Marvin S. Cohen,et al.  Metarecognition in Time-Stressed Decision Making: Recognizing, Critiquing, and Correcting , 1996, Hum. Factors.

[29]  Decision-Making in Two Worlds , 1996 .

[30]  Paul E. Spector,et al.  The Impact of Cross-Training on Team Functioning: An Empirical Investigation , 1996, Hum. Factors.

[31]  Jens Rasmussen,et al.  Merging paradigms: Decision Making, Management, and Cognitive Control , 1996 .

[32]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[33]  N. Shadbolt,et al.  Eliciting Knowledge from Experts: A Methodological Analysis , 1995 .

[34]  Caroline E. Zsambok,et al.  Characteristics of Skilled Option Generation in Chess , 1995 .

[35]  Eduardo Salas,et al.  Situation Awareness in Team Performance: Implications for Measurement and Training , 1995, Hum. Factors.

[36]  Nadine B. Sarter,et al.  How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control , 1995, Hum. Factors.

[37]  Z. Shapira Risk Taking: A Managerial Perspective , 1995 .

[38]  E. Hutchins Cognition in the wild , 1995 .

[39]  Raanan Lipshitz,et al.  Decision Making in Three Modes , 1994 .

[40]  Ute Fischer,et al.  Decision Errors in the Cockpit , 1993 .

[41]  B Crandall,et al.  Critical decision method: A technique for eliciting concrete assessment indicators from the intuition of NICU nurses , 1993, ANS. Advances in nursing science.

[42]  L. Beach Broadening the Definition of Decision Making: The Role of Prechoice Screening of Options , 1993 .

[43]  W. Firestone Alternative Arguments for Generalizing From Data as Applied to Qualitative Research , 1993 .

[44]  G. Klein,et al.  A recognition-primed decision (RPD) model of rapid decision making. , 1993 .

[45]  T. Connolly,et al.  The reinvention of decision making. , 1993 .

[46]  E. Salas,et al.  Team decision making in complex environments. , 1993 .

[47]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[48]  Raanan Lipshitz,et al.  Converging themes in the study of decision making in realistic settings. , 1993 .

[49]  E. Salas,et al.  Games teams play: A method for investigating team coordination and performance , 1992 .

[50]  E M Roth,et al.  Cognitive simulation as a tool for cognitive task analysis. , 1992, Ergonomics.

[51]  J. Shanteue COMPETENCE IN EXPERTS: THE ROLE OF TASK CHARACTERISTICS , 1992 .

[52]  Organizations , 1992, Restoration & Management Notes.

[53]  David G. Mathiasen Groups that work (and those that Don't): Creating Conditions for Effective Teamwork, edited by J. Richard Hackman. San Francisco, CA: Jossey-Bass 1990, 512 pp. Price: $39.95 cloth , 1991 .

[54]  E. Mishler Validation in Inquiry-Guided Research: The Role of Exemplars in Narrative Studies , 1990 .

[55]  H. Boothroyd Image Theory: Decision Making in Personal and Organizational Contexts. , 1990 .

[56]  K. Howe,et al.  Standards for Qualitative (and Quantitative) Research: A Prolegomenon , 1990 .

[57]  Barbara G. Kanki,et al.  Personality factors in flight operations. Volume 1: Leader characteristics and crew performance in a full-mission air transport simulation , 1990 .

[58]  J.W. Payne,et al.  Understanding contingent choice: a computer simulation approach , 1990, IEEE Trans. Syst. Man Cybern..

[59]  J. Reason Human Error , 1990 .

[60]  J. E. Russo,et al.  Decision traps : ten barriers to brilliant decision-making and how to overcome them , 1989 .

[61]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[62]  H. Montgomery From cognition to action: The search for dominance in decision making. , 1989 .

[63]  Herbert W. Simons,et al.  Rhetoric in the human sciences , 1989 .

[64]  Kenneth R Hammond,et al.  Judgement and Decision Making in Dynamic Tasks , 1988 .

[65]  Sarah Lichtenstein,et al.  Islanders and hostages: Deep and surface structures of decision problems☆ , 1988 .

[66]  Gary Klein,et al.  Time Pressure, Skill, and Move Quality in Chess , 1988 .

[67]  J. Kagan,et al.  Rational choice in an uncertain world , 1988 .

[68]  D. Funder,et al.  Errors and mistakes: evaluating the accuracy of social judgment. , 1987, Psychological bulletin.

[69]  R. Hogarth,et al.  Decision Making under Ambiguity , 1986 .

[70]  Vimla L. Patel,et al.  Knowledge Based Solution Strategies in Medical Reasoning , 1986, Cogn. Sci..

[71]  Dina Berkeley,et al.  Handling Uncertainty Levels of Analysis of Decision Problems , 1985 .

[72]  H. Simon,et al.  Protocol Analysis: Verbal Reports as Data , 1986 .

[73]  H. Foushee,et al.  Dyads and triads at 35,000 feet: Factors affecting group process and aircrew performance , 1984 .

[74]  A. Grandori A Prescriptive Contingency View of Organizational Decision Making. , 1984 .

[75]  James G. March,et al.  Theories of choice and making decisions , 1982 .

[76]  B. Fischhoff,et al.  Judgment under uncertainty: Debiasing , 1982 .

[77]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[78]  Dorothea P. Simon,et al.  Expert and Novice Performance in Solving Physics Problems , 1980, Science.

[79]  A. D. D. Groot Thought and Choice in Chess , 1978 .

[80]  L. Beach,et al.  A Contingency Model for the Selection of Decision Strategies , 1978 .

[81]  H. Simon,et al.  Rationality as Process and as Product of Thought , 1978 .

[82]  I. Janis,et al.  Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment , 1977 .

[83]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[84]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[85]  A. K. Basu A Theory of Decision-Making , 1973, The Journal of Sociology & Social Welfare.

[86]  A. Tversky Elimination by aspects: A theory of choice. , 1972 .

[87]  C. H. Coombs,et al.  Mathematical psychology : an elementary introduction , 1970 .

[88]  Ma. de la Natividad Jiménez Salas,et al.  The Conduct of Inquiry , 1967 .

[89]  Paul E. Meehl,et al.  Clinical vs. Statistical Prediction. , 1955 .

[90]  J. C. Flanagan Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[91]  D. Bernoulli Exposition of a New Theory on the Measurement of Risk , 1954 .

[92]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[93]  J. Dewey,et al.  How We Think , 2009 .