Evaluating the effectiveness of the PreMortem technique on plan confidence

One problem affecting crisis management planning teams is overconfidence– an inflated belief that a plan will be successful. In this paper we compared the effect of several different methods for reducing individual team member confidence levels and compared each to a baseline control condition. One hundred and seventy-eight people participated in one of five conditions to evaluate an H1N1 flu epidemic plan in a university context. Over the course of evaluating the plan, participants provided several ratings of confidence in the plan’s success and their understanding. We compared several techniques commonly used, such as critique, Pro/Cons generation, Cons only generation and a newer technique, PreMortem, to a baseline condition. The Pro/Cons generation, Cons only generation and the PreMortem technique all reliably reduced confidence levels more than baseline condition. Furthermore, the Premortem method, imagining that a plan has failed and then generating reasons to explain why, reliably reduced confidence more than each of the other conditions, and therefore can be a useful tool for combating overconfidence in crisis management planning. We discuss the results in the context of sensemaking and decision making theory.

[1]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[2]  Derek J. Koehler,et al.  Explanation, imagination, and confidence in judgment. , 1991, Psychological bulletin.

[3]  Zeno Franco,et al.  The dirty dozen: twelve failures of the hurricane katrina response and how psychology can help. , 2007, American Psychologist.

[4]  Jennifer K. Phillips,et al.  A Data–Frame Theory of Sensemaking , 2007 .

[5]  Nuno Correia,et al.  Life-saver: Flood emergency simulator , 2008 .

[6]  Gary Klein,et al.  Performing a Project Premortem , 2008, IEEE Engineering Management Review.

[7]  Niklas Hallberg,et al.  Evaluation of Crisis Management Operations using Reconstruction and Exploration , 2008 .

[8]  Jack B. Soll,et al.  Overconfidence: It Depends on How, What, and Whom You Ask. , 1999, Organizational behavior and human decision processes.

[9]  Ola Leifler Combining Technical and Human-Centered Strategies for Decision Support in Command and Control - The ComPlan Approach , 2008 .

[10]  Starr Roxanne Hiltz,et al.  Emergency Planning as a Continuous Game , 2006 .

[11]  R. A. Cosier The effects of three potential aids for making strategic decisions on prediction accuracy , 1978 .

[12]  N. Pennington,et al.  Back to the future: Temporal perspective in the explanation of events , 1989 .

[13]  Albert-László Barabási,et al.  WIPER: A Multi-Agent System for Emergency Response , 2006 .

[14]  R. Buehler,et al.  Exploring the "planning fallacy": Why people underestimate their task completion times. , 1994 .

[15]  Pierre Wack,et al.  Scenarios : Uncharted Waters Ahead , 1996 .

[16]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .