The Effectiveness of Cognitive Forcing Strategies to Decrease Diagnostic Error: An Exploratory Study

Background: Cognitive forcing strategies, a form of metacognition, have been advocated as a strategy to prevent diagnostic error. Increasingly, curricula are being implemented in medical training to address this error. Yet there is no experimental evidence that these curricula are effective. Description: This was an exploratory, prospective study using consecutive enrollment of 56 senior medical students during their emergency medicine rotation. Students received interactive, standardized cognitive forcing strategy training. Evaluation: Using a cross-over design to assess transfer between similar (to instructional cases) and novel diagnostic cases, students were evaluated on 6 test cases. Forty-seven students were immediately tested and 9 were tested 2 weeks later. Data were analyzed using descriptive statistics and a McNemar chi-square test. Conclusions: This is the first study to explore the impact of cognitive forcing strategy training on diagnostic error. Our preliminary findings suggest that application and retention is poor. Further large studies are required to determine if transfer across diagnostic formats occurs.

[1]  D. Kahneman,et al.  Conditions for intuitive expertise: a failure to disagree. , 2009, The American psychologist.

[2]  E. Berner,et al.  Overconfidence as a cause of diagnostic error in medicine. , 2008, The American journal of medicine.

[3]  Jonathan Evans.  Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[4]  P. Croskerry,et al.  Critical thinking and decisionmaking: avoiding the perils of thin-slicing. , 2006, Annals of emergency medicine.

[5]  Thomas Gilovich,et al.  Critical Thinking in Psychology: Informal Logical Fallacies , 2006 .

[6]  Henry L. Roediger,et al.  Critical thinking in psychology , 2006 .

[7]  E. Thomas,et al.  Understanding diagnostic errors in medicine: a lesson from aviation , 2006, Quality and Safety in Health Care.

[8]  K. Eva,et al.  The difficulty with experience: Does practice increase susceptibility to premature closure? , 2006, The Journal of continuing education in the health professions.

[9]  Kevin W Eva,et al.  Heuristics and biases − a biased perspective on clinical reasoning , 2005, Medical education.

[10]  N. Franklin,et al.  Diagnostic error in internal medicine. , 2005, Archives of internal medicine.

[11]  D. Derauf,et al.  Cognitive psychology of missed diagnoses. , 2005, Annals of internal medicine.

[12]  S. Sheps,et al.  The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada , 2004, Canadian Medical Association Journal.

[13]  M. Graber,et al.  Metacognitive Training to Reduce Diagnostic Errors: Ready for Prime Time? , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[14]  P. Croskerry.  The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[15]  Robyn Tamblyn,et al.  Association between licensure examination scores and practice in primary care. , 2002, JAMA.

[16]  Eric Schneider,et al.  Views of practicing physicians and the public on medical errors. , 2002, The New England journal of medicine.

[17]  A. Elstein,et al.  Clinical problem solving and diagnostic decision making: selective review of the cognitive literature , 2002, BMJ : British Medical Journal.

[18]  K. Hall.  Reviewing intuitive decision‐making and uncertainty: the implications for medical education , 2002, Medical education.

[19]  K S Berbaum,et al.  Satisfaction of search in osteoradiology. , 2001, AJR. American journal of roentgenology.

[20]  P Croskerry,et al.  Setting the educational agenda and curriculum for error prevention in emergency medicine. , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[21]  A. Terranova,et al.  Clinical errors in emergency medicine: experience at the emergency department of an Italian teaching hospital. , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[22]  T. Brennan,et al.  Incidence and types of adverse events and negligent care in Utah and Colorado. , 2000, Medical care.

[23]  G R Norman,et al.  Exploring the etiology of content specificity: factors influencing analogic transfer and problem solving. , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[24]  R. Popp,et al.  The relevance to clinical practice of the certifying examination in internal medicine , 1993, Journal of General Internal Medicine.

[25]  T. Brennan,et al.  The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. , 1991, The New England journal of medicine.

[26]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[27]  Donald A Redelmeier,et al.  Improving patient care. The cognitive psychology of missed diagnoses. , 2005, Annals of internal medicine.

[28]  Pat Croskerry,et al.  Cognitive forcing strategies in clinical decisionmaking. , 2003, Annals of emergency medicine.

[29]  P. Maurette,et al.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[30]  A. Elstein,et al.  Heuristics and biases: selected errors in clinical reasoning. , 1999, Academic medicine : journal of the Association of American Medical Colleges.