Disrupting diagnostic reasoning: do interruptions, instructions, and experience affect the diagnostic accuracy and response time of residents and emergency physicians?

Purpose Others have suggested that increased time pressure, sometimes caused by interruptions, may result in increased diagnostic errors. The authors previously found, however, that increased time pressure alone does not result in increased errors, but they did not test the effect of interruptions. It is unclear whether experience modulates the combined effects of time pressure and interruptions. This study investigated whether increased time pressure, interruptions, and experience level affect diagnostic accuracy and response time. Method In October 2012, 152 residents were recruited at five Medical Council of Canada Qualifying Examination Part II test sites. Forty-six emergency physicians were recruited from one Canadian and one U.S. academic health center. Participants diagnosed 20 written general medicine cases. They were randomly assigned to receive fast (time pressure) or slow condition instructions. Visual and auditory case interruptions were manipulated as a within-subject factor. Results Diagnostic accuracy was not affected by interruptions or time pressure but was related to experience level: Emergency physicians were more accurate (71%) than residents (43%) (F = 234.0, P < .0001) and responded more quickly (54 seconds) than residents (65 seconds) (F = 9.0, P < .005). Response time was shorter for participants in the fast condition (55 seconds) than in the slow condition (73 seconds) (F = 22.2, P < .0001). Interruptions added about 8 seconds to response time. Conclusions Experienced emergency physicians were both faster and more accurate than residents. Instructions to proceed quickly and interruptions had a small effect on response time but no effect on accuracy.

[1]  Kevin W Eva,et al.  Comparing Diagnostic Performance and the Utility of Clinical Vignette-Based Assessment Under Testing Conditions Designed to Encourage Either Automatic or Analytic Thought , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[2]  P. Croskerry The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[3]  N. Franklin,et al.  Diagnostic error in internal medicine. , 2005, Archives of internal medicine.

[4]  G. D. Logan Task Switching , 2022 .

[5]  Valerie F Reyna,et al.  Clinical gist and medical education: connecting the dots. , 2009, JAMA.

[6]  Cordula Wagner,et al.  Relating Faults in Diagnostic Reasoning With Diagnostic Errors and Patient Harm , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[7]  S. Durning,et al.  Authenticity of instruction and student performance: a prospective randomised trial , 2011, Medical education.

[8]  Nancy F. Lenfestey,et al.  Cognitive interventions to reduce diagnostic error: a narrative review , 2012, BMJ quality & safety.

[9]  V. Reyna CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE How People Make Decisions That Involve Risk A Dual-Processes Approach , 2022 .

[10]  Jonathan Sherbino,et al.  Ineffectiveness of cognitive forcing strategies to reduce biases in diagnostic reasoning: a controlled trial. , 2014, CJEM.

[11]  C. Chisholm,et al.  A task analysis of emergency physician activities in academic and community settings. , 2011, Annals of emergency medicine.

[12]  M. Graber The incidence of diagnostic error in medicine , 2013, BMJ quality & safety.

[13]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[14]  M. Eccles,et al.  Improving patient care , 2013 .

[15]  Kevin W Eva,et al.  The Aging Physician: Changes in Cognitive Processing and Their Impact on Medical Practice , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[16]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[17]  Jonathan Sherbino,et al.  The Etiology of Diagnostic Errors: A Controlled Trial of System 1 Versus System 2 Reasoning , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[18]  A. Elstein,et al.  Clinical problem solving and diagnostic decision making: selective review of the cognitive literature , 2002, BMJ : British Medical Journal.

[19]  D. Derauf,et al.  Cognitive psychology of missed diagnoses. , 2005, Annals of internal medicine.

[20]  S. Mamede,et al.  Effects of reflective practice on the accuracy of medical diagnoses , 2008, Medical education.

[21]  K. Stanovich,et al.  On the relative independence of thinking biases and cognitive ability. , 2008, Journal of personality and social psychology.

[22]  Donald A Redelmeier,et al.  Improving patient care. The cognitive psychology of missed diagnoses. , 2005, Annals of internal medicine.

[23]  G. Norman,et al.  The Effectiveness of Cognitive Forcing Strategies to Decrease Diagnostic Error: An Exploratory Study , 2011, Teaching and learning in medicine.

[24]  Rose Hatala,et al.  Assessing cardiac physical examination skills using simulation technology and real patients: a comparison study , 2008, Medical education.

[25]  W H Cordell,et al.  Work interrupted: a comparison of workplace interruptions in emergency departments and primary care offices. , 2001, Annals of emergency medicine.

[26]  Timothy J. Wood,et al.  The Relationship Between Response Time and Diagnostic Accuracy , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[27]  Jonathan Evans Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[28]  Pat Croskerry,et al.  Clinical cognition and diagnostic error: applications of a dual process model of reasoning , 2009, Advances in health sciences education : theory and practice.

[29]  W. Dunsmuir,et al.  The impact of interruptions on clinical task completion , 2010, Quality and Safety in Health Care.

[30]  S. Monsell Task-set reconfiguration processes do not imply a control homunuculus: Reply to Altmann , 2003, Trends in Cognitive Sciences.

[31]  K. Eva,et al.  Swapping Horses Midstream: Factors Related to Physicians' Changing Their Minds About a Diagnosis , 2010, Academic medicine : journal of the Association of American Medical Colleges.