The Potential of Training to Increase Acceptance and Use of Computerized Decision Support Systems for Medical Diagnosis

Objective: The goals of this study were to understand the reasons underlying the limited use of medical decision-support tools and to explore the potential of a computerbased tutorial to mitigate barriers to use. Background: Medical decision-support tools such the Acute Cardiac Ischemia Time-Insensitive Predictive Instrument (ACITIPI) have demonstrated statistical validity and clinical impact for patient safety but have seen limited adoption and use. Methods: The study developed a brief Web-based “demystifying” ACI-TIPI tutorial employing case-based training and valuated the effectiveness of that tutorial in changing self-reported attitudes and behaviors. Results: Clinicians using the tutorial reported greater understanding of how to use the ACITIPI score appropriately and increased confidence in the score. Case studies in the tutorial that provided examples of how to use the score for actual cases were rated as especially helpful. Conclusion: This study suggests that a primary barrier to the use of statistical decision support tools for patient diagnosis is lack of training or experience in combining a population-based numerical risk score with other diagnostic information about the individual patient's case that is not considered in that score. The results of this study indicate that there is a potential for a relatively brief tutorial to increase acceptance and use of decision support tools for medical diagnosis. Application: These findings have the potential for the identification of methods to help clinicians learn how to use statistical and probabilistic information to better assess risk and to promote integration of decision support tools into medical decision making for improvement of patient safety.

[1]  R B D'Agostino,et al.  The usefulness of a predictive instrument to reduce inappropriate admissions to the coronary care unit. , 1980, Annals of internal medicine.

[2]  J. Lubsen,et al.  Acute coronary events in general practice: the Imminent Myocardial Infarction Rotterdam Study , 1978 .

[3]  Harry P. Selker,et al.  A Tool for Judging Coronary Care Unit Admission Appropriateness, Valid for Both Real-Time and Retrospective Use: A Time-Insensitive Predictive Instrument (TIPI) for Acute Cardiac Ischemia: A Multicenter Study , 1991, Medical care.

[4]  Wayne W. Zachary,et al.  Decision Support Systems: Designing to Extend the Cognitive Limits , 1988 .

[5]  Michael J Doyle,et al.  Malpractice claims against emergency physicians in Massachusetts: 1975-1993. , 1996, The American journal of emergency medicine.

[6]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[7]  C. R. Christensen,et al.  Teaching and the case method , 1987 .

[8]  W. Baxt,et al.  Prospective validation of artificial neural network trained to identify acute myocardial infarction , 1996, The Lancet.

[9]  E S Berner,et al.  Influence of case and physician characteristics on perceptions of decision support systems. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[10]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[11]  E F Cook,et al.  A computer protocol to predict myocardial infarction in emergency department patients with chest pain. , 1988, The New England journal of medicine.

[12]  Ralph L. Rosnow,et al.  Essentials of Behavioral Research: Methods and Data Analysis , 1984 .

[13]  Harry P. Selker,et al.  Identifying Acute Cardiac Ischemia in the Emergency Department , 1999 .

[14]  R B D'Agostino,et al.  A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. , 1984, The New England journal of medicine.

[15]  H P Selker,et al.  How Did the Acute Ischemic Heart Disease Predictiue Instrument Reduce Unnecessary Coronary Care Unit Admissions? , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[16]  W M Tierney,et al.  Physicians' Estimates of the Probability of Myocardial Infarction in Emergency Boom Patients with chest Pain , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[18]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[19]  Malcolm P. McNair,et al.  The case method at the Harvard Business School : papers by present and past members of the faculty and staff , 1954 .

[20]  Michael W. Pozen,et al.  Optimal Identification of the Patient with Acute Myocardial Ischemia in the Emergency Room , 1985 .

[21]  R. Parasuraman,et al.  Trust as a Construct for Evaluation of Automated Aids: Past and Future Theory and Research , 1999 .

[22]  D. Spiegelhalter,et al.  Field trials of medical decision-aids: potential problems and solutions. , 1991, Proceedings. Symposium on Computer Applications in Medical Care.

[23]  J P Ornato,et al.  Use of the Acute Cardiac Ischemia Time-Insensitive Predictive Instrument (ACI-TIPI) To Assist with Triage of Patients with Chest Pain or Other Symptoms Suggestive of Acute Cardiac Ischemia: A Multicenter, Controlled Clinical Trial , 1998, Annals of Internal Medicine.