Effects of a decision support system on physicians' diagnostic performance.

PURPOSE This study examines how the information provided by a diagnostic decision support system for clinical cases of varying diagnostic difficulty affects physicians' diagnostic performance. METHODS A national sample of 67 internists, 35 family physicians, and 6 other physicians used the Quick Medical Reference (QMR) diagnostic decision support system to assist them in the diagnosis of written clinical cases. Three sets of eight cases, stratified by diagnostic difficulty and the potential of QMR to produce high-quality information, were used. The effects of using QMR on three measures of physicians' diagnostic performance were analyzed using analyses of variance. RESULTS Physicians' diagnostic performance was significantly higher (p < 0.01) on the easier cases and the cases for which QMR could provide higher-quality information. CONCLUSIONS Physicians' diagnostic performance can be strongly influenced by the quality of information the system produces and the type of cases on which the system is used.

[1]  J S O'Shea,et al.  Computer-assisted pediatric diagnosis. , 1975, American journal of diseases of children.

[2]  R A Bankowitz,et al.  A Method for Assessing the Impact of a Computer-Based Decision Support System on Health Care Outcomes , 1992, Methods of Information in Medicine.

[3]  W W Tunnessen,et al.  Computer-assisted diagnosis in pediatrics. , 1974, American journal of diseases of children.

[4]  O Bouhaddou,et al.  Iliad and Medical HouseCall: evaluating the impact of common sense knowledge on the diagnostic accuracy of a medical expert system. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[5]  Eric Horvitz,et al.  Probabilistic Diagnosis Using a Reformulation of the INTERNIST-1/QMR Knowledge Base Part II , 2016 .

[6]  Harry E. Pople,et al.  An Experimental Computer-Based Diagnostic Consultant for General Internal Medicine , 1982 .

[7]  H L Bleich,et al.  Computer evaluation of acid-base disorders. , 1969, Transactions of the Association of American Physicians.

[8]  H R Warner,et al.  Performance of a diagnostic system (Iliad) as a tool for quality assurance. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[9]  R. Miller,et al.  Problem area formation as an element of computer aided diagnosis: a comparison of two strategies within quick medical reference (QMR). , 1991, Methods of information in medicine.

[10]  Jeffrey R. Hammersley,et al.  Evaluating the Utility of Available Differential Diagnosis Systems. , 1988 .

[11]  Fredric M. Wolf,et al.  Effects of a decision support system on the diagnostic accuracy of users: a preliminary report. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[12]  Martha W. Evens,et al.  A Statistical Evaluation of the Diagnostic Performance of MEDAS-The Medical Emergency Decision Assistance System. , 1990 .

[13]  N. Meyers,et al.  H = W. , 1964, Proceedings of the National Academy of Sciences of the United States of America.

[14]  A S Elstein,et al.  The effect of incomplete knowledge on the diagnoses of a computer consultant system. , 1991, Medical informatics = Medecine et informatique.

[15]  Allan S. Detsky,et al.  A randomized crossover trial of quick medical reference (QMR) as a teaching tool for medical interns , 1994, Journal of general internal medicine.

[16]  A. L. Baker,et al.  Performance of four computer-based diagnostic systems. , 1994, The New England journal of medicine.

[17]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[18]  D. Heckerman,et al.  Probabilistic diagnosis using a reformulation of the INTERNIST-1/QMR knowledge base. II. Evaluation of diagnostic performance. , 1991, Methods of information in medicine.

[19]  J P Kassirer,et al.  A report card on computer-assisted diagnosis--the grade: C. , 1994, The New England journal of medicine.

[20]  E. Berner,et al.  Clinical Decision Support Systems: Theory and Practice , 1998 .

[21]  F. Oski,et al.  Impact of a system of computer-assisted diagnosis. Initial evaluation of the hospitalized patient. , 1975, American journal of diseases of children.

[22]  W Sumner.  A review of Iliad and Quick Medical Reference for primary care providers. Two diagnostic computer programs. , 1993, Archives of family medicine.

[23]  J. Myers,et al.  The INTERNIST-1/QUICK MEDICAL REFERENCE project--status report. , 1986, The Western journal of medicine.

[24]  E S Berner,et al.  Paradigms and problem-solving: a literature review. , 1984, Journal of medical education.

[25]  A S Elstein,et al.  The influence of a decision support system on the differential diagnosis of medical practitioners at three levels of training. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[26]  E S Berner,et al.  Relationships among performance scores of four diagnostic decision support systems. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[27]  Guy Marchal,et al.  COMPUTER-ASSISTED DIAGNOSIS , 1989, The Lancet.

[28]  M S Blois,et al.  Evaluating RECONSIDER. A computer program for diagnostic prompting. , 1985, Journal of medical systems.

[29]  Fredric M. Wolf,et al.  Changes in diagnostic decision-making after a computerized decision support consultation based on perceptions of need and helpfulness: a preliminary report , 1997, AMIA.

[30]  G O Barnett,et al.  An approach to evaluating the accuracy of DXplain. , 1990, Computer methods and programs in biomedicine.

[31]  H. Waxman,et al.  Computer‐Assisted Adult Medical Diagnosis: Subject Review and Evaluation of a New Microcomputer‐Based System , 1990, Medicine.

[32]  R A Miller,et al.  Effect of a Computer-Assisted General Medicine Diagnostic Consultation Service on Housestaff Diagnostic Strategy , 1989, Methods of Information in Medicine.

[33]  H. E. Pople,et al.  Internist-I, an Experimental Computer-Based Diagnostic Consultant for General Internal Medicine , 1982 .