A History of the INTERNIST-1 and Quick Medical Reference (QMR) Computer-Assisted Diagnosis Projects, with Lessons Learned

The INTERNIST-1/Quick Medical Reference (QMR) diagnostic decision support project spans four decades, from 1971-onward. This paper describes the history of the project and details insights gained of relevance to the general clinical and informatics communities.

[1]  E R Siegel,et al.  The hepatitis knowledge base. A prototype information transfer system. , 1980, Annals of internal medicine.

[2]  R A Miller,et al.  Computer-based diagnostic decisionmaking. , 1987, Medical care.

[3]  Timothy M. Franz,et al.  Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. , 1999, JAMA.

[4]  R. Miller,et al.  Use of the Quick Medical Reference (QMR) Program as a Tool for Medical Education , 1989, Methods of Information in Medicine.

[5]  R A Miller,et al.  Heuristic determination of quantitative data for knowledge acquisition in medicine. , 1991, Computers and biomedical research, an international journal.

[6]  C R Welford.  A comprehensive computerized patient record with automated linkage to QMR. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[7]  W. Kapoor,et al.  A computer-assisted medical diagnostic consultation service. Implementation and prospective evaluation of a prototype. , 1989, Annals of internal medicine.

[8]  Gregory F. Cooper,et al.  An Empirical Analysis of Likelihood-Weighting Simulation on a Large, Multiply-Connected Belief Network , 1991, Computers and biomedical research, an international journal.

[9]  Blackford Middleton,et al.  Evaluating Consensus Among Physicians in Medical Knowledge Base Construction , 1993, Methods of Information in Medicine.

[10]  M Lee,et al.  Diagnostic error in medicine. , 1991 .

[11]  Michael M. Wagner,et al.  The Diagnostic Importance of the History and Physical Examination as Determined by the Use of a Medical Decision Support System. , 1989 .

[12]  Eta S. Berner,et al.  Effects of a decision support system on physicians' diagnostic performance. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[13]  Randolph A. Miller,et al.  Consistency enforcement in medical knowledge base construction , 1993, Artif. Intell. Medicine.

[14]  Blackford Middleton,et al.  Building a speech interface to a medical diagnostic system , 1991, IEEE Expert.

[15]  G F Cooper,et al.  A temporal analysis of QMR. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[16]  R A Miller,et al.  INTERNIST-I properties: representing common sense and good medical practice in a computerized medical knowledge base. , 1985, Computers and biomedical research, an international journal.

[17]  Randolph A Miller,et al.  Computer-assisted diagnostic decision support: history, challenges, and possible paths forward , 2009, Advances in health sciences education : theory and practice.

[18]  R A Miller,et al.  Ethical and legal issues related to the use of computer programs in clinical medicine. , 1985, Annals of internal medicine.

[19]  W. M. McClain.  The fundamental theorem , 2009 .

[20]  E S Berner,et al.  Relationships among performance scores of four diagnostic decision support systems. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[21]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[22]  R A Miller,et al.  INTERNIST-1/CADUCEUS: Problems Facing Expert Consultant Programs , 1984, Methods of Information in Medicine.

[23]  R A Miller,et al.  Comparing contents of a knowledge base to traditional information sources. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[24]  R A Miller,et al.  Why the standard view is standard: people, not machines, understand patients' problems. , 1990, The Journal of medicine and philosophy.

[25]  J R Scherrer,et al.  Modeling principles for QMR medical findings. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[26]  Randolph A. Miller,et al.  Computer Assisted Multi-Center Creation of Medical Knowledge Bases , 1988 .

[27]  I Arene,et al.  Evaluation of quick medical reference (QMR) as a teaching tool. , 1998, M.D. computing : computers in medical practice.

[28]  Randolph A. Miller,et al.  Medical Knowledge Base Acquisition: The Role of the Expert Review Process in Disease Profile Construction. , 1989 .

[29]  William J. Clancey,et al.  NEOMYCIN: Reconfiguring a Rule-Based Expert System for Application to Teaching , 1981, IJCAI.

[30]  K F Schaffner,et al.  Medical Informatics and the Concept of Disease , 2000, Theoretical medicine and bioethics.

[31]  M E Gozum,et al.  Emulating cognitive diagnostic skills without clinical experience: a report of medical students using Quick Medical Reference and Iliad in the diagnosis of difficult clinical cases. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[32]  Charles P. Friedman,et al.  Viewpoint Paper: A "Fundamental Theorem" of Biomedical Informatics , 2009, J. Am. Medical Informatics Assoc..

[33]  M. Collen.  A History of Medical Informatics in the United States, 1950 to 1990 , 1995 .

[34]  David A. Wolfram,et al.  An appraisal of INTERNIST-I , 1995, Artif. Intell. Medicine.

[35]  J R Scherrer,et al.  Modeling concepts in medicine for medical language understanding. , 1998, Methods of information in medicine.

[36]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[37]  L M Fagan,et al.  The integration of a continuous-speech-recognition system with the QMR diagnostic program. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[38]  J B Lemaire,et al.  Effectiveness of the Quick Medical Reference as a diagnostic tool. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[39]  D. Heckerman,et al.  ,81. Introduction , 2022 .

[40]  R A Miller,et al.  Effect of a Computer-Assisted General Medicine Diagnostic Consultation Service on Housestaff Diagnostic Strategy , 1989, Methods of Information in Medicine.

[41]  Edward H. Shortliffe,et al.  Computer-based medical consultations, MYCIN , 1976 .

[42]  P. Pronovost,et al.  Diagnostic errors--the next frontier for patient safety. , 2009, JAMA.

[43]  Randolph A. Miller,et al.  Research Paper: Evaluation of Long-term Maintenance of a Large Medical Knowledge Base , 1995, J. Am. Medical Informatics Assoc..

[44]  Randolph A. Miller,et al.  A Heuristic Approach to the Multiple Diagnoses Problem , 1997, AIME.

[45]  R A Miller,et al.  The Demise of the “Greek Oracle” Model for Medical Diagnostic Systems , 1990, Methods of Information in Medicine.

[46]  Randolph A. Miller,et al.  Knowledge Base Editing with QMR-KAT , 1993 .

[47]  A. L. Baker,et al.  Performance of four computer-based diagnostic systems. , 1994, The New England journal of medicine.

[48]  Randolph A. Miller,et al.  A Comparison of Clustered Knowledge Structures in Iliad and in Quick Medical Reference , 1988 .

[49]  G O Barnett,et al.  The application of computer-based medical-record systems in ambulatory practice. , 1984, The New England journal of medicine.

[50]  P W Moorman,et al.  Integrating QMR with a computer-based patient record. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[51]  R. Miller,et al.  Problem area formation as an element of computer aided diagnosis: a comparison of two strategies within quick medical reference (QMR). , 1991, Methods of information in medicine.

[52]  R A Miller,et al.  Distinguishing drug toxicity syndromes from medical diseases: a QMR computer-based approach. , 1990, Computer methods and programs in biomedicine.

[53]  R A Bankowitz,et al.  A prospective analysis of inter-rater agreement between a physician and a physician's assistant in selecting QMR vocabulary terms. , 1991, Proceedings. Symposium on Computer Applications in Medical Care.

[54]  F E Masarie,et al.  Quick medical reference (QMR) for diagnostic assistance. , 1986, M.D.Computing.

[55]  Randolph A. Miller,et al.  User Variability in Abstracting and Entering Printed Case Histories with QUICK MEDICAL REFERENCE (QMR). , 1987 .

[56]  D. Heckerman,et al.  Probabilistic diagnosis using a reformulation of the INTERNIST-1/QMR knowledge base. II. Evaluation of diagnostic performance. , 1991, Methods of information in medicine.

[57]  H. Warner,et al.  An interlingua for electronic interchange of medical information: using frames to map between clinical vocabularies. , 1991, Computers and biomedical research, an international journal.

[58]  Matthew Concannon.  A History of Medical Informatics in the United States: 1950 to 1990, Morris F. Collen MD.. Bethesda, Maryland (1995), 489, $40 , 1996 .

[59]  R A Miller,et al.  Extending the capabilities of diagnostic decision support programs through links to bibliographic searching: addition of "canned MeSH logic" to the Quick Medical Reference (QMR) program for use with Grateful Med. , 1991, Proceedings. Symposium on Computer Applications in Medical Care.

[60]  Reed M. Gardner,et al.  White Paper: Designing Medical Informatics Research and Library-Resource Projects to Increase What Is Learned , 1994, J. Am. Medical Informatics Assoc..

[61]  Randolph A. Miller,et al.  Diagnostic and Prognostic Decision-Making Systems: A Survey of Recent Developments in the United States , 1984 .

[62]  Randolph A. Miller,et al.  Using Causal Knowledge to Create Simulated Patient Cases: The CPCS Project as an Extension of INTERNIST-1 , 1988 .

[63]  Randolph A. Miller,et al.  DIALOG: A Model Of Diagnostic Logic For Internal Medicine , 1975, IJCAI.

[64]  Randolph A. Miller,et al.  Towards computer-assisted maintenance of medical knowledge bases , 1990, Artif. Intell. Medicine.

[65]  Randolph A. Miller,et al.  Evaluating Evaluations of Medical Diagnostic Systems , 1996, J. Am. Medical Informatics Assoc..

[66]  Robert H. Baud,et al.  Compositional and enumerative designs for medical language representation , 1997, AMIA.

[67]  R A Miller,et al.  QUICK (QUick Index to Caduceus Knowledge): using the INTERNIST-1/CADUCEUS knowledge base as an electronic textbook of medicine. , 1985, Computers and biomedical research, an international journal.

[68]  E S Berner,et al.  Influence of case and physician characteristics on perceptions of decision support systems. , 1999, Journal of the American Medical Informatics Association : JAMIA.