Evaluation of the content coverage of SNOMED CT: ability of SNOMED clinical terms to represent clinical problem lists.

OBJECTIVE To evaluate the ability of SNOMED CT (Systematized Nomenclature of Medicine Clinical Terms) version 1.0 to represent the most common problems seen at the Mayo Clinic in Rochester, Minn. MATERIAL AND METHODS We selected the 4996 most common nonduplicated text strings from the Mayo Master Sheet Index that describe patient problems associated with inpatient and outpatient episodes of care. From July 2003 through January 2004, 2 physician reviewers compared the Master Sheet Index text with the SNOMED CT terms that were automatically mapped by a vocabulary server or that they identified using a vocabulary browser and rated the "correctness" of the match. If the 2 reviewers disagreed, a third reviewer adjudicated. We evaluated the specificity, sensitivity, and positive predictive value of SNOMED CT. RESULTS Of the 4996 problems in the test set, SNOMED CT correctly identified 4568 terms (true-positive results); 36 terms were true negatives, 9 terms were false positives, and 383 terms were false negatives. SNOMED CT had a sensitivity of 92.3%, a specificity of 80.0%, and a positive predictive value of 99.8%. CONCLUSION SNOMED CT, when used as a compositional terminology, can exactly represent most (92.3%) of the terms used commonly in medical problem lists. Improvements to synonymy and adding missing modifiers would lead to greater coverage of common problem statements. Health care organizations should be encouraged and provided incentives to begin adopting SNOMED CT to drive their decision-support applications.

[1]  L. Weed Medical records, patient care, and medical education , 1964, Irish journal of medical science.

[2]  L. Weed Medical records that guide and teach. , 1968, The New England journal of medicine.

[3]  How to implement the Weed system. (In order to improve patient care, education, and research by improving medical records). , 1971, Archives of internal medicine.

[4]  J. Hurst,et al.  Ten reasons why Lawrence Weed is right. , 1971, The New England journal of medicine.

[5]  J. Willis Hurst,et al.  The Problem-oriented system , 1972 .

[6]  A R Feinstein,et al.  The problems of the "problem-oriented medical record". , 1973, Annals of internal medicine.

[7]  John C. Bjorn,et al.  Problem-Oriented Medical Record , 1973 .

[8]  Feinstein Ar,et al.  An analysis of diagnostic reasoning. I. The domains and disorders of clinical macrobiology. , 1973 .

[9]  Feinstein Ar,et al.  An analysis of diagnostic reasoning. II. The strategy of intermediate decisions. , 1973 .

[10]  Feinstein Ar An analysis of diagnostic reasoning. 3. The construction of clinical algorithms. , 1974 .

[11]  Patient care and medical case notes. A plea for the wider use of the Weed system of problem orientated medical records. , 1975 .

[12]  G. Gorry,et al.  Clinical problem solving: a behavioral analysis. , 1978, Annals of internal medicine.

[13]  L. Shulman,et al.  Medical Problem Solving: An Analysis of Clinical Reasoning , 1978 .

[14]  L. Goldman,et al.  Patient-physician concordance in problem identification in the primary care setting. , 1980, Annals of internal medicine.

[15]  D M Eddy,et al.  The art of diagnosis: solving the clinicopathological exercise. , 1982, The New England journal of medicine.

[16]  R. Stout,et al.  Validation of a problem-focused nomenclature. , 1983, Archives of general psychiatry.

[17]  Strategies of information gathering: Part II. , 1988, Hospital practice.

[18]  J. Kassirer,et al.  Intuitive and inspirational, or inductive and incremental? , 1988, Hospital practice.

[19]  J P Kassirer,et al.  Cognitive errors in diagnosis: instantiation, classification, and consequences. , 1989, The American journal of medicine.

[20]  M A Musen,et al.  Representation of clinical data using SNOMED III and conceptual graphs. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[21]  B W Lloyd,et al.  Use of problem lists in letters between hospital doctors and general practitioners. , 1993, BMJ.

[22]  A L Rector,et al.  Goals for concept representation in the GALEN project. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[23]  James R. Campbell,et al.  A comparison of four schemes for codification of problem lists. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[24]  A L Rector,et al.  The GALEN project. , 1994, Computer methods and programs in biomedicine.

[25]  Stanley M. Huff,et al.  Position Paper: Toward a Medical-concept Representation Language , 1994, J. Am. Medical Informatics Assoc..

[26]  Lawrence M. Fagan,et al.  Development of a Controlled Medical Terminology: Knowledge Acquisition and Knowledge Representation , 1995, Methods of Information in Medicine.

[27]  Christopher G. Chute,et al.  Standardized problem list generation, utilizing the Mayo canonical vocabulary embedded within the Unified Medical Language System , 1997, AMIA.

[28]  Christopher G. Chute,et al.  A randomized controlled trial of automated term composition , 1998, AMIA.

[29]  Kent A. Spackman,et al.  Compositional concept representation using SNOMED: towards further convergence of clinical terminologies , 1998, AMIA.

[30]  Christopher G. Chute,et al.  The Role of Compositionality in Standardized Problem List Generation , 1998, MedInfo.

[31]  Christopher G. Chute,et al.  A randomized double-blind controlled trial of automated term dissection , 1999, AMIA.

[32]  R A Miller,et al.  Empirical Derivation of an Electronic Clinically Useful Problem Statement System , 1999, Annals of Internal Medicine.

[33]  Peter L. Elkin,et al.  Automated enhancement of description logic-defined terminologies to facilitate mapping to ICD9-CM , 2002, J. Biomed. Informatics.

[34]  Peter L. Elkin,et al.  Guideline and quality indicators for development, purchase and use of controlled health vocabularies , 2002, Int. J. Medical Informatics.

[35]  Alan L. Rector,et al.  A formal representation for messages containing compositional expressions , 2003, Int. J. Medical Informatics.

[36]  Olivier Bodenreider,et al.  RxNav: A Semantic Navigation Tool for Clinical Drugs , 2004 .

[37]  Anil Jain,et al.  Responding to the Rofecoxib Withdrawal Crisis: A New Model for Notifying Patients at Risk and Their Health Care Providers , 2005, Annals of Internal Medicine.