Automated coded ambulatory problem lists: evaluation of a vocabulary and a data entry tool

BACKGROUND Problem lists are fundamental to electronic medical records (EMRs). However, obtaining an appropriate problem list dictionary is difficult, and getting users to code their problems at the time of data entry can be challenging. OBJECTIVE To develop a problem list dictionary and search algorithm for an EMR system and evaluate its use. METHODS We developed a problem list dictionary and lookup tool and implemented it in several EMR systems. A sample of 10,000 problem entries was reviewed from each system to assess overall coding rates. We also performed a manual review of a subset of entries to determine the appropriateness of coded entries, and to assess the reasons other entries were left uncoded. RESULTS The overall coding rate varied significantly between different EMR implementations (63-79%). Coded entries were virtually always appropriate (99%). The most frequent reasons for uncoded entries were due to user interface failures (44-45%), insufficient dictionary coverage (20-32%), and non-problem entries (10-12%). CONCLUSION The problem list dictionary and search algorithm has achieved a good coding rate, but the rate is dependent on the specific user interface implementation. Problem coding is essential for providing clinical decision support, and improving usability should result in better coding rates.

[1]  J J Cimino,et al.  Cognitive evaluation of the user interface and vocabulary of an outpatient information system. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[2]  David W. Bates,et al.  Standardized coding of the medical problem list , 1994, J. Am. Medical Informatics Assoc..

[3]  P Carpenter,et al.  Phase II evaluation of clinical coding schemes: completeness, taxonomy, mapping, definitions, and clarity. CPRI Work Group on Codes and Structures. , 1997, Journal of the American Medical Informatics Association : JAMIA.

[4]  Peter L. Elkin,et al.  A randomized controlled trial of the accuracy of clinical record retrieval using SNOMED-RT as compared with ICD9-CM , 2001, AMIA.

[5]  E. Mayo.  The Human Problems of an Industrial Civilization , 1934, Nature.

[6]  C. Chute,et al.  The content coverage of clinical classifications. For The Computer-Based Patient Record Institute's Work Group on Codes & Structures. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[7]  Christopher G. Chute,et al.  Desiderata for a clinical terminology server , 1999, AMIA.

[8]  Jonathan M. Teich,et al.  The Brigham integrated computing system (BICS): advanced clinical systems in an academic hospital environment , 1999, Int. J. Medical Informatics.

[9]  J. Fleiss.  Measuring agreement between two judges on the presence or absence of a trait. , 1975, Biometrics.

[10]  G J Kuperman,et al.  Blood pressure and angiotensin converting enzyme inhibitor use in hypertensive patients with chronic renal insufficiency. , 2001, American journal of hypertension.

[11]  Edward H. Shortliffe,et al.  Viewpoint: The Unified Medical Language System: Toward a Collaborative Approach for Solving Terminologic Problems , 1998, J. Am. Medical Informatics Assoc..

[12]  A Khoury.  MARS (medical automated record system) attacks Cleveland. Award-winning system breaks through implementation barriers. , 1998, Healthcare informatics : the business magazine for information and communication systems.

[13]  W E Hammond,et al.  Computer-prompted diagnostic codes. , 1995, The Journal of family practice.

[14]  Christopher G. Chute,et al.  Barriers to the clinical implementation of compositionality , 1999, AMIA.

[15]  Peter J. Haug,et al.  Development and evaluation of a computerized admission diagnoses encoding system. , 1996, Computers and biomedical research, an international journal.

[16]  Henry C. Chueh,et al.  Original investigations: Client-server, Distributed Database Strategies in a Health-care Record System for a Homeless Population , 1994, J. Am. Medical Informatics Assoc..

[17]  Christopher G. Chute,et al.  A clinical terminology in the post modern era: pragmatic problem list development , 1998, AMIA.

[18]  E. B. Steen,et al.  The Computer-Based Patient Record: An Essential Technology for Health Care , 1992, Annals of Internal Medicine.

[19]  Peter J. Haug,et al.  A natural language parsing system for encoding admitting diagnoses , 1997, AMIA.

[20]  G O Barnett,et al.  The application of computer-based medical-record systems in ambulatory practice. , 1984, The New England journal of medicine.

[21]  H. Chin,et al.  Improving clinician acceptance and use of computerized documentation of coded diagnosis. , 1997, The American journal of managed care.

[22]  James R. Campbell.  Strategies for problem list implementation in a complex clinical enterprise , 1998, AMIA.

[23]  L. Weed.  Medical records that guide and teach. , 1968, The New England journal of medicine.

[24]  G O Barnett,et al.  A component-based, distributed object services architecture for a clinical workstation. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[25]  Vimla L. Patel,et al.  Research Paper: Studying the Human- Computer-Terminology Interface , 2001, J. Am. Medical Informatics Assoc..

[26]  J Zelingher,et al.  Categorization of free-text problem lists: an effective method of capturing clinical data. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[27]  T H Payne,et al.  How well does ICD9 represent phrases used in the medical record problem list? , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[28]  James R. Campbell,et al.  Just-in-time coding of the problem list in a clinical environment , 1998, AMIA.

[29]  Alexa T. McCray,et al.  Research Paper: Evaluating the Coverage of Controlled Health Data Terminologies: Report on the Results of the NLM/AHCPR Large Scale Vocabulary Test , 1997, J. Am. Medical Informatics Assoc..

[30]  Dick Rs,et al.  The Computer-Based Patient Record: Revised Edition: An Essential Technology for Health Care , 1997 .

[31]  H. Scherpbier,et al.  A simple approach to physician entry of patient problem list. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[32]  Christopher G. Chute,et al.  Standardized problem list generation, utilizing the Mayo canonical vocabulary embedded within the Unified Medical Language System , 1997, AMIA.

[33]  James J. Cimino,et al.  Review: From Data to Knowledge through Concept-oriented Terminologies: Experience with the Medical Entities Dictionary , 2000, J. Am. Medical Informatics Assoc..

[34]  David W. Bates,et al.  Research Paper: Using Computerized Data to Identify Adverse Drug Events in Outpatients , 2001, J. Am. Medical Informatics Assoc..

[35]  T A Pryor,et al.  Pick from thousands: a collaborative processing model for coded data entry. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[36]  J. Cimino.  Desiderata for Controlled Medical Vocabularies in the Twenty-First Century , 1998, Methods of Information in Medicine.

[37]  R A Miller,et al.  Empirical Derivation of an Electronic Clinically Useful Problem Statement System , 1999, Annals of Internal Medicine.

[38]  D W Bates,et al.  Outcomes of care and resource utilization among patients with knee or shoulder disorders treated by general internists, rheumatologists, or orthopedic surgeons. , 2011, The American journal of medicine.

[39]  Christopher G. Chute,et al.  The Role of Compositionality in Standardized Problem List Generation , 1998, MedInfo.

[40]  W. G. Cole,et al.  Metaphrase: An Aid to the Clinical Conceptualization and Formalization of Patient Problems in Healthcare Enterprises , 1998, Methods of Information in Medicine.

[41]  G O Barnett,et al.  Quality assurance through automated monitoring and concurrent feedback using a computer-based medical information system. , 1978, Medical care.

[42]  et al.,et al.  The Regenstrief Medical Record System: a quarter century experience , 1999, Int. J. Medical Informatics.

[43]  T H Payne,et al.  How useful is the UMLS metathesaurus in developing a controlled vocabulary for an automated problem list? , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[44]  J H Hohnloser,et al.  Improving clinician's coded data entry through the use of an electronic patient record system: 3.5 years experience with a semiautomatic browsing and encoding tool in clinical routine. , 1996, Computers and biomedical research, an international journal.

[45]  D M Rind,et al.  A computer-based outpatient medical record for a teaching hospital. , 1991, M.D. computing : computers in medical practice.

[46]  Jonathan M. Teich,et al.  Design Considerations in the BWH Ambulatory Medical Record: Features for Maximum Acceptance by Clinicians. , 1990 .