Research Paper: Acute Infections in Primary Care: Accuracy of Electronic Diagnoses and Electronic Antibiotic Prescribing

OBJECTIVE To maximize effectiveness, clinical decision-support systems must have access to accurate diagnostic and prescribing information. We measured the accuracy of electronic claims diagnoses and electronic antibiotic prescribing for acute respiratory infections (ARIs) and urinary tract infections (UTIs) in primary care. DESIGN A retrospective, cross-sectional study of randomly selected visits to nine clinics in the Brigham and Women's Practice-Based Research Network between 2000 and 2003 with a principal claims diagnosis of an ARI or UTI (N = 827). MEASUREMENTS We compared electronic billing diagnoses and electronic antibiotic prescribing to the gold standard of blinded chart review. RESULTS Claims-derived, electronic ARI diagnoses had a sensitivity of 98%, specificity of 96%, and positive predictive value of 96%. Claims-derived, electronic UTI diagnoses had a sensitivity of 100%, specificity of 87%, and positive predictive value of 85%. According to the visit note, physicians prescribed antibiotics in 45% of ARI visits and 73% of UTI visits. Electronic antibiotic prescribing had a sensitivity of 43%, specificity of 93%, positive predictive value of 90%, and simple agreement of 64%. The sensitivity of electronic antibiotic prescribing increased over time from 22% in 2000 to 58% in 2003 (p for trend < 0.0001). CONCLUSION Claims-derived, electronic diagnoses for ARIs and UTIs appear accurate. Although closing, a large gap persists between antibiotic prescribing documented in the visit note and the use of electronic antibiotic prescribing. Barriers to electronic antibiotic prescribing in primary care must be addressed to leverage the potential that computerized decision-support systems offer in reducing costs, improving quality, and improving patient safety.

[1]  H Prins,et al.  Availability and usability of data for medical practice assessment. , 2002, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[2]  William W. Stead,et al.  Review Paper: Integration and Beyond: Linking Information from Disparate Sources and into Workflow , 2000, J. Am. Medical Informatics Assoc..

[3]  D. Cherry,et al.  National Ambulatory Medical Care Survey: 2002 summary. , 2004, Advance data.

[4]  Douglas S. Bell,et al.  Model Formulation: A Conceptual Framework for Evaluating Outpatient Electronic Prescribing Systems Based on Their Functional Capabilities , 2004, J. Am. Medical Informatics Assoc..

[5]  Michael M. Wagner,et al.  Review: Accuracy of Data in Computer-based Patient Records , 1997, J. Am. Medical Informatics Assoc..

[6]  Vincenza Snow,et al.  Principles of Appropriate Antibiotic Use for Acute Pharyngitis in Adults , 2001, Annals of Internal Medicine.

[7]  B. Ewigman,et al.  Practice-Based Research Networks: The Laboratories of Primary Care Research , 2004, Medical care.

[8]  K Y Liang,et al.  Longitudinal data analysis for discrete and continuous outcomes. , 1986, Biometrics.

[9]  D. Bates,et al.  Incidence and preventability of adverse drug events among older persons in the ambulatory setting. , 2003, JAMA.

[10]  Ralph Gonzales,et al.  Changing Use of Antibiotics in Community-Based Outpatient Practice, 19911999 , 2003, Annals of Internal Medicine.

[11]  Perry L. Miller,et al.  Research Paper: Exploring the Degree of Concordance of Coded and Textual Data in Answering Clinical Queries from a Clinical Data Repository , 2000, J. Am. Medical Informatics Assoc..

[12]  William W. Stead,et al.  Assessing Data Quality: From Concordance, through Correctness and Completeness, to Valid Manipulatable Representations , 2000, J. Am. Medical Informatics Assoc..

[13]  Michael S. Benninger,et al.  Diagnosis and treatment of uncomplicated acute bacterial rhinosinusitis: Summary of the Agency for Health Care Policy and Research evidence-based report , 2000, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[14]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[15]  S. Jain,et al.  Assessing the Accuracy of Administrative Data in Health Information Systems , 2004, Medical care.

[16]  Jonathan M. Teich,et al.  Identifying hospital admissions due to adverse drug events using a computer‐based monitor , 2001, AMIA.

[17]  Anne F. Kittler,et al.  A cost-benefit analysis of electronic medical records in primary care. , 2003, The American journal of medicine.

[18]  Daniel E. Singer,et al.  Desire for antibiotics and antibiotic prescribing for adults with upper respiratory tract infections , 2003, Journal of General Internal Medicine.

[19]  Mary K Goldstein,et al.  Accuracy of computerized outpatient diagnoses in a Veterans Affairs general medicine clinic. , 2002, The American journal of managed care.

[20]  Joshua Borus,et al.  Adverse drug events in ambulatory care. , 2003, The New England journal of medicine.

[21]  A. Fendrick,et al.  The economic burden of non-influenza-related viral respiratory tract infection in the United States. , 2003, Archives of internal medicine.

[22]  David Gerrett,et al.  A survey of validity and utility of electronic patient records in a general practice , 2001, BMJ : British Medical Journal.

[23]  Mitchell J. Barnett,et al.  Assessing the accuracy of computerized medication histories. , 2004, The American journal of managed care.

[24]  Henry C. Chueh,et al.  A security architecture for query tools used to access large biomedical databases , 2002, AMIA.

[25]  H. Lehmann,et al.  Clinical Decision Support Systems (cdsss) Have Been Hailed for Their Potential to Reduce Medical Errors Clinical Decision Support Systems for the Practice of Evidence-based Medicine , 2022 .

[26]  Ida Sim,et al.  Antibiotic treatment of acute bronchitis in smokers: a systematic review. , 2002, Journal of general internal medicine.

[27]  J. Maselli,et al.  Measuring antibiotic prescribing practices among ambulatory physicians: accuracy of administrative claims data. , 2001, Journal of clinical epidemiology.

[28]  P Huovinen,et al.  The effect of changes in the consumption of macrolide antibiotics on erythromycin resistance in group A streptococci in Finland. Finnish Study Group for Antimicrobial Resistance. , 1997, The New England journal of medicine.

[29]  K. Thiru,et al.  Systematic review of scope and quality of electronic patient record data in primary care , 2003, BMJ : British Medical Journal.

[30]  C. Woods,et al.  Impact of different definitions on estimates of accuracy of the diagnosis data in a clinical database. , 2001, Journal of clinical epidemiology.

[31]  R. Stafford,et al.  National patterns in the treatment of urinary tract infections in women by ambulatory care physicians. , 2002, Archives of internal medicine.

[32]  E. Cook,et al.  Drug complications in outpatients , 2000, Journal of general internal medicine.

[33]  A. Komaroff,et al.  The variability and inaccuracy of medical data , 1979, Proceedings of the IEEE.

[34]  W. Hogan,et al.  The accuracy of medication data in an outpatient electronic medical record. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[35]  D E Low,et al.  Decreased susceptibility of Streptococcus pneumoniae to fluoroquinolones in Canada. Canadian Bacterial Surveillance Network. , 1999, The New England journal of medicine.

[36]  N. Terrin,et al.  Diagnosis and treatment of acute bacterial rhinosinusitis. , 1999, Evidence report/technology assessment.

[37]  R. Gonzales,et al.  Principles of Appropriate Antibiotic Use for Treatment of Acute Bronchitis in Adults , 2001, Annals of Internal Medicine.

[38]  A. Neugut,et al.  Anaphylaxis in the United States: an investigation into its epidemiology. , 2001, Archives of internal medicine.

[39]  Frank Buntinx,et al.  Antibiotics for the common cold , 1996, The Lancet.

[40]  Mitchell L. Cohen Epidemiology of Drug Resistance: Implications for a Post—Antimicrobial Era , 1992, Science.