Validation of asthma recording in electronic health records: a systematic review

Objective To describe the methods used to validate asthma diagnoses in electronic health records and summarize the results of the validation studies. Background Electronic health records are increasingly being used for research on asthma to inform health services and health policy. Validation of the recording of asthma diagnoses in electronic health records is essential to use these databases for credible epidemiological asthma research. Methods We searched EMBASE and MEDLINE databases for studies that validated asthma diagnoses detected in electronic health records up to October 2016. Two reviewers independently assessed the full text against the predetermined inclusion criteria. Key data including author, year, data source, case definitions, reference standard, and validation statistics (including sensitivity, specificity, positive predictive value [PPV], and negative predictive value [NPV]) were summarized in two tables. Results Thirteen studies met the inclusion criteria. Most studies demonstrated a high validity using at least one case definition (PPV >80%). Ten studies used a manual validation as the reference standard; each had at least one case definition with a PPV of at least 63%, up to 100%. We also found two studies using a second independent database to validate asthma diagnoses. The PPVs of the best performing case definitions ranged from 46% to 58%. We found one study which used a questionnaire as the reference standard to validate a database case definition; the PPV of the case definition algorithm in this study was 89%. Conclusion Attaining high PPVs (>80%) is possible using each of the discussed validation methods. Identifying asthma cases in electronic health records is possible with high sensitivity, specificity or PPV, by combining multiple data sources, or by focusing on specific test measures. Studies testing a range of case definitions show wide variation in the validity of each definition, suggesting this may be important for obtaining asthma definitions with optimal validity.

[1]  Zubair Afzal,et al.  Automatic generation of case‐detection algorithms to identify children with asthma from large electronic health record databases , 2013, Pharmacoepidemiology and drug safety.

[2]  F. Leone,et al.  Pharmaceutically-based severity stratification of an asthmatic population. , 1999, Respiratory medicine.

[3]  P. Vedsted,et al.  Identification of asthmatic children using prescription data and diagnosis , 2007, European Journal of Clinical Pharmacology.

[4]  Kevin B Weiss,et al.  Worldwide severity and control of asthma in children and adults: the global asthma insights and reality surveys. , 2004, The Journal of allergy and clinical immunology.

[5]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[6]  Kevin B. Johnson,et al.  Implementation and evaluation of an integrated computerized asthma management system in a pediatric emergency department: A randomized clinical trial , 2014, Int. J. Medical Informatics.

[7]  D. Strachan,et al.  Validity and interpretation of mortality, health service and survey data on COPD and asthma in England , 2003, European Respiratory Journal.

[8]  Paul C Tang,et al.  Research Paper: Comparison of Methodologies for Calculating Quality Measures Based on Administrative Data versus Clinical Data from an Electronic Health Record System: Implications for Performance Measures , 2007, J. Am. Medical Informatics Assoc..

[9]  P. Burney,et al.  A reliable method to retrieve accident & emergency data stored on a free-text basis. , 1997, Respiratory medicine.

[10]  P. Demoly,et al.  Update on asthma control in five European countries: results of a 2008 survey , 2010, European Respiratory Review.

[11]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[12]  D. Serraino,et al.  Validity of breast, lung and colorectal cancer diagnoses in administrative databases: a systematic review protocol , 2016, BMJ Open.

[13]  K. E. Ravikumar,et al.  Automated chart review for asthma cohort identification using natural language processing: an exploratory study. , 2013, Annals of allergy, asthma & immunology : official publication of the American College of Allergy, Asthma, & Immunology.

[14]  Huw Thomas,et al.  Collecting morbidity data in general practice: the Somerset morbidity project , 1996, BMJ.

[15]  R. Pauwels,et al.  GLOBAL STRATEGY FOR ASTHMA MANAGEMENT AND PREVENTION , 1996 .

[16]  L. Smeeth,et al.  Validation of asthma recording in electronic health records: protocol for a systematic review , 2017, BMJ Open.

[17]  F. Destefano,et al.  Wheezing lower respiratory disease and vaccination of premature infants. , 2011, Vaccine.

[18]  Chunhua Weng,et al.  Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research , 2013, J. Am. Medical Informatics Assoc..

[19]  A Coulter,et al.  Computer held chronic disease registers in general practice: a validation study. , 1989, Journal of epidemiology and community health.

[20]  M. McPheeters,et al.  A systematic review of validated methods to capture acute bronchospasm using administrative or claims data. , 2013, Vaccine.

[21]  A. Sheikh,et al.  Defining asthma and assessing asthma outcomes using electronic health record data: a systematic scoping review , 2017, European Respiratory Journal.

[22]  S. Vollset,et al.  Validation of disease registration in pregnant women in the Medical Birth Registry of Norway , 2009, Acta obstetricia et gynecologica Scandinavica.

[23]  R Platt,et al.  Assessment of asthma using automated and full-text medical records. , 1997, The Journal of asthma : official journal of the Association for the Care of Asthma.

[24]  Abel N. Kho,et al.  A Highly Specific Algorithm for Identifying Asthma Cases and Controls for Genome-Wide Association Studies , 2009, AMIA.

[25]  David Chan,et al.  Identifying patients with asthma in primary care electronic medical record systems Chart analysis-based electronic algorithm validation study. , 2015, Canadian family physician Medecin de famille canadien.

[26]  D. Halpin,et al.  How accurate is diagnosis of asthma in a general practice database? A review of patients' notes and questionnaire-reported symptoms. , 2004, The British journal of general practice : the journal of the Royal College of General Practitioners.

[27]  Kevin Haynes,et al.  Validity of The Health Improvement Network (THIN) for epidemiologic studies of hepatitis C virus infection , 2009, Pharmacoepidemiology and drug safety.

[28]  M. Chan-yeung,et al.  A novel study design to investigate the early‐life origins of asthma in children (SAGE study) , 2009, Allergy.

[29]  David Moher,et al.  Setting the RECORD straight: developing a guideline for the REporting of studies Conducted using Observational Routinely collected Data , 2013, Clinical epidemiology.

[30]  William M Vollmer,et al.  Searching multiple clinical information systems for longer time periods found more prevalent cases of asthma. , 2004, Journal of clinical epidemiology.

[31]  Michael J. Denney,et al.  Validating the extract, transform, load process used to populate a large clinical research database , 2016, Int. J. Medical Informatics.

[32]  Maria Laura Luchetta,et al.  Validation of chronic obstructive pulmonary disease (COPD) diagnoses in healthcare databases: a systematic review protocol , 2016, BMJ Open.

[33]  A. Mathai,et al.  Understanding and using sensitivity, specificity and predictive values , 2008, Indian journal of ophthalmology.

[34]  M. Marino,et al.  Variation in Outcomes of Quality Measurement by Data Source , 2014, Pediatrics.

[35]  D SANDERS,et al.  Identifying asthma exacerbations in a pediatric emergency department: A feasibility study , 2007, Int. J. Medical Informatics.