Database queries for hospitalizations for acute congestive heart failure: flexible methods and validation based on set theory

BACKGROUND AND OBJECTIVE Electronic health records databases are increasingly used for identifying cohort populations, covariates, or outcomes, but discerning such clinical 'phenotypes' accurately is an ongoing challenge. We developed a flexible method using overlapping (Venn diagram) queries. Here we describe this approach to find patients hospitalized with acute congestive heart failure (CHF), a sampling strategy for one-by-one 'gold standard' chart review, and calculation of positive predictive value (PPV) and sensitivities, with SEs, across different definitions. MATERIALS AND METHODS We used retrospective queries of hospitalizations (2002-2011) in the Indiana Network for Patient Care with any CHF ICD-9 diagnoses, a primary diagnosis, an echocardiogram performed, a B-natriuretic peptide (BNP) drawn, or BNP >500 pg/mL. We used a hybrid between proportional sampling by Venn zone and over-sampling non-overlapping zones. The acute CHF (presence/absence) outcome was based on expert chart review using a priori criteria. RESULTS Among 79,091 hospitalizations, we reviewed 908. A query for any ICD-9 code for CHF had PPV 42.8% (SE 1.5%) for acute CHF and sensitivity 94.3% (1.3%). Primary diagnosis of 428 and BNP >500 pg/mL had PPV 90.4% (SE 2.4%) and sensitivity 28.8% (1.1%). PPV was <10% when there was no echocardiogram, no BNP, and no primary diagnosis. 'False positive' hospitalizations were for other heart disease, lung disease, or other reasons. CONCLUSIONS This novel method successfully allowed flexible application and validation of queries for patients hospitalized with acute CHF.

[1]  Suzette J. Bielinski,et al.  Use of diverse electronic medical record systems to identify genetic risk for type 2 diabetes within a genome-wide association study , 2012, J. Am. Medical Informatics Assoc..

[2]  Thomas Lumley,et al.  Survival associated with two sets of diagnostic criteria for congestive heart failure. , 2004, American journal of epidemiology.

[3]  Alan S Maisel,et al.  Natriuretic peptide testing for predicting adverse events following heart failure hospitalization. , 2012, Congestive heart failure.

[4]  J. Overhage,et al.  Advancing the Science for Active Surveillance: Rationale and Design for the Observational Medical Outcomes Partnership , 2010, Annals of Internal Medicine.

[5]  T. Murdoch,et al.  The inevitable application of big data to health care. , 2013, JAMA.

[6]  Karen Kmetik,et al.  Using health information technology-related performance measures and tools to improve chronic care. , 2009, Joint Commission journal on quality and patient safety.

[7]  Hude Quan,et al.  Administrative data have high variation in validity for recording heart failure. , 2010, The Canadian journal of cardiology.

[8]  Anne E Sales,et al.  A Hybrid Center for Medicaid and Medicare Service Mortality Model in 3 Diagnoses , 2012, Medical care.

[9]  David McManus,et al.  Validation of acute myocardial infarction in the Food and Drug Administration's Mini‐Sentinel program , 2013, Pharmacoepidemiology and drug safety.

[10]  Philip Rotella,et al.  A systematic review of validated methods for identifying hypersensitivity reactions other than anaphylaxis (fever, rash, and lymphadenopathy), using administrative and claims data , 2012, Pharmacoepidemiology and drug safety.

[11]  P. Ray,et al.  Differential diagnosis of acute dyspnea: the value of B natriuretic peptides in the emergency department. , 2008, QJM : monthly journal of the Association of Physicians.

[12]  Grantham Ja,et al.  BNP: increasing importance in the pathophysiology and diagnosis of congestive heart failure. , 1997 .

[13]  Laurent Letrilliart,et al.  Health problems most commonly diagnosed among young female patients during visits to general practitioners and gynecologists in France before the initiation of the human papillomavirus vaccination program , 2012, Pharmacoepidemiology and drug safety.

[14]  E. DeLong,et al.  Discordance of Databases Designed for Claims Payment versus Clinical Information Systems: Implications for Outcomes Research , 1993, Annals of Internal Medicine.

[15]  L H Kuller,et al.  Surveillance and ascertainment of cardiovascular events. The Cardiovascular Health Study. , 1995, Annals of epidemiology.

[16]  Jeffrey R Curtis,et al.  Identification and Validation of Vertebral Compression Fractures Using Administrative Claims Data , 2009, Medical care.

[17]  John Spertus,et al.  ACCF/AHA/AMA-PCPI 2011 Performance Measures for Adults With Heart Failure: A Report of the American College of Cardiology Foundation/American Heart Association Task Force on Performance Measures and the American Medical Association–Physician Consortium for Performance Improvement , 2012, Circulation.

[18]  William Lopez,et al.  Evaluation of the Reliability of Electronic Medical Record Data in Identifying Comorbid Conditions among Patients with Advanced Non-Small Cell Lung Cancer , 2011, Journal of cancer epidemiology.

[19]  Philip Rotella,et al.  A systematic review of validated methods for identifying acute respiratory failure using administrative and claims data , 2012, Pharmacoepidemiology and drug safety.

[20]  J P Wexler,et al.  The relationship between left ventricular systolic function and congestive heart failure diagnosed by clinical criteria. , 1988, Circulation.

[21]  Hua Xu,et al.  Portability of an algorithm to identify rheumatoid arthritis in electronic health records , 2012, J. Am. Medical Informatics Assoc..

[22]  Jay R. Desai,et al.  Diabetes and Asthma Case Identification, Validation, and Representativeness When Using Electronic Health Data to Construct Registries for Comparative Effectiveness and Epidemiologic Research , 2012, Medical care.

[23]  D. Muthu,et al.  Rapid Measurement of B-Type Natriuretic Peptide in the Emergency Diagnosis of Heart Failure , 2009 .

[24]  Paul C Tang,et al.  Research Paper: Comparison of Methodologies for Calculating Quality Measures Based on Administrative Data versus Clinical Data from an Electronic Health Record System: Implications for Performance Measures , 2007, J. Am. Medical Informatics Assoc..

[25]  Y. Tabak,et al.  An Automated Model to Identify Heart Failure Patients at Risk for 30-Day Readmission or Death Using Electronic Medical Record Data , 2010, Medical care.

[26]  Melissa A. Basford,et al.  Validation of electronic medical record-based phenotyping algorithms: results and lessons learned from the eMERGE network. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[27]  R. A. Johnson,et al.  An analysis of physicians' reasons for prescribing long-term digitalis therapy in outpatients. , 1985, Journal of chronic diseases.

[28]  R A Rosati,et al.  Chronic congestive heart failure in coronary artery disease: clinical criteria. , 1977, Annals of internal medicine.

[29]  Sameer Malhotra,et al.  Accuracy of Electronically Reported “Meaningful Use” Clinical Quality Measures , 2013, Annals of Internal Medicine.

[30]  Lin Chen,et al.  Importance of multi-modal approaches to effectively identify cataract cases from electronic health records , 2012, J. Am. Medical Informatics Assoc..

[31]  Jun Liu,et al.  Validity of claims‐based definitions of left ventricular systolic dysfunction in Medicare patients , 2011, Pharmacoepidemiology and drug safety.

[32]  E John Orav,et al.  Quality of care and patient outcomes in critical access rural hospitals. , 2011, JAMA.

[33]  J. Rice,et al.  Definition of the phenotype. , 2001, Advances in genetics.

[34]  T. Kottke,et al.  An Algorithm That Identifies Coronary and Heart Failure Events In The Electronic Health Record , 2013, Preventing chronic disease.

[35]  Melissa A. Basford,et al.  Variants near FOXE1 are associated with hypothyroidism and other thyroid conditions: using electronic medical records for genome- and phenome-wide studies. , 2011, American journal of human genetics.

[36]  Richard L. Scheaffer,et al.  Elementary Survey Sampling , 1971 .

[37]  M. Wojczynski,et al.  Definition of phenotype. , 2008, Advances in genetics.

[38]  W. Kannel,et al.  The natural history of congestive heart failure: the Framingham study. , 1971, The New England journal of medicine.

[39]  M. Arad,et al.  Brain and atrial natriuretic peptides in patients with ischemic heart disease with and without heart failure. , 1996, Cardiology.

[40]  Wayne Gade,et al.  The Emerging Roles of BNP and Accelerated Cardiac Protocols in Emergency Laboratory Medicine , 2003, American Society for Clinical Laboratory Science.

[41]  J C Burnett,et al.  BNP: increasing importance in the pathophysiology and diagnosis of congestive heart failure. , 1997, Circulation.

[42]  Patrick B. Ryan,et al.  Validation of a common data model for active safety surveillance research , 2012, J. Am. Medical Informatics Assoc..

[43]  Lonnie Blevins,et al.  The Indiana network for patient care: a working local health information infrastructure. An example of a working infrastructure collaboration that links data from five health systems and hundreds of millions of entries. , 2005, Health affairs.

[44]  H. Imura,et al.  Increased human brain natriuretic peptide in congestive heart failure. , 1990, The New England journal of medicine.

[45]  Sengwee Toh,et al.  Design for validation of acute myocardial infarction cases in Mini‐Sentinel , 2012, Pharmacoepidemiology and drug safety.

[46]  M. Nichaman,et al.  Congestive heart failure in the United States: is there more than meets the I(CD code)? The Corpus Christi Heart Project. , 2000, Archives of internal medicine.

[47]  Thomas Lumley,et al.  Congestive heart failure incidence and prognosis: case identification using central adjudication versus hospital discharge diagnoses. , 2006, Annals of epidemiology.

[48]  B. Mahon,et al.  Maternal and infant use of erythromycin and other macrolide antibiotics as risk factors for infantile hypertrophic pyloric stenosis. , 2001, The Journal of pediatrics.

[49]  George Hripcsak,et al.  Next-generation phenotyping of electronic health records , 2012, J. Am. Medical Informatics Assoc..

[50]  J. Steiner,et al.  A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research. , 2012, Medical care.

[51]  L Bordenave,et al.  Review of 10 years of the clinical use of brain natriuretic peptide in cardiology. , 1999, The Journal of laboratory and clinical medicine.