Are Claims Data Accurate Enough to Identify Patients for Performance Measures or Quality Improvement? The Case of Diabetes, Heart Disease, and Depression

The objective of this study was to demonstrate a method to accurately identify patients with specific conditions from claims data for care improvement or performance measurement. In an iterative process of trial case definitions followed by review of repeated random samples of 10 to 20 cases for diabetes, heart disease, or newly treated depression, a final identification algorithm was created from claims files of health plan members. A final sample was used to calculate the positive predictive value (PPV). Each condition had unacceptably low PPVs (0.20, 0.60, and 0.65) when cases were identified on the basis of only 1 International Classification of Diseases, ninth revision, code per year. Requiring 2 outpatient codes or 1 inpatient code within 12 months (plus consideration of medication data for diabetes and extra criteria for depression) resulted in PPVs of 0.97, 0.95, and 0.95. This approach is feasible and necessary for those wanting to use administrative data for case identification for performance measurement or quality improvement.

[1]  D. Cannon,et al.  How well do automated performance measures assess guideline implementation for new-onset depression in the Veterans Health Administration? , 2003, Joint Commission journal on quality and safety.

[2]  Richard W. Kobylinski,et al.  Identifying physician-recognized depression from administrative data: consequences for quality measurement. , 2003, Health services research.

[3]  M. Valenstein,et al.  Targeting quality improvement activities for depression. Implications of using administrative data. , 2000, The Journal of family practice.

[4]  W. Manning,et al.  The Unreliability of Individual Physician “Report Cards” for Assessing the Costs and Quality of Care of a Chronic Disease , 2000 .

[5]  E. McGlynn,et al.  Measuring antidepressant prescribing practice in a health care system using administrative data: implications for quality measurement and improvement. , 2000, The Joint Commission journal on quality improvement.

[6]  D. Plocher,et al.  Best Practices in Medical Management , 2000 .

[7]  T. Croghan,et al.  Use of claims data for research on treatment and outcomes of depression care. , 1999, Medical care.

[8]  Kashner Tm.  Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. , 1998 .

[9]  A G Mainous,et al.  Assessing quality of care via HEDIS 3.0. Is there a better way? , 1998, Archives of family medicine.

[10]  D M Eddy,et al.  Performance measurement: problems and solutions. , 1998, Health affairs.

[11]  M. Smith.  Prevention in managed care: joining forces for value and quality. Opening plenary. , 1998, American journal of preventive medicine.

[12]  P. O’Connor,et al.  Identifying diabetes mellitus or heart disease among health maintenance organization members: sensitivity, specificity, predictive value, and cost of survey and database methods. , 1998, The American journal of managed care.

[13]  J. Fowles,et al.  Validation of Claims Diagnoses and Self‐Reported Conditions Compared with Medical Records for Selected Chronic Diseases , 1998, The Journal of ambulatory care management.

[14]  J. Eisenberg.  Health services research in a market-oriented health care system. , 1998, Health affairs.

[15]  T. M. Kashner,et al.  Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. , 1998, Medical care.

[16]  P. O’Connor,et al.  Building a patient registry for implementation of health promotion initiatives: targeting high-risk individuals. , 1997, HMO practice.

[17]  P Huston,et al.  Health services research: reporting on studies using secondary data sources. , 1996, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[18]  J. E. Bailey,et al.  Prevention in managed care: obstacles and opportunities. , 1996, Journal of the Tennessee Medical Association.

[19]  D McLerran,et al.  Using administrative data to describe casemix: a comparison with the medical record. , 1994, Journal of clinical epidemiology.

[20]  K. Rost,et al.  The deliberate misdiagnosis of major depression in primary care. , 1994, Archives of family medicine.

[21]  J. Corrigan,et al.  Toward the development of uniform reporting standards for managed care organizations: the Health Plan Employer Data and Information Set (Version 2.0). , 1993, The Joint Commission journal on quality improvement.

[22]  R. Deyo,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. , 1992, Journal of clinical epidemiology.

[23]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.