Validity of administrative database coding for kidney disease: a systematic review.

BACKGROUND Information in health administrative databases increasingly guides renal care and policy. STUDY DESIGN Systematic review of observational studies. SETTING & POPULATION Studies describing the validity of codes for acute kidney injury (AKI) and chronic kidney disease (CKD) in administrative databases operating in any jurisdiction. SELECTION CRITERIA After searching 13 medical databases, we included observational studies published from database inception though June 2009 that validated renal diagnostic and procedural codes for AKI or CKD against a reference standard. INDEX TESTS Renal diagnostic or procedural administrative data codes. REFERENCE TESTS Patient chart review, laboratory values, or data from a high-quality patient registry. RESULTS 25 studies of 13 databases in 4 countries were included. Validation of diagnostic and procedural codes for AKI was present in 9 studies, and validation for CKD was present in 19 studies. Sensitivity varied across studies and generally was poor (AKI median, 29%; range, 15%-81%; CKD median, 41%; range, 3%-88%). Positive predictive values often were reasonable, but results also were variable (AKI median, 67%; range, 15%-96%; CKD median, 78%; range, 29%-100%). Defining AKI and CKD by only the use of dialysis generally resulted in better code validity. The study characteristic associated with sensitivity in multivariable meta-regression was whether the reference standard used laboratory values (P < 0.001); sensitivity was 39% lower when laboratory values were used (95% CI, 23%-56%). LIMITATIONS Missing data in primary studies limited some of the analyses that could be done. CONCLUSIONS Administrative database analyses have utility, but must be conducted and interpreted judiciously to avoid bias arising from poor code validity.

[1]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[2]  W. Weintraub,et al.  Can cardiovascular clinical characteristics be identified and outcome models be developed from an in-patient claims database? , 1999, The American journal of cardiology.

[3]  K. Schulz,et al.  Uses and abuses of screening tests , 2002, The Lancet.

[4]  H. Quan,et al.  Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. , 2008, Health services research.

[5]  D. Carlisle,et al.  Administrative Versus Clinical Data for Coronary Artery Bypass Graft Surgery Report Cards: The View From California , 2006, Medical care.

[6]  N. Black,et al.  Cross sectional survey of multicentre clinical databases in the United Kingdom , 2004, BMJ : British Medical Journal.

[7]  S. Thompson,et al.  How should meta‐regression analyses be undertaken and interpreted? , 2002, Statistics in medicine.

[8]  Johannes B Reitsma,et al.  Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies , 2006, BMC medical research methodology.

[9]  H. Quan,et al.  Validity of Procedure Codes in International Classification of Diseases, 9th revision, Clinical Modification Administrative Data , 2004, Medical care.

[10]  J. Spinelli,et al.  Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? , 2000, Journal of clinical epidemiology.

[11]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[12]  D. Mark,et al.  Bias in the coding of hospital discharge data and its implications for quality assessment. , 1994, Medical care.

[13]  R. Tamblyn,et al.  Validation of diagnostic codes within medical services claims. , 2004, Journal of clinical epidemiology.

[14]  S. Harold,et al.  Center for Healthcare Policy and Research , 1996 .

[15]  E L Hannan,et al.  Clinical Versus Administrative Data Bases for CABG Surgery: Does it Matter , 1992, Medical care.

[16]  J. Marsal,et al.  Predicting in-hospital mortality with coronary bypass surgery using hospital discharge data: comparison with a prospective observational study. , 2008, Revista espanola de cardiologia.

[17]  E. Fisher,et al.  The accuracy of Medicare's hospital claims data: progress has been made, but problems remain. , 1992, American journal of public health.

[18]  L E Moses,et al.  Estimating Diagnostic Accuracy from Multiple Conflicting Reports , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[19]  Anne Elixhauser,et al.  Understanding and Enhancing the Value of Hospital Discharge Data , 2007, Medical care research and review : MCRR.

[20]  Peter C Austin,et al.  Comparison of Coding of Heart Failure and Comorbidities in Administrative and Clinical Data for Use in Outcomes Research , 2005, Medical care.

[21]  E. McCarthy,et al.  Declining mortality in patients with acute renal failure, 1988 to 2002. , 2006, Journal of the American Society of Nephrology : JASN.

[22]  Azeem Majeed,et al.  Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models , 2007, BMJ : British Medical Journal.

[23]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[24]  David Aron,et al.  Failure of ICD-9-CM codes to identify patients with comorbid chronic kidney disease in diabetes. , 2006, Health services research.

[25]  A. Kshirsagar,et al.  High Prevalence of Unlabeled Chronic Kidney Disease Among Inpatients at a Tertiary-Care Hospital , 2009, The American journal of the medical sciences.

[26]  L. Price,et al.  Epidemiology and outcomes of acute renal failure in hospitalized patients: a national survey. , 2005, Clinical journal of the American Society of Nephrology : CJASN.

[27]  Jonathan M Morris,et al.  The prevalence of maternal medical conditions during pregnancy and a validation of their reporting in hospital discharge data , 2008, The Australian & New Zealand journal of obstetrics & gynaecology.

[28]  P. Bossuyt,et al.  The diagnostic odds ratio: a single indicator of test performance. , 2003, Journal of clinical epidemiology.

[29]  Second Report of the California Hospital Outcomes Project (1996): Acute Myocardial Infarction Volume Two: Technical Appendix-chapter014 , 1996 .

[30]  Laurel Jebamani,et al.  Data Quality in an Information-Rich Environment: Canada as an Example , 2005, Canadian Journal on Aging / La Revue canadienne du vieillissement.

[31]  Sushrut S Waikar,et al.  Validity of International Classification of Diseases, Ninth Revision, Clinical Modification Codes for Acute Renal Failure. , 2006, Journal of the American Society of Nephrology : JASN.

[32]  J. Avorn,et al.  Identification of individuals with CKD from Medicare claims data: a validation study. , 2005, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[33]  Julian P. T. Higgins,et al.  Meta-Regression in Stata , 2008 .

[34]  D. Juurlink,et al.  Enhancing the effectiveness of health care for Ontarians through research Canadian Institute for Health Information Discharge Abstract Database : A Validation Study , 2006 .

[35]  Gaietà Permanyer-Miralda,et al.  Predicción de la mortalidad hospitalaria en la cirugía de derivación aortocoronaria mediante datos administrativos: comparación con un estudio observacional prospectivo☆ , 2008 .

[36]  Lawrence So,et al.  ICD-10 coding algorithms for defining comorbidities of acute myocardial infarction , 2006, BMC Health Services Research.

[37]  Mohammed A Mohammed,et al.  The value of administrative databases , 2007, BMJ : British Medical Journal.

[38]  A. Walker,et al.  A systematic review of discharge coding accuracy. , 2001, Journal of public health medicine.

[39]  E. B. Wilson Probable Inference, the Law of Succession, and Statistical Inference , 1927 .

[40]  Peter J Pronovost,et al.  A systematic review of the Charlson comorbidity index using Canadian administrative databases: a perspective on risk adjustment in critical care research. , 2005, Journal of critical care.

[41]  L. Howard,et al.  Administrative registers in psychiatric research: a systematic review of validity studies , 2005, Acta psychiatrica Scandinavica.

[42]  P. Loy International Classification of Diseases--9th revision. , 1978, Medical record and health care information journal.

[43]  H. Quan,et al.  Comparison and Validity of Procedures Coded With ICD-9-CM and ICD-10-CA/CCI , 2008, Medical care.

[44]  I. Ferreira-González,et al.  [Evaluation of risk-adjusted hospital mortality after coronary artery bypass graft surgery in the Catalan public healthcare system. Influence of hospital management type (ARCA Study)]. , 2006, Revista espanola de cardiologia.

[45]  P. Bossuyt,et al.  BMC Medical Research Methodology , 2002 .

[46]  Hude Quan,et al.  Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data. , 2004, Journal of clinical epidemiology.

[47]  Hude Quan,et al.  Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa , 2009, BMC medical research methodology.