Performance and limitations of administrative data in the identification of AKI.

BACKGROUND AND OBJECTIVES Billing codes are frequently used to identify AKI events in epidemiologic research. The goals of this study were to validate billing code-identified AKI against the current AKI consensus definition and to ascertain whether sensitivity and specificity vary by patient characteristic or over time. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS The study population included 10,056 Atherosclerosis Risk in Communities study participants hospitalized between 1996 and 2008. Billing code-identified AKI was compared with the 2012 Kidney Disease Improving Global Outcomes (KDIGO) creatinine-based criteria (AKIcr) and an approximation of the 2012 KDIGO creatinine- and urine output-based criteria (AKIcr_uop) in a subset with available outpatient data. Sensitivity and specificity of billing code-identified AKI were evaluated over time and according to patient age, race, sex, diabetes status, and CKD status in 546 charts selected for review, with estimates adjusted for sampling technique. RESULTS A total of 34,179 hospitalizations were identified; 1353 had a billing code for AKI. The sensitivity of billing code-identified AKI was 17.2% (95% confidence interval [95% CI], 13.2% to 21.2%) compared with AKIcr (n=1970 hospitalizations) and 11.7% (95% CI, 8.8% to 14.5%) compared with AKIcr_uop (n=1839 hospitalizations). Specificity was >98% in both cases. Sensitivity was significantly higher in the more recent time period (2002-2008) and among participants aged 65 years and older. Billing code-identified AKI captured a more severe spectrum of disease than did AKIcr and AKIcr_uop, with a larger proportion of patients with stage 3 AKI (34.9%, 19.7%, and 11.5%, respectively) and higher in-hospital mortality (41.2%, 18.7%, and 12.8%, respectively). CONCLUSIONS The use of billing codes to identify AKI has low sensitivity compared with the current KDIGO consensus definition, especially when the urine output criterion is included, and results in the identification of a more severe phenotype. Epidemiologic studies using billing codes may benefit from a high specificity, but the variation in sensitivity may result in bias, particularly when trends over time are the outcome of interest.

[1]  C. McCulloch,et al.  Temporal changes in incidence of dialysis-requiring AKI. , 2013, Journal of the American Society of Nephrology : JASN.

[2]  R. Mehta,et al.  Oliguria is an early predictor of higher mortality in critically ill patients. , 2011, Kidney international.

[3]  W. Winkelmayer,et al.  Trends in acute kidney injury, associated use of dialysis, and mortality after cardiac surgery, 1999 to 2008. , 2013, The Annals of thoracic surgery.

[4]  D. Lezotte,et al.  Uncomplicated acute renal failure and hospital resource utilization: a retrospective multicenter analysis. , 2005, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[5]  K. Ho,et al.  A Comparison of Nonoliguric and Oliguric Severe Acute Kidney Injury according to the Risk Injury Failure Loss End-Stage (RIFLE) Criteria , 2010, Nephron Clinical Practice.

[6]  J. Schildcrout,et al.  Estimating baseline kidney function in hospitalized patients with impaired kidney function. , 2012, Clinical journal of the American Society of Nephrology : CJASN.

[7]  E. McCarthy,et al.  Declining mortality in patients with acute renal failure, 1988 to 2002. , 2006, Journal of the American Society of Nephrology : JASN.

[8]  A. Folsom,et al.  The Atherosclerosis Risk in Communities (ARIC) Study: design and objectives. The ARIC investigators. , 1989, American journal of epidemiology.

[9]  C. McCulloch,et al.  Community-based incidence of acute renal failure. , 2007, Kidney international.

[10]  David Aron,et al.  Failure of ICD-9-CM codes to identify patients with comorbid chronic kidney disease in diabetes. , 2006, Health services research.

[11]  J. Kellum,et al.  Diagnosis, evaluation, and management of acute kidney injury: a KDIGO summary (Part 1) , 2013, Critical Care.

[12]  H. Quan,et al.  Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative Data , 2005, Medical care.

[13]  Gilles Clermont,et al.  A comparison of three methods to estimate baseline creatinine for RIFLE classification. , 2010, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[14]  A. Go,et al.  Commonly used surrogates for baseline renal function affect the classification and prognosis of acute kidney injury. , 2010, Kidney international.

[15]  E. Fisher,et al.  The accuracy of Medicare's hospital claims data: progress has been made, but problems remain. , 1992, American journal of public health.

[16]  John A Kellum,et al.  Acute Kidney Injury Network: report of an initiative to improve outcomes in acute kidney injury , 2007, Critical care.

[17]  Jonathan Himmelfarb,et al.  Incidence and mortality of acute renal failure in Medicare beneficiaries, 1992 to 2001. , 2006, Journal of the American Society of Nephrology : JASN.

[18]  Donald R. Miller,et al.  Defining acute kidney injury in database studies: the effects of varying the baseline kidney function assessment period and considering CKD status. , 2010, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[19]  F. Ahmed,et al.  Preferred provider organization claims showed high predictive value but missed substantial proportion of adults with high-risk conditions. , 2005, Journal of clinical epidemiology.

[20]  Susan M. Martinelli,et al.  Trends in Cardiac Surgery-Associated Acute Renal Failure in the United States: A Disproportionate Increase after Heart Transplantation , 2009, Renal failure.

[21]  C. Ronco,et al.  North East Italian Prospective Hospital Renal Outcome Survey on Acute Kidney Injury (NEiPHROS-AKI): targeting the problem with the RIFLE Criteria. , 2007, Clinical journal of the American Society of Nephrology : CJASN.

[22]  Amit X Garg,et al.  Long-term risk of mortality and other adverse outcomes after acute kidney injury: a systematic review and meta-analysis. , 2009, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[23]  Sander Greenland,et al.  Modern Epidemiology 3rd edition , 1986 .

[24]  Roger B. Davis,et al.  Outcomes and Cost-effectiveness of Initiating Dialysis and Continuing Aggressive Care in Seriously Ill Hospitalized Adults , 1997, Annals of Internal Medicine.

[25]  M. Swaminathan,et al.  Mortality Trends Associated with Acute Renal Failure Requiring Dialysis after CABG Surgery in the United States , 2009, Blood Purification.

[26]  Sushrut S Waikar,et al.  KDOQI US commentary on the 2012 KDIGO clinical practice guideline for acute kidney injury. , 2013, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[27]  Sushrut S Waikar,et al.  Validity of International Classification of Diseases, Ninth Revision, Clinical Modification Codes for Acute Renal Failure. , 2006, Journal of the American Society of Nephrology : JASN.

[28]  C. Schmid,et al.  A new equation to estimate glomerular filtration rate. , 2009, Annals of internal medicine.

[29]  J. Avorn,et al.  Identification of individuals with CKD from Medicare claims data: a validation study. , 2005, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[30]  Heather Thiessen Philbrook,et al.  Secular trends in acute dialysis after elective major surgery — 1995 to 2009 , 2012, Canadian Medical Association Journal.