Predicting virologic failure in an HIV clinic.

BACKGROUND We sought to use data captured in the electronic health record (EHR) to develop and validate a prediction rule for virologic failure among patients being treated for infection with human immunodeficiency virus (HIV). METHODS We used EHRs at 2 Boston tertiary care hospitals, Massachusetts General Hospital and Brigham and Women's Hospital, to identify HIV-infected patients who were virologically suppressed (HIV RNA level < or = 400 copies/mL) on antiretroviral therapy (ART) during the period from 1 January 2005 through 31 December 2006. We used a multivariable logistic model with data from Massachusetts General Hospital to derive a 1-year virologic failure prediction rule. The model was validated using data from Brigham and Women's Hospital.We then simplified the scoring scheme to develop a clinical prediction rule. RESULTS The 1-year virologic failure prediction model, using data from 712 patients from Massachusetts General Hospital, demonstrated good discrimination (C statistic, 0.78) and calibration (chi(2)= 6.6; P= .58). The validation model, based on 362 patients from Brigham and Women's Hospital, also showed good discrimination (C statistic, 0.79) and calibration (chi(2)= 1.9; P= .93). The clinical prediction rule included 7 predictors (suboptimal adherence, CD4 cell count < 100 cells/microL, drug and/or alcohol abuse, highly ART experienced, missed > or = 1 appointment, prior virologic failure, and suppressed < or = 12 months) and appropriately stratified patients in the validation data set into low-, medium-, and high-risk groups, with 1-year virologic failure rates of 3.0%, 13.0%, and 28.6%, respectively. CONCLUSIONS A risk score based on 7 variables available in the EHR predicts HIV virologic failure at 1 year and could be used for targeted interventions to improve outcomes in HIV infection.

[1]  G. Leung,et al.  A Clinical Prediction Rule for Diagnosing Severe Acute Respiratory Syndrome in the Emergency Department , 2004, Annals of Internal Medicine.

[2]  J. Sterne,et al.  Prognosis of HIV-1-infected patients up to 5 years after initiation of HAART: collaborative analysis of prospective studies , 2007, AIDS.

[3]  J. Sterne,et al.  Prognostic model for HIV-1 disease progression in patients starting antiretroviral therapy was validated using independent data. , 2005, Journal of clinical epidemiology.

[4]  Susan Swindells,et al.  Adherence to Protease Inhibitor Therapy and Outcomes in Patients with HIV Infection , 2000, Annals of Internal Medicine.

[5]  Peter C. Austin,et al.  Predicting mortality among patients hospitalized for heart failure: derivation and validation of a clinical model. , 2003, JAMA.

[6]  Kholoud Porter,et al.  Determinants of survival following HIV-1 seroconversion after the introduction of HAART , 2003, The Lancet.

[7]  D R Hoover,et al.  Initial plasma HIV-1 RNA levels and progression to AIDS in women and men. , 2001, The New England journal of medicine.

[8]  Blackford Middleton,et al.  Barriers to Electronic Health Record Use during Patient Visits , 2006, AMIA.

[9]  H. Chueh,et al.  Predictors of Antiretroviral Treatment Failure in an Urban HIV Clinic , 2007, Journal of acquired immune deficiency syndromes.

[10]  Christopher D Pilcher,et al.  Triple-nucleoside regimens versus efavirenz-containing regimens for the initial treatment of HIV-1 infection. , 2004, The New England journal of medicine.

[11]  J. Lindsey,et al.  Adherence to Antiretrovirals Among US Women During and After Pregnancy , 2008, Journal of acquired immune deficiency syndromes.

[12]  Yuqing Yang,et al.  Combining dependent tests to compare the diagnostic accuracies--a non-parametric approach. , 2006, Statistics in medicine.

[13]  D. Mark,et al.  Clinical prediction models: are we building better mousetraps? , 2003, Journal of the American College of Cardiology.

[14]  D. Jasinski,et al.  Highly active antiretroviral therapy outcomes in a primary care clinic , 2003, AIDS care.

[15]  N. Schneiderman,et al.  Psychosocial Factors Predict CD4 and Viral Load Change in Men and Women With Human Immunodeficiency Virus in the Era of Highly Active Antiretroviral Treatment , 2005, Psychosomatic medicine.

[16]  D. Vlahov,et al.  A PROSPECTIVE STUDY OF ADHERENCE AND VIRAL LOAD IN A LARGE MULTI-CENTER COHORT OF HIV-INFECTED WOMEN , 2002, AIDS.

[17]  J. Morris,et al.  Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groups , 2006, Statistics in medicine.

[18]  D W Bates,et al.  Predicting acute renal failure after coronary bypass surgery: cross-validation of two risk-stratification algorithms. , 2000, Kidney international.

[19]  D. Levy,et al.  Prediction of coronary heart disease using risk factor categories. , 1998, Circulation.

[20]  Jonathan AC Sterne,et al.  Prognosis of HIV-1-infected patients starting highly active antiretroviral therapy: a collaborative analysis of prospective studies , 2002, The Lancet.

[21]  S. Cole,et al.  Racial Disparities in HIV Virologic Failure: Do Missed Visits Matter? , 2009, Journal of Acquired Immune Deficiency Syndromes.

[22]  L. Sandvik,et al.  Predictors of mortality in HIV-infected patients starting antiretroviral therapy in a rural hospital in Tanzania , 2008, BMC infectious diseases.

[23]  Victor De Gruttola,et al.  Comparison of sequential three-drug regimens as initial therapy for HIV-1 infection. , 2003, The New England journal of medicine.

[24]  M. Pepe,et al.  Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. , 2004, American journal of epidemiology.

[25]  Joshua D. Hartzell,et al.  Race and Mental Health Diagnosis Are Risk Factors for Highly Active Antiretroviral Therapy Failure in a Military Cohort Despite Equal Access to Care , 2007, Journal of acquired immune deficiency syndromes.

[26]  Roger Detels,et al.  Plasma Viral Load and CD4+ Lymphocytes as Prognostic Markers of HIV-1 Infection , 1997, Annals of Internal Medicine.

[27]  G. Satten,et al.  Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. HIV Outpatient Study Investigators. , 1998, The New England journal of medicine.

[28]  Louise C. Walter,et al.  Development and validation of a prognostic index for 1-year mortality in older adults after hospitalization. , 2001 .

[29]  R. Chaisson,et al.  Highly Active Antiretroviral Therapy in a Large Urban Clinic: Risk Factors for Virologic Failure and Adverse Drug Reactions , 1999, Annals of Internal Medicine.

[30]  H. Sox,et al.  Clinical prediction rules. Applications and methodological standards. , 1985, The New England journal of medicine.

[31]  David Gur,et al.  Incorporating utility-weights when comparing two diagnostic systems: a preliminary assessment. , 2005, Academic radiology.

[32]  J. Lambert,et al.  Progression of HIV Disease Among Women Following Delivery , 2003, Journal of acquired immune deficiency syndromes.

[33]  A. Mocroft,et al.  Virological rebound after suppression on highly active antiretroviral therapy , 2003, AIDS.

[34]  Ting-kai Li,et al.  Quantifying the risks associated with exceeding recommended drinking limits. , 2005, Alcoholism, clinical and experimental research.

[35]  M. Suarez‐Almazor,et al.  Retention in care: a challenge to survival with HIV infection. , 2007, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[36]  A. Mocroft,et al.  Short-term clinical disease progression in HIV-1-positive patients taking combination antiretroviral therapy: the EuroSIDA risk-score , 2007, AIDS.

[37]  Y Vergouwe,et al.  Updating methods improved the performance of a clinical prediction model in new patients. , 2008, Journal of clinical epidemiology.

[38]  A. Laupacis,et al.  Clinical prediction rules. A review and suggested modifications of methodological standards. , 1997, JAMA.

[39]  R. D'Agostino,et al.  Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation. , 2001, JAMA.