The ROC curve for regularly measured longitudinal biomarkers.

The receiver operating characteristic (ROC) curve is a commonly used graphical summary of the discriminative capacity of a thresholded continuous scoring system for a binary outcome. Estimation and inference procedures for the ROC curve are well-studied in the cross-sectional setting. However, there is a paucity of research when both biomarker measurements and disease status are observed longitudinally. In a motivating example, we are interested in characterizing the value of longitudinally measured CD4 counts for predicting the presence or absence of a transient spike in HIV viral load, also time-dependent. The existing method neither appropriately characterizes the diagnostic value of observed CD4 counts nor efficiently uses status history in predicting the current spike status. We propose to jointly model the binary status as a Markov chain and the biomarkers levels, conditional on the binary status, as an autoregressive process, yielding a dynamic scoring procedure for predicting the occurrence of a spike. Based on the resulting prediction rule, we propose several natural extensions of the ROC curve to the longitudinal setting and describe procedures for statistical inference. Lastly, extensive simulations have been conducted to examine the small sample operational characteristics of the proposed methods.

[1]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[2]  John A. Swets,et al.  Evaluation of diagnostic systems : methods from signal detection theory , 1982 .

[3]  G. Robinson That BLUP is a Good Thing: The Estimation of Random Effects , 1991 .

[4]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[5]  A. Azzalini Logistic regression for autocorrelated data with application to repeated measures , 1994 .

[6]  T. Lumley,et al.  Time‐Dependent ROC Curves for Censored Survival Data and a Diagnostic Marker , 2000, Biometrics.

[7]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[8]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[9]  Jason Wittenberg,et al.  Clarify: Software for Interpreting and Presenting Statistical Results , 2003 .

[10]  Honghu Liu,et al.  Estimating the Area under a Receiver Operating Characteristic Curve For Repeated Measures Design , 2003 .

[11]  Yingye Zheng,et al.  Semiparametric estimation of time-dependent ROC curves for longitudinal marker data. , 2004, Biostatistics.

[12]  P. Heagerty,et al.  Survival Model Predictive Accuracy and ROC Curves , 2005, Biometrics.

[13]  Tianxi Cai,et al.  Evaluating Prediction Rules for t-Year Survivors With Censored Regression Models , 2007 .

[14]  W. Andiman,et al.  Absolute CD4+ T-Lymphocyte Count as a Surrogate Marker of Pediatric Human Immunodeficiency Virus Disease Progression , 2008, The Pediatric infectious disease journal.

[15]  M. Pencina,et al.  Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond , 2008, Statistics in medicine.

[16]  Gary Longton,et al.  Accommodating Covariates in Receiver Operating Characteristic Analysis , 2009 .

[17]  L. Montaner,et al.  Prediction based classification for longitudinal biomarkers. , 2010, The annals of applied statistics.

[18]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[19]  Paul S Albert,et al.  A linear mixed model for predicting a binary event from longitudinal data under random effects misspecification , 2012, Statistics in medicine.

[20]  Lu Tian,et al.  A unified inference procedure for a class of measures to assess improvement in risk prediction systems with survival data , 2013, Statistics in medicine.

[21]  Danping Liu,et al.  Combination of longitudinal biomarkers in predicting binary events. , 2014, Biostatistics.

[22]  Mauricio Santillana,et al.  Accurate estimation of influenza epidemics using Google search data via ARGO , 2015, Proceedings of the National Academy of Sciences.

[23]  W. Andiman,et al.  Frequent Episodes of Detectable Viremia in HIV Treatment-Experienced Children is Associated with a Decline in CD4+ T-cells Over Time. , 2016, Journal of AIDS & clinical research.

[24]  Gang Li,et al.  Testing Statistical Significance of the Area under a Receiving Operating Characteristics Curve for Repeated Measures Design with Bootstrapping , 2005, Journal of Data Science.