ROC analysis in biomarker combination with covariate adjustment.

RATIONAL AND OBJECTIVES Receiver operating characteristic (ROC) analysis is often used to find the optimal combination of biomarkers. When the subject level covariates affect the magnitude and/or accuracy of the biomarkers, the combination rule should take into account of the covariate adjustment. The authors propose two new biomarker combination methods that make use of the covariate information. MATERIALS AND METHODS The first method is to maximize the area under the covariate-adjusted ROC curve (AAUC). To overcome the limitations of the AAUC measure, the authors further proposed the area under covariate-standardized ROC curve (SAUC), which is an extension of the covariate-specific ROC curve. With a series of simulation studies, the proposed optimal AAUC and SAUC methods are compared with the optimal AUC method that ignores the covariates. The biomarker combination methods are illustrated by an example from Alzheimer's disease research. RESULTS The simulation results indicate that the optimal AAUC combination performs well in the current study population. The optimal SAUC method is flexible to choose any reference populations, and allows the results to be generalized to different populations. CONCLUSIONS The proposed optimal AAUC and SAUC approaches successfully address the covariate adjustment problem in estimating the optimal marker combination. The optimal SAUC method is preferred for practical use, because the biomarker combination rule can be easily evaluated for different population of interest.

[1]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[2]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[3]  M. Pepe,et al.  Combining diagnostic test results to increase accuracy. , 2000, Biostatistics.

[4]  Xiao-Hua Zhou,et al.  Covariate Adjustment in Estimating the Area Under ROC Curve with Partially Missing Gold Standard , 2013, Biometrics.

[5]  Chunling Liu,et al.  A min–max combination of biomarkers to improve diagnostic accuracy , 2011, Statistics in medicine.

[6]  Lori E. Dodd,et al.  Semiparametric Regression for the Area Under the Receiver Operating Characteristic Curve , 2003 .

[7]  Jun S. Liu,et al.  Linear Combinations of Multiple Diagnostic Markers , 1993 .

[8]  Holly Janes,et al.  Adjusting for covariate effects on classification accuracy using the covariate-adjusted receiver operating characteristic curve. , 2009, Biometrika.

[9]  Danping Liu,et al.  Semiparametric estimation of the covariate-specific ROC curve in presence of ignorable verification bias. , 2011, Biometrics.

[10]  Holly Janes,et al.  Practice of Epidemiology Adjusting for Covariates in Studies of Diagnostic, Screening, or Prognostic Markers: an Old Concept in a New Setting , 2022 .

[11]  Yulei Jiang,et al.  Effect of correlation on combining diagnostic information from two images of the same patient. , 2005, Medical physics.

[12]  Lorenzo L. Pesce,et al.  On the convexity of ROC curves estimated from radiological test results. , 2010, Academic radiology.

[13]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[14]  Yulei Jiang,et al.  A quadratic model for combining quantitative diagnostic assessments from radiologist and computer in computer-aided diagnosis. , 2006, Academic radiology.

[15]  M S Pepe,et al.  Three approaches to regression analysis of receiver operating characteristic curves for continuous test results. , 1998, Biometrics.

[16]  K. Zou,et al.  Statistical combination schemes of repeated diagnostic test data. , 2006, Academic radiology.