Receiver-operating characteristic curve analysis in diagnostic, prognostic and predictive biomarker research

#### Take-home messages From a clinical perspective, biomarkers may have a variety of functions, which correspond to different stages (table 1) in disease development, such as in the progression in cancer or cardiovascular disease.1 2 Biomarkers can assist in the care of patients who are asymptomatic (screening biomarkers), those who are suspected to have the disease (diagnostic biomarkers) and those with overt disease (prognostic biomarkers) for whom therapy may or may not have been initiated. Biomarkers can also be used for treatment response (predictive biomarkers) or surveillance after therapy (monitoring biomarkers). Fundamental for the use of biomarkers in all situations is biomarker accuracy—the ability to correctly classify one condition and/or outcome from another (eg, healthy versus diseased). View this table: Table 1 Clinical use of biomarkers: rationale and objectives for use of cancer biomarkers For the clinician, diagnostic testing plays a fundamental role in clinical practice. For instance, daily surgical decision making is based on the correct classification by pathology, radiology and/or clinical chemistry reports involving tissue and/or image evaluation and interpretation of disease conditions—in many decisions the interpretation is based on results in the “grey-area” although requiring “black-and-white” answers for choice of treatment (fig 1). Further, predictive modelling to estimate expected outcomes such as mortality or adverse events based on patient risk characteristics is common in any type of clinical research. Receiver-operating characteristic (ROC) …

[1]  S. Baker The central role of receiver operating characteristic (ROC) curves in evaluating tests for the early detection of cancer. , 2005, Journal of the National Cancer Institute.

[2]  J. Musial,et al.  Clinical significance of antiphospholipid protein antibodies. Receiver operating characteristics plot analysis. , 2003, Journal of Rheumatology.

[3]  Margaret Sullivan Pepe,et al.  Insights into latent class analysis of diagnostic test performance. , 2007, Biostatistics.

[4]  Hao Liu,et al.  On the analysis of glycomics mass spectrometry data via the regularized area under the ROC curve , 2007, BMC Bioinformatics.

[5]  Holly Janes,et al.  Practice of Epidemiology Adjusting for Covariates in Studies of Diagnostic, Screening, or Prognostic Markers: an Old Concept in a New Setting , 2022 .

[6]  M. Pepe,et al.  Insights into Latent Class Analysis , 2005 .

[7]  Klaus Jung,et al.  Comparison of eight computer programs for receiver-operating characteristic analysis. , 2003, Clinical chemistry.

[8]  M S Pepe,et al.  Phases of biomarker development for early detection of cancer. , 2001, Journal of the National Cancer Institute.

[9]  F A Langley,et al.  The use of ROC curves in histopathologic decision making. , 1985, Analytical and quantitative cytology and histology.

[10]  J R Beck,et al.  Decision-making Studies in Patient Management , 1991, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  W S A Smellie When is “abnormal” abnormal? Dealing with the slightly out of range laboratory result , 2006, Journal of Clinical Pathology.

[12]  Margaret S Pepe,et al.  Gauging the performance of SNPs, biomarkers, and clinical factors for predicting risk of breast cancer. , 2008, Journal of the National Cancer Institute.

[13]  M S Pepe,et al.  Evaluating technologies for classification and prediction in medicine , 2005, Statistics in medicine.

[14]  J. Ware The limitations of risk factors as prognostic tools. , 2006, The New England journal of medicine.

[15]  N. Obuchowski,et al.  ROC curves in clinical chemistry: uses, misuses, and possible solutions. , 2004, Clinical chemistry.

[16]  Thomas J. Wang,et al.  The search for new cardiovascular biomarkers , 2008, Nature.

[17]  Holly Janes,et al.  The optimal ratio of cases to controls for estimating the classification accuracy of a biomarker. , 2006, Biostatistics.

[18]  H. Körner,et al.  Metachronous cancer development in patients with sporadic colorectal adenomas—multivariate risk model with independent and combined value of hTERT and survivin , 2008, International Journal of Colorectal Disease.

[19]  H. Körner,et al.  Diagnostic Accuracy of Serum-Carcinoembryonic Antigen in Recurrent Colorectal Cancer: A Receiver Operating Characteristic Curve Analysis , 2007, Annals of Surgical Oncology.

[20]  Lori E. Dodd,et al.  Partial AUC Estimation and Regression , 2003, Biometrics.

[21]  D. Ransohoff Bias as a threat to the validity of cancer molecular-marker research , 2005, Nature reviews. Cancer.

[22]  T. Walley,et al.  Evaluating laboratory diagnostic tests , 2008, BMJ : British Medical Journal.

[23]  N. Cook Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. , 2008, Clinical chemistry.

[24]  J. Hanley Receiver operating characteristic (ROC) methodology: the state of the art. , 1989, Critical reviews in diagnostic imaging.

[25]  T. Cai,et al.  Combining Predictors for Classification Using the Area under the Receiver Operating Characteristic Curve , 2006, Biometrics.

[26]  D. Ransohoff Rules of evidence for cancer molecular-marker discovery and validation , 2004, Nature Reviews Cancer.

[27]  Chen-Tuo Liao,et al.  A non‐inferiority test for diagnostic accuracy based on the paired partial areas under ROC curves , 2008, Statistics in medicine.

[28]  Ying Huang,et al.  Evaluating the ROC performance of markers for future events , 2008, Lifetime data analysis.

[29]  R. Steele,et al.  Selecting immunohistochemical cut-off scores for novel biomarkers of progression and survival in colorectal cancer , 2006, Journal of Clinical Pathology.

[30]  K. Zou,et al.  Receiver-Operating Characteristic Analysis for Evaluating Diagnostic Tests and Predictive Models , 2007, Circulation.

[31]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[32]  András Kocsor,et al.  ROC analysis: applications to the classification of biological sequences and 3D structures , 2008, Briefings Bioinform..

[33]  Robert D. Clark,et al.  Managing bias in ROC curves , 2008, J. Comput. Aided Mol. Des..

[34]  Tianxi Cai,et al.  Application of the Time‐Dependent ROC Curves for Prognostic Accuracy with Multiple Biomarkers , 2006, Biometrics.

[35]  S D Walter,et al.  Studies reporting ROC curves of diagnostic and prediction data can be incorporated into meta-analyses using corresponding odds ratios. , 2007, Journal of clinical epidemiology.

[36]  Jialiang Li,et al.  ROC analysis with multiple classes and multiple tests: methodology and its application in microarray studies. , 2008, Biostatistics.

[37]  M. Muselli,et al.  ROC curves are a suitable and flexible tool for the analysis of gene expression profiles , 2003, Cytogenetic and Genome Research.

[38]  Kjetil Søreide,et al.  Evolving molecular classification by genomic and proteomic biomarkers in colorectal cancer: potential implications for the surgical oncologist. , 2009, Surgical oncology.

[39]  Douglas G Altman,et al.  Reporting recommendations for tumor marker prognostic studies. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[40]  Jon C Ison,et al.  ROCPLOT: a generic software tool for ROC analysis and the validation of predictive methods. , 2005, Applied bioinformatics.

[41]  M. Altschuler,et al.  Using the receiver operating characteristic curve to select pretreatment and pathologic predictors for early and late postprostatectomy PSA failure. , 2001, Urology.