Unified Least Squares Methods for the Evaluation of Diagnostic Tests With the Gold Standard

The article proposes a unified least squares method to estimate the receiver operating characteristic (ROC) parameters for continuous and ordinal diagnostic tests, such as cancer biomarkers. The method is based on a linear model framework using the empirically estimated sensitivities and specificities as input “data.” It gives consistent estimates for regression and accuracy parameters when the underlying continuous test results are normally distributed after some monotonic transformation. The key difference between the proposed method and the method of Tang and Zhou lies in the response variable. The response variable in the latter is transformed empirical ROC curves at different thresholds. It takes on many values for continuous test results, but few values for ordinal test results. The limited number of values for the response variable makes it impractical for ordinal data. However, the response variable in the proposed method takes on many more distinct values so that the method yields valid estimates for ordinal data. Extensive simulation studies are conducted to investigate and compare the finite sample performance of the proposed method with an existing method, and the method is then used to analyze 2 real cancer diagnostic example as an illustration.

[1]  Margaret Sullivan Pepe,et al.  Contrasting Two Frameworks for ROC Analysis of Ordinal Ratings , 2010, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  J. Hanley The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[3]  A. Hongo,et al.  Expression of hepatocyte growth factor activator inhibitors (HAI-1 and HAI-2) in ovarian cancer. , 2009, International journal of oncology.

[4]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[5]  B. Turnbull,et al.  NONPARAMETRIC AND SEMIPARAMETRIC ESTIMATION OF THE RECEIVER OPERATING CHARACTERISTIC CURVE , 1996 .

[6]  Douglas C McCrory,et al.  Noninvasive staging of non-small cell lung cancer: a review of the current evidence. , 2003, Chest.

[7]  F. Xu,et al.  Expression changes in epithelial cell adhesion molecule during colorectal cancer tumorigenesis. , 2015, Genetics and molecular research : GMR.

[8]  Marcus Schmidt,et al.  Overexpression of epithelial cell adhesion molecule protein is associated with favorable prognosis in an unselected cohort of ovarian cancer patients , 2014, Journal of Cancer Research and Clinical Oncology.

[9]  G. Silvestri,et al.  One from column A: choosing between CT, positron emission tomography, endoscopic ultrasound with fine-needle aspiration, transbronchial needle aspiration, thoracoscopy, mediastinoscopy, and mediastinotomy for staging lung cancer. , 2003, Chest.

[10]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[11]  Ying Huang,et al.  A Linear Regression Framework for the Receiver Operating Characteristic (ROC) Curve Analysis. , 2012, Journal of biometrics & biostatistics.

[12]  M. Schummer,et al.  Selecting Differentially Expressed Genes from Microarray Experiments , 2003, Biometrics.

[13]  C A Roe,et al.  Statistical Comparison of Two ROC-curve Estimates Obtained from Partially-paired Datasets , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  D. Albertson,et al.  DNA profiling of primary serous ovarian and Fallopian tube carcinomas with array comparative genomic hybridization and multiplex ligation‐dependent probe amplification , 2007, The Journal of pathology.

[15]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[16]  Michael K Gould,et al.  Noninvasive staging of non-small cell lung cancer: ACCP evidenced-based clinical practice guidelines (2nd edition). , 2007, Chest.

[17]  Xiao-Hua Zhou,et al.  Semiparametric Inferential Procedures for Comparing Multivariate ROC Curves with Interaction Terms , 2008 .

[18]  D. Dorfman,et al.  Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals—Rating-method data , 1969 .

[19]  B. W. Turnbull,et al.  Non- and Semi-Parametric Estimation of the Receiver Operating Characteristic (ROC) Curve , 1992 .

[20]  C. Metz,et al.  A New Approach for Testing the Significance of Differences Between ROC Curves Measured from Correlated Data , 1984 .

[21]  S. Walter,et al.  Estimating the error rates of diagnostic tests. , 1980, Biometrics.

[22]  H. Klocker,et al.  EpCAM is overexpressed in local and metastatic prostate cancer, suppressed by chemotherapy and modulated by MET-associated miRNA-200c/205 , 2014, British Journal of Cancer.

[23]  Mitchell H. Gail,et al.  A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data , 1989 .

[24]  Liansheng Larry Tang,et al.  A Semiparametric Separation Curve Approach for Comparing Correlated ROC Data From Multiple Markers , 2012, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.