nsROC: An R package for Non-Standard ROC Curve Analysis

The receiver operating characteristic (ROC) curve is a graphical method which has become standard in the analysis of diagnostic markers, that is, in the study of the classification ability of a numerical variable. Most of the commercial statistical software provide routines for the standard ROC curve analysis. Of course, there are also many R packages dealing with the ROC estimation as well as other related problems. In this work we introduce the nsROC package which incorporates some new ROC curve procedures. Particularly: ROC curve comparison based on general distances among functions for both paired and unpaired designs; efficient confidence bands construction; a generalization of the curve considering different classification subsets than the one involved in the classical definition of the ROC curve; a procedure to deal with censored data in cumulative-dynamic ROC curve estimation for time-to-event outcomes; and a non-parametric ROC curve method for meta-analysis. This is the only R package which implements these particular procedures.

[1]  Sofus A. Macskassy,et al.  Confidence Bands for Roc Curves , 2003 .

[2]  P. Martínez-Camblor,et al.  Efficient nonparametric confidence bands for receiver operating-characteristic curves , 2018, Statistical methods in medical research.

[3]  D. Mossman.  Three-way ROCs , 1999, Medical decision making : an international journal of the Society for Medical Decision Making.

[4]  A. Dreher.  Modeling Survival Data Extending The Cox Model , 2016 .

[5]  Foster J. Provost,et al.  ROC confidence bands: an empirical evaluation , 2005, ICML.

[6]  P. Heagerty,et al.  Survival Model Predictive Accuracy and ROC Curves , 2005, Biometrics.

[7]  Luzia Gonçalves,et al.  ROC curve estimation: An overview , 2014 .

[8]  P. Bossuyt,et al.  Meta-analysis of diagnostic test accuracy. , 2006, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[9]  E. Venkatraman,et al.  A Permutation Test to Compare Receiver Operating Characteristic Curves , 2000, Biometrics.

[10]  Eugene Demidenko,et al.  Confidence intervals and bands for the binormal ROC curve revisited , 2012, Journal of applied statistics.

[11]  Gerta Rücker,et al.  Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies , 2016, BMC Medical Research Methodology.

[12]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[13]  Pablo Martínez-Camblor,et al.  Fully non-parametric receiver operating characteristic curve estimation for random-effects meta-analysis , 2017, Statistical methods in medical research.

[14]  T. Greene,et al.  A simple method to estimate the time-dependent receiver operating characteristic curve and the area under the curve with right censored data , 2018, Statistical methods in medical research.

[15]  P. Martínez-Camblor,et al.  Powerful nonparametric statistics to compare k independent ROC curves , 2011 .

[16]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[17]  Carlos Carleos,et al.  General nonparametric ROC curve comparison , 2013 .

[18]  T. Lumley,et al.  Time‐Dependent ROC Curves for Censored Survival Data and a Diagnostic Marker , 2000, Biometrics.

[19]  Gustavo F. Bayón,et al.  Cumulative/dynamic ROC curve estimation , 2016 .

[20]  S. Basov.  Simulation and Inference for Stochastic Differential Equations: With R Examples , 2010 .

[21]  Johannes B Reitsma,et al.  Meta-Analysis of Diagnostic Studies: A Comparison of Random Intercept, Normal-Normal, and Binomial-Normal Bivariate Summary ROC Approaches , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  Norberto Corral,et al.  Receiver operating characteristic curve generalization for non-monotone relationships , 2017, Statistical methods in medical research.

[23]  Tianxi Cai,et al.  Semi-parametric ROC regression analysis with placement values. , 2004, Biostatistics.

[24]  Carmen Cadarso-Suárez,et al.  Comparative study of ROC regression techniques - Applications for the computer-aided diagnostic system in breast cancer detection , 2011, Comput. Stat. Data Anal..

[25]  E. S. Venkatraman,et al.  A distribution-free procedure for comparing receiver operating characteristic curves from a paired experiment , 1996 .

[26]  P. Martínez-Camblor,et al.  A general bootstrap algorithm for hypothesis testing , 2012 .

[27]  B. Reiser,et al.  Estimation of the Youden Index and its Associated Cutoff Point , 2005, Biometrical journal. Biometrische Zeitschrift.

[28]  Oliver Kuss,et al.  Meta-analysis for the comparison of two diagnostic tests to a common gold standard: A generalized linear mixed model approach , 2018, Statistical methods in medical research.

[29]  H. Schäfer,et al.  Regional confidence bands for ROC curves. , 2000, Statistics in medicine.

[30]  R. Riley,et al.  Meta-analysis of individual participant data: rationale, conduct, and reporting , 2010, BMJ : British Medical Journal.

[31]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[32]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[33]  Daniel Zelterman,et al.  Modeling Survival Data: Extending the Cox Model , 2002, Technometrics.

[34]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[35]  Pablo Martínez-Camblor,et al.  Parametric estimates for the receiver operating characteristic curve generalization for non-monotone relationships , 2019, Statistical methods in medical research.

[36]  O. Mangasarian,et al.  Robust linear programming discrimination of two linearly inseparable sets , 1992 .

[37]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[38]  Jean-François Dartigues,et al.  Estimating and comparing time‐dependent areas under receiver operating characteristic curves for censored event times with competing risks , 2013, Statistics in medicine.