Using the ROC curve for gauging treatment effect in clinical trials

Non-parametric procedures such as the Wilcoxon rank-sum test, or equivalently the Mann-Whitney test, are often used to analyse data from clinical trials. These procedures enable testing for treatment effect, but traditionally do not account for covariates. We adapt recently developed methods for receiver operating characteristic (ROC) curve regression analysis to extend the Mann-Whitney test to accommodate covariate adjustment and evaluation of effect modification. Our approach naturally extends use of the Mann-Whitney statistic in a fashion that is analogous to how linear models extend the t-test. We illustrate the methodology with data from clinical trials of a therapy for Cystic Fibrosis.

[1]  J. L. Hodges,et al.  The Efficiency of Some Nonparametric Competitors of the t-Test , 1956 .

[2]  P. Rothwell.  Subgroup analysis in randomised controlled trials: importance, indications, and interpretation , 2005, The Lancet.

[3]  R. Iman,et al.  Rank Transformations as a Bridge between Parametric and Nonparametric Statistics , 1981 .

[4]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[5]  S. Pocock,et al.  Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practiceand problems , 2002, Statistics in medicine.

[6]  J. Hanley.  Receiver operating characteristic (ROC) methodology: the state of the art. , 1989, Critical reviews in diagnostic imaging.

[7]  Lori E. Dodd,et al.  Semiparametric Regression for the Area Under the Receiver Operating Characteristic Curve , 2003 .

[8]  W W Hauck,et al.  Should we adjust for covariates in nonlinear regression analyses of randomized trials? , 1998, Controlled clinical trials.

[9]  C B Begg,et al.  A General Regression Methodology for ROC Curve Estimation , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  T Hyslop,et al.  Generalized treatment effects for clinical trials. , 2000, Statistics in medicine.

[11]  R L Iman,et al.  Analysis of covariance using the rank transformation. , 1982, Biometrics.

[12]  Margaret S. Pepe,et al.  A regression modelling framework for receiver operating characteristic curves in medical diagnostic testing , 1997 .

[13]  D. DeMets,et al.  Fundamentals of Clinical Trials , 1982 .

[14]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[15]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[16]  P Armitage,et al.  Importance of prognostic factors in the analysis of data from clinical trials. , 1981, Controlled clinical trials.

[17]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[18]  John A. Swets,et al.  Evaluation of diagnostic systems : methods from signal detection theory , 1982 .

[19]  M S Pepe,et al.  Intermittent administration of inhaled tobramycin in patients with cystic fibrosis. Cystic Fibrosis Inhaled Tobramycin Study Group. , 1999, The New England journal of medicine.

[20]  P. O'Brien,et al.  Comparing Two Samples: Extensions of the t, Rank-Sum, and Log-Rank Tests , 1988 .

[21]  A. Cantin,et al.  Cystic fibrosis lung inflammation: early, sustained, and severe. , 1995, American journal of respiratory and critical care medicine.

[22]  C Brownie,et al.  A rank-based mixed model approach to multisite clinical trials. , 1992, Biometrics.

[23]  D. Bamber.  The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[24]  J. J. Higgins,et al.  A Comparison of the Power of Wilcoxon's Rank-Sum Statistic to that of Student'st Statistic Under Various Nonnormal Distributions , 1980 .

[25]  Margaret Sullivan Pepe,et al.  The Analysis of Placement Values for Evaluating Discriminatory Measures , 2004, Biometrics.

[26]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[27]  Douglas A. Wolfe,et al.  On Constructing Statistics and Reporting Data , 1971 .

[28]  David Faraggi,et al.  Adjusting receiver operating characteristic curves and related indices for covariates , 2003 .

[29]  W W Hauck,et al.  A consequence of omitted covariates when estimating odds ratios. , 1991, Journal of clinical epidemiology.