An Approach to Evaluating and Comparing Biomarkers for Patient Treatment Selection

Abstract Despite the heightened interest in developing biomarkers predicting treatment response that are used to optimize patient treatment decisions, there has been relatively little development of statistical methodology to evaluate these markers. There is currently no unified statistical framework for marker evaluation. This paper proposes a suite of descriptive and inferential methods designed to evaluate individual markers and to compare candidate markers. An R software package has been developed which implements these methods. Their utility is illustrated in the breast cancer treatment context, where candidate markers are evaluated for their ability to identify a subset of women who do not benefit from adjuvant chemotherapy and can therefore avoid its toxicity.

[1]  Y. Benjamini,et al.  False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected Parameters , 2005 .

[2]  M. Cronin,et al.  Gene expression and benefit of chemotherapy in women with node-negative, estrogen receptor-positive breast cancer. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[3]  Margaret Pepe,et al.  Measures to Summarize and Compare the Predictive Capacity of Markers , 2009, The international journal of biostatistics.

[4]  Na Zhang,et al.  Variable Selection for Optimal Treatment Regimes. , 2014 .

[5]  Holly Janes,et al.  Measuring the Performance of Markers for Guiding Treatment Decisions , 2011, Annals of Internal Medicine.

[6]  M. Cronin,et al.  A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. , 2004, The New England journal of medicine.

[7]  Eric B. Laber,et al.  A Robust Method for Estimating Optimal Treatment Regimes , 2012, Biometrics.

[8]  M. Gail,et al.  Testing for qualitative interactions between treatment effects and patient subsets. , 1985, Biometrics.

[9]  Ziding Feng,et al.  Evaluating the Predictiveness of a Continuous Marker , 2007, Biometrics.

[10]  Wenbin Lu,et al.  Variable selection for optimal treatment decision , 2013, Statistical methods in medical research.

[11]  Jason Brinkley,et al.  A Generalized Estimator of the Attributable Benefit of an Optimal Treatment Regime , 2010, Biometrics.

[12]  C. Begg,et al.  One statistical test is sufficient for assessing new predictive markers , 2011, BMC Medical Research Methodology.

[13]  Jim Hunter,et al.  Proceedings of the 11th conference on Artificial Intelligence in Medicine , 2005 .

[14]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[15]  Thomas Lumley,et al.  American Journal of Epidemiology Practice of Epidemiology Evaluating the Incremental Value of New Biomarkers with Integrated Discrimination Improvement , 2022 .

[16]  Ji Zhu,et al.  Variable Selection for Optimal Decision Making , 2007, AIME.

[17]  Holly Janes,et al.  A Framework for Evaluating Markers Used to Select Patient Treatment , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[18]  R. Pyke,et al.  Logistic disease incidence models and case-control studies , 1979 .

[19]  Kathleen F. Kerr,et al.  Net reclassification indices for evaluating risk prediction instruments: a critical review. , 2014, Epidemiology.

[20]  Yu-Ming Shen.  Assessing Treatment-Selection Markers using a Potential Outcomes Framework , 2014 .

[21]  M. Bonetti,et al.  Patterns of treatment effects in subsets of patients in clinical trials. , 2004, Biostatistics.

[22]  Lihui Zhao,et al.  Estimating Subject-Specific Treatment Differences for Risk-Benefit Assessment with Competing Risk Event-Time Data , 2011 .

[23]  S. Martino,et al.  Adjuvant chemotherapy and timing of tamoxifen in postmenopausal patients with endocrine-responsive, node-positive breast cancer: a phase 3, open-label, randomised controlled trial , 2009, The Lancet.

[24]  Kathleen F. Kerr,et al.  Testing for improvement in prediction model performance , 2013, Statistics in medicine.

[25]  M S Pepe,et al.  Semiparametric methods for evaluating the covariate‐specific predictiveness of continuous markers in matched case–control studies , 2010, Journal of the Royal Statistical Society. Series C, Applied statistics.

[26]  L. Tian,et al.  Analysis of randomized comparative clinical trial data for personalized treatment selections. , 2011, Biostatistics.

[27]  Ralph B D'Agostino,et al.  Misuse of DeLong test to compare AUCs for nested models , 2012, Statistics in medicine.

[28]  S. Murphy,et al.  PERFORMANCE GUARANTEES FOR INDIVIDUALIZED TREATMENT RULES. , 2011, Annals of statistics.

[29]  J. M. Taylor,et al.  Subgroup identification from randomized clinical trial data , 2011, Statistics in medicine.

[30]  P. Royston,et al.  A new approach to modelling interactions between treatment and continuous covariates in clinical trials by using fractional polynomials , 2004, Statistics in medicine.

[31]  Robert B Livingston,et al.  Prognostic and predictive value of the 21-gene recurrence score assay in postmenopausal women with node-positive, oestrogen-receptor-positive breast cancer on chemotherapy: a retrospective analysis of a randomised trial. , 2010, The Lancet. Oncology.

[32]  Margaret Sullivan Pepe,et al.  Evaluating Markers for Selecting a Patient's Treatment , 2004, Biometrics.

[33]  V. Seshan,et al.  Comparing ROC curves derived from regression models , 2013, Statistics in medicine.

[34]  Lacey Gunter,et al.  Variable Selection for Qualitative Interactions in Personalized Medicine While Controlling the Family-Wise Error Rate , 2011, Journal of biopharmaceutical statistics.

[35]  K. Jirström,et al.  Low ERK Phosphorylation in Cancer-Associated Fibroblasts Is Associated with Tamoxifen Resistance in Pre-Menopausal Breast Cancer , 2012, PloS one.

[36]  青儀 健二郎,et al.  What's going on 乳癌 Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15-year survival: an overview of the randomised trials. Early Breast Cancer Trialists' Collaborative Group(EBCTCG). Lancet. 2005; 365: 1687-717. PMID: 15894097.--早期乳癌に対する化学療法・内分泌療法が乳癌再発・15年生存率に及 , 2006 .

[37]  Lu Tian,et al.  Effectively Selecting a Target Population for a Future Comparative Study , 2013, Journal of the American Statistical Association.

[38]  Holly Janes,et al.  Methods for Evaluating Prediction Performance of Biomarkers and Tests , 2013 .

[39]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[40]  D. Hosmer,et al.  A review of goodness of fit statistics for use in the development of logistic regression models. , 1982, American journal of epidemiology.

[41]  Margaret Sullivan Pepe,et al.  Assessing risk prediction models in case–control studies using semiparametric and nonparametric methods , 2010, Statistics in medicine.

[42]  B. Kramer,et al.  Statistics for weighing benefits and harms in a proposed genetic substudy of a randomized cancer prevention trial , 2005 .

[43]  M. Dowsett,et al.  International Web-based consultation on priorities for translational breast cancer research , 2007, Breast Cancer Research.

[44]  J. van Eys,et al.  Interaction between prognostic factors and treatment. , 1983, Controlled clinical trials.

[45]  Andrew J Vickers,et al.  Method for evaluating prediction models that apply the results of randomized trials to individual patients , 2007, Trials.

[46]  R. Gelber,et al.  Prognostic interaction between expression of p53 and estrogen receptor in patients with node-negative breast cancer: results from IBCSG Trials VIII and IX , 2012, Breast Cancer Research.

[47]  Didier Frappaz,et al.  Temozolomide versus standard 6-week radiotherapy versus hypofractionated radiotherapy in patients older than 60 years with glioblastoma: the Nordic randomised, phase 3 trial. , 2012, The Lancet. Oncology.

[48]  Richard Simon,et al.  Lost in translation: problems and pitfalls in translating laboratory observations to clinical utility. , 2008, European journal of cancer.