Measuring the Performance of Markers for Guiding Treatment Decisions

Treatment selection markers, sometimes called predictive markers, are factors that help clinicians select therapies that maximize good outcomes and minimize adverse outcomes for patients. Existing statistical methods for evaluating a treatment selection marker include assessing its prognostic value, evaluating treatment effects in patients with a restricted range of marker values, and testing for a statistical interaction between marker value and treatment. These methods are inadequate, because they give misleading measures of performance that do not answer key clinical questions about how the marker might help patients choose treatment, how treatment decisions should be made on the basis of a continuous marker measurement, what effect using the marker to select treatment would have on the population, or what proportion of patients would have treatment changes on the basis of marker measurement. Marker-by-treatment predictiveness curves are proposed as a more useful aid to answering these clinically relevant questions, because they illustrate treatment effects as a function of marker value, outcomes when using or not using the marker to select treatment, and the proportion of patients for whom treatment recommendations change after marker measurement. Randomized therapeutic clinical trials, in which entry criteria and treatment regimens are not restricted by the marker, are also proposed as the basis for constructing the curves and evaluating and comparing markers.

[1]  Dongsheng Tu,et al.  K-ras mutations and benefit from cetuximab in advanced colorectal cancer. , 2008, The New England journal of medicine.

[2]  Ziding Feng,et al.  Evaluating the Predictiveness of a Continuous Marker , 2007, Biometrics.

[3]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[4]  Robert B Livingston,et al.  Prognostic and predictive value of the 21-gene recurrence score assay in postmenopausal women with node-positive, oestrogen-receptor-positive breast cancer on chemotherapy: a retrospective analysis of a randomised trial. , 2010, The Lancet. Oncology.

[5]  Margaret Sullivan Pepe,et al.  Evaluating Markers for Selecting a Patient's Treatment , 2004, Biometrics.

[6]  R. Simon,et al.  Adaptive Signature Design: An Adaptive Clinical Trial Design for Generating and Prospectively Testing A Gene Expression Signature for Sensitive Patients , 2005, Clinical Cancer Research.

[7]  L. Schwartz,et al.  Cetuximab shows activity in colorectal cancer patients with tumors that do not express the epidermal growth factor receptor by immunohistochemistry. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[8]  N. Cook Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[9]  Daniel J Sargent,et al.  Clinical trial designs for predictive marker validation in cancer treatment trials. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[10]  A. Cohn,et al.  Impact of a commercial reference laboratory test recurrence score on decision making in early-stage breast cancer. , 2007, Journal of oncology practice.

[11]  M. Cronin,et al.  Gene expression and benefit of chemotherapy in women with node-negative, estrogen receptor-positive breast cancer. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[12]  Ralph H Stern,et al.  Evaluating New Cardiovascular Risk Factors for Risk Stratification , 2008, Journal of clinical hypertension.

[13]  Richard Simon,et al.  The Use of Genomics in Clinical Trial Design , 2008, Clinical Cancer Research.

[14]  S. Martino,et al.  Adjuvant chemotherapy and timing of tamoxifen in postmenopausal patients with endocrine-responsive, node-positive breast cancer: a phase 3, open-label, randomised controlled trial , 2009, The Lancet.

[15]  T. Trikalinos,et al.  Systematic Review: Anti–Epidermal Growth Factor Receptor Treatment Effect Modification by KRAS Mutations in Advanced Colorectal Cancer , 2011, Annals of Internal Medicine.

[16]  W T McGivney,et al.  The National Comprehensive Cancer Network , 1998, Cancer.

[17]  Marc Buyse,et al.  Towards validation of statistically reliable biomarkers , 2007 .

[18]  Richard Simon,et al.  Development and Validation of Biomarker Classifiers for Treatment Selection. , 2008, Journal of statistical planning and inference.

[19]  M. Dowsett,et al.  International Web-based consultation on priorities for translational breast cancer research , 2007, Breast Cancer Research.

[20]  Andrew J Vickers,et al.  Method for evaluating prediction models that apply the results of randomized trials to individual patients , 2007, Trials.

[21]  M. Bonetti,et al.  Evaluation of treatment-effect heterogeneity using biomarkers measured on a continuous scale: subpopulation treatment effect pattern plot. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[22]  P. Qiu The Statistical Evaluation of Medical Tests for Classification and Prediction , 2005 .

[23]  Yingye Zheng,et al.  Integrating the predictiveness of a marker with its performance as a classifier. , 2007, American journal of epidemiology.

[24]  Y Wang,et al.  Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15-year survival: an overview of the randomised trials , 2005, The Lancet.

[25]  Soonmyung Paik,et al.  Use of archived specimens in evaluation of prognostic and predictive biomarkers. , 2009, Journal of the National Cancer Institute.

[26]  Armando Santoro,et al.  Cetuximab monotherapy and cetuximab plus irinotecan in irinotecan-refractory metastatic colorectal cancer. , 2004, The New England journal of medicine.

[27]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .