Statistical evaluation of surrogate endpoints with examples from cancer clinical trials

A surrogate endpoint is intended to replace a clinical endpoint for the evaluation of new treatments when it can be measured more cheaply, more conveniently, more frequently, or earlier than that clinical endpoint. A surrogate endpoint is expected to predict clinical benefit, harm, or lack of these. Besides the biological plausibility of a surrogate, a quantitative assessment of the strength of evidence for surrogacy requires the demonstration of the prognostic value of the surrogate for the clinical outcome, and evidence that treatment effects on the surrogate reliably predict treatment effects on the clinical outcome. We focus on these two conditions, and outline the statistical approaches that have been proposed to assess the extent to which these conditions are fulfilled. When data are available from a single trial, one can assess the "individual level association" between the surrogate and the true endpoint. When data are available from several trials, one can additionally assess the "trial level association" between the treatment effect on the surrogate and the treatment effect on the true endpoint. In the latter case, the "surrogate threshold effect" can be estimated as the minimum effect on the surrogate endpoint that predicts a statistically significant effect on the clinical endpoint. All these concepts are discussed in the context of randomized clinical trials in oncology, and illustrated with two meta-analyses in gastric cancer.

[1]  H. Sandler,et al.  Posttreatment prostatic-specific antigen doubling time as a surrogate endpoint for prostate cancer-specific survival: an analysis of Radiation Therapy Oncology Group Protocol 92-02. , 2006, International journal of radiation oncology, biology, physics.

[2]  Geert Molenberghs,et al.  Validation of Surrogate Endpoints in Multiple Randomized Clinical Trials with Discrete Outcomes , 2002 .

[3]  D. DeMets,et al.  Biomarkers and surrogate endpoints: Preferred definitions and conceptual framework , 2001, Clinical pharmacology and therapeutics.

[4]  Marc Buyse,et al.  Surrogate threshold effect: an alternative measure for meta‐analytic surrogate endpoint validation , 2006, Pharmaceutical statistics.

[5]  A. D'Amico,et al.  Surrogate endpoints for prostate cancer-specific mortality after radiotherapy and androgen suppression therapy in men with localised or locally advanced prostate cancer: an analysis of two randomised trials. , 2012, The Lancet. Oncology.

[6]  Satoshi Morita,et al.  Role of chemotherapy for advanced/recurrent gastric cancer: an individual-patient-data meta-analysis. , 2013, European journal of cancer.

[7]  D. Sargent,et al.  Biomarkers and surrogate end points—the challenge of statistical validation , 2010, Nature Reviews Clinical Oncology.

[8]  Bartha M. Knoppers,et al.  Data sharing, year 1--access to data from industry-sponsored clinical trials. , 2014, The New England journal of medicine.

[9]  Geert Molenberghs,et al.  Validation of Surrogate Markers in Multiple Randomized Clinical Trials with Repeated Measurements , 2003, Biometrics.

[10]  H. Sandler,et al.  Potential surrogate endpoints for prostate cancer survival: analysis of a phase III randomized trial. , 2009, Journal of the National Cancer Institute.

[11]  S W Lagakos,et al.  Surrogate Markers in AIDS: Where Are We? Where Are We Going? , 1992, Annals of Internal Medicine.

[12]  R. Mann,et al.  Prescription‐event and other forms of epidemiological monitoring of side‐effects in the UK , 1999, Clinical and experimental allergy : journal of the British Society for Allergy and Clinical Immunology.

[13]  P. Hougaard Survival models for heterogeneous populations derived from stable distributions , 1986 .

[14]  Geert Molenberghs,et al.  Choice of units of analysis and modeling strategies in multilevel hierarchical models , 2004, Comput. Stat. Data Anal..

[15]  V. De Gruttola,et al.  Modelling progression of CD4-lymphocyte count and its relationship to survival time. , 1994, Biometrics.

[16]  Caroline Domerg,et al.  Surrogate endpoints for overall survival in chemotherapy and radiotherapy trials in operable and locally advanced lung cancer: a re-analysis of meta-analyses of individual patients' data , 2013, The Lancet. Oncology.

[17]  D. Clayton A model for association in bivariate life tables and its application in epidemiological studies of familial tendency in chronic disease incidence , 1978 .

[18]  D. DeMets,et al.  Surrogate End Points in Clinical Trials: Are We Being Misled? , 1996, Annals of Internal Medicine.

[19]  Qian Shi,et al.  Comparative assessment of trial-level surrogacy measures for candidate time-to-event surrogate endpoints in clinical trials , 2011, Comput. Stat. Data Anal..

[20]  Geert Molenberghs,et al.  On the relationship between the causal‐inference and meta‐analytic paradigms for the validation of surrogate endpoints , 2015, Biometrics.

[21]  R. Prentice Surrogate endpoints in clinical trials: definition and operational criteria. , 1989, Statistics in medicine.

[22]  M. Buyse,et al.  Evaluation of tumor response, disease control, progression-free survival, and time to progression as potential surrogate end points in metastatic breast cancer. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[23]  P. Greer,et al.  Time to biochemical failure and prostate-specific antigen doubling time as surrogates for prostate cancer-specific mortality: evidence from the TROG 96.01 randomised controlled trial. , 2008, The Lancet. Oncology.

[24]  C. Begg,et al.  On the use of surrogate end points in randomized trials , 2000 .

[25]  L. Collette,et al.  Are prostate-specific antigen changes valid surrogates for survival in hormone-refractory prostate cancer? A meta-analysis is needed! , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[26]  B. Graubard,et al.  Statistical validation of intermediate endpoints for chronic diseases. , 1992, Statistics in medicine.

[27]  G. Molenberghs,et al.  The validation of surrogate endpoints in meta-analyses of randomized experiments. , 2000, Biostatistics.

[28]  Rodolphe Thiébaut,et al.  Counterfactual Links to the Proportion of Treatment Effect Explained by a Surrogate Marker , 2005, Biometrics.

[29]  A. Armstrong,et al.  Prostate-specific antigen changes as surrogate for overall survival in men with metastatic castration-resistant prostate cancer treated with second-line chemotherapy. , 2013, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[30]  T. Louis,et al.  Inferences on the association parameter in copula models for bivariate survival data. , 1995, Biometrics.

[31]  Yuan Xue,et al.  Center-within-trial versus trial-level evaluation of surrogate endpoints , 2014, Comput. Stat. Data Anal..

[32]  D. Rubin,et al.  Principal Stratification in Causal Inference , 2002, Biometrics.

[33]  C. Genest,et al.  The Joy of Copulas: Bivariate Distributions with Uniform Marginals , 1986 .

[34]  Geert Molenberghs,et al.  Relation between tumour response to first-line chemotherapy and survival in advanced colorectal cancer: a meta-analysis , 2000, The Lancet.

[35]  Daniel J Sargent,et al.  Disease-free survival versus overall survival as a primary end point for adjuvant colon cancer studies: individual patient data from 20,898 patients on 18 randomized trials. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[36]  Geert Molenberghs,et al.  Prentice's Approach and the Meta‐Analytic Paradigm: A Reflection on the Role of Statistics in the Evaluation of Surrogate Endpoints , 2004, Biometrics.

[37]  G. Molenberghs,et al.  Criteria for the validation of surrogate endpoints in randomized experiments. , 1998, Biometrics.

[38]  M. Gail,et al.  The promise and peril of surrogate end points in cancer research , 2002, Nature Reviews Cancer.

[39]  D. Sargent,et al.  Individual patient data (IPD) analysis of progression-free survival (PFS) versus overall survival (OS) as an endpoint for metastatic colorectal cancer (mCRC) in modern trials: Findings from the 16,700 patients (pts) ARCAD database. , 2013 .

[40]  Bradley P Carlin,et al.  Bayesian adjusted R2 for the meta‐analytic evaluation of surrogate time‐to‐event endpoints in clinical trials , 2012, Statistics in medicine.

[41]  Geert Molenberghs,et al.  Validation of a longitudinally measured surrogate marker for a time-to-event endpoint , 2003 .

[42]  T. Fleming Surrogate markers in aids and cancer trials , 1994 .

[43]  Yasuo Ohashi,et al.  Benefit of Adjuvant Chemotherapy for Resectable Gastric Cancer , 2009 .

[44]  V De Gruttola,et al.  Estimating the proportion of treatment effect explained by a surrogate marker. , 1997, Statistics in medicine.

[45]  Frank Rockhold,et al.  Access to patient-level data from GlaxoSmithKline clinical trials. , 2013, The New England journal of medicine.

[46]  Thomas C Jones Call for a new approach to the process of clinical trials and drug registration , 2001, British medical journal.

[47]  G. Molenberghs,et al.  Surrogate Marker Evaluation from an Information Theory Perspective , 2007, Biometrics.

[48]  G. Molenberghs,et al.  Validation of surrogate end points in multiple randomized clinical trials with failure time end points , 2001 .

[49]  P Flandre,et al.  Estimating the proportion of treatment effect explained by a surrogate marker. , 1999, Statistics in Medicine.

[50]  Marc Buyse,et al.  Leukemia-free survival as a surrogate end point for overall survival in the evaluation of maintenance therapy for patients with acute myeloid leukemia in complete remission , 2011, Haematologica.

[51]  Geert Molenberghs,et al.  A unifying approach for surrogate marker validation based on Prentice's criteria , 2006, Statistics in medicine.

[52]  T. Fleming,et al.  Perspective: validating surrogate markers--are we being naive? , 1997, The Journal of infectious diseases.

[53]  Geert Molenberghs,et al.  Report of the Editors – 2007 , 2008 .

[54]  Geert Molenberghs,et al.  The validation of surrogate end points by using data from randomized clinical trials: a case‐study in advanced colorectal cancer , 2004 .

[55]  W. Rogers,et al.  Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. , 1989, The New England journal of medicine.

[56]  Robert Schooley,et al.  CD4+ Lymphocytes Are an Incomplete Surrogate Marker for Clinical Progression in Persons with Asymptomatic HIV Infection Taking Zidovudine , 1993, Annals of Internal Medicine.

[57]  J. Robins,et al.  Identifiability and Exchangeability for Direct and Indirect Effects , 1992, Epidemiology.

[58]  L. Lesko,et al.  Use of biomarkers and surrogate endpoints in drug development and regulatory decision making: criteria, validation, strategies. , 2001, Annual review of pharmacology and toxicology.

[59]  P. Tugwell,et al.  Definitions and validation criteria for biomarkers and surrogate endpoints: development and testing of a quantitative hierarchical levels of evidence schema. , 2007, The Journal of rheumatology.

[60]  Satoshi Morita,et al.  Disease-free survival as a surrogate for overall survival in adjuvant trials of gastric cancer: a meta-analysis. , 2013, Journal of the National Cancer Institute.

[61]  Jeremy MG Taylor,et al.  Causal assessment of surrogacy in a meta-analysis of colorectal cancer trials. , 2011, Biostatistics.

[62]  C. Tangen,et al.  Evaluation of prostate-specific antigen declines for surrogacy in patients treated on SWOG 99-16. , 2006, Journal of the National Cancer Institute.

[63]  Gideon Blumenthal,et al.  Pathological complete response and long-term clinical benefit in breast cancer: the CTNeoBC pooled analysis , 2014, The Lancet.

[64]  S W Lagakos,et al.  Zidovudine in Asymptomatic Human Immunodeficiency Virus Infection , 1990 .

[65]  J. Abraham The international conference on harmonisation of technical requirements for registration of pharmaceuticals for human use , 2009 .

[66]  Andrzej T. Galecki,et al.  General class of covariance structures for two or more repeated factors in longitudinal data analysis , 1994 .

[67]  J. Dale Global cross-ratio models for bivariate, discrete, ordered responses. , 1986, Biometrics.

[68]  Elizabeth Garrett-Mayer,et al.  Prostate-specific antigen and pain surrogacy analysis in metastatic hormone-refractory prostate cancer. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[69]  Stuart G Baker,et al.  Surrogate endpoints: wishful thinking or reality? , 2006, Journal of the National Cancer Institute.

[70]  Geert Molenberghs,et al.  Simplified hierarchical linear models for the evaluation of surrogate endpoints , 2003 .

[71]  Geert Molenberghs,et al.  Statistical challenges in the evaluation of surrogate endpoints in randomized trials. , 2002, Controlled clinical trials.

[72]  M J Daniels,et al.  Meta-analysis for the evaluation of potential surrogate markers. , 1997, Statistics in medicine.

[73]  D. Sargent,et al.  Progression-free survival is a surrogate for survival in advanced colorectal cancer. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[74]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[75]  R J Carroll,et al.  On meta-analytic assessment of surrogate outcomes. , 2000, Biostatistics.

[76]  Tomasz Burzykowski,et al.  Is prostate-specific antigen a valid surrogate end point for survival in hormonally treated patients with metastatic prostate cancer? Joint research of the European Organisation for Research and Treatment of Cancer, the Limburgs Universitair Centrum, and AstraZeneca Pharmaceuticals. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[77]  A. E. Ferentz Integrating pharmacogenomics into drug development. , 2002, Pharmacogenomics.

[78]  Tomasz Burzykowski,et al.  Surrogate endpoints for overall survival in locally advanced head and neck cancer: meta-analyses of individual patient data. , 2009, The Lancet. Oncology.