The Biomarker-Surrogacy Evaluation Schema: a review of the biomarker-surrogate literature and a proposal for a criterion-based, quantitative, multidimensional hierarchical levels of evidence schema for evaluating the status of biomarkers as surrogate endpoints

There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Section 2 is a systematic, historical review of the biomarker-surrogate endpoint literature with special reference to the nomenclature, the systems of classification and statistical methods developed for their evaluation. In Section 3 an explicit, criterion-based, quantitative, multidimensional hierarchical levels of evidence schema — Biomarker-Surrogacy Evaluation Schema — is proposed to evaluate and co-ordinate the multiple dimensions (biological, epidemiological, statistical, clinical trial and risk-benefit evidence) of the biomarker clinical endpoint relationships. The schema systematically evaluates and ranks the surrogacy status of biomarkers and surrogate endpoints using defined levels of evidence. The schema incorporates the three independent domains: Study Design, Target Outcome and Statistical Evaluation. Each domain has items ranked from zero to five. An additional category called Penalties incorporates additional considerations of biological plausibility, risk-benefit and generalizability. The total score (0—15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. The term `surrogate' is restricted to markers attaining Levels 1 or 2 only. Surrogacy status of markers can then be directly compared within and across different areas of medicine to guide individual, trial-based or drug-development decisions. This schema would facilitate communication between clinical, researcher, regulatory, industry and consumer participants necessary for evaluation of the biomarker-surrogate-clinical endpoint relationship in their different settings.

[1]  D. Hayes Determination of clinical utility of tumor markers: a tumor marker utility grading system. , 1998, Recent results in cancer research. Fortschritte der Krebsforschung. Progres dans les recherches sur le cancer.

[2]  P. Wood Where are we now with radiographic assessment of rheumatoid arthritis? , 1983, British journal of rheumatology.

[3]  Geert Molenberghs,et al.  Evaluation of Surrogate Endpoints , 2006, Handbook of Statistical Methods for Randomized Controlled Trials.

[4]  J. Wittes,et al.  Surrogate endpoints in clinical trials: cardiovascular diseases. , 1989, Statistics in medicine.

[5]  R J Carroll,et al.  On meta-analytic assessment of surrogate outcomes. , 2000, Biostatistics.

[6]  J. Spence,et al.  Measurement of atherosclerosis: development of an atherosclerosis severity index. , 1989, Clinical and experimental hypertension. Part A, Theory and practice.

[7]  J. Ruskin,et al.  The cardiac arrhythmia suppression trial (CAST). , 1989, The New England journal of medicine.

[8]  K. Lee,et al.  Perspectives on large-scale cardiovascular clinical trials for the new millennium. The Virtual Coordinating Center for Global Collaborative Cardiovascular Research (VIGOUR) Group. , 1997, Circulation.

[9]  J. Collet,et al.  Surrogate endpoints: A basis for a rational approach , 2006, European Journal of Clinical Pharmacology.

[10]  D. Rubin Direct and Indirect Causal Effects via Potential Outcomes * , 2004 .

[11]  N. Freemantle,et al.  Response rate or time to progression as predictors of survival in trials of metastatic colorectal cancer or non-small-cell lung cancer: a meta-analysis. , 2006, The Lancet. Oncology.

[12]  J M Taylor,et al.  Statistical issues for HIV surrogate endpoints: point/counterpoint. An NIAID workshop. , 1998, Statistics in medicine.

[13]  G. Molenberghs,et al.  Criteria for the validation of surrogate endpoints in randomized experiments. , 1998, Biometrics.

[14]  A. Schatzkin Intermediate markers as surrogate endpoints in cancer research. , 2000, Hematology/oncology clinics of North America.

[15]  A. J. Bauman,et al.  A search for porphyrin biomarkers in nonesuch shale and extraterrestrial samples , 2007, Space life sciences.

[16]  D. Seigel,et al.  Surrogate endpoints in clinical trials: ophthalmologic disorders. , 1989, Statistics in medicine.

[17]  M. Hughes Initial treatment of HIV infection: randomized trials with clinical end points are still needed. , 2006, The Journal of infectious diseases.

[18]  P. Lachenbruch,et al.  Biomarkers and Surrogate Endpoints in Renal Transplantation: Present Status and Considerations for Clinical Trial Design , 2004, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[19]  Geert Molenberghs,et al.  The validation of surrogate end points by using data from randomized clinical trials: a case‐study in advanced colorectal cancer , 2004 .

[20]  B. Fagerberg,et al.  Multiple risk intervention trial in high risk hypertensive men: comparison of ultrasound intima‐media thickness and clinical outcome during 6 years of follow‐up , 2001, Journal of internal medicine.

[21]  C. McCulloch,et al.  Latent Class Models for Joint Analysis of Longitudinal Biomarker and Event Process Data , 2002 .

[22]  D. DeMets,et al.  Biomarkers and surrogate endpoints: Preferred definitions and conceptual framework , 2001, Clinical pharmacology and therapeutics.

[23]  M. Gail,et al.  The promise and peril of surrogate end points in cancer research , 2002, Nature Reviews Cancer.

[24]  Donald Mainland Elementary Medical Statistics , 1952 .

[25]  Thomas R Fleming,et al.  Surrogate endpoints and FDA's accelerated approval process. , 2005, Health affairs.

[26]  A. Jaffe,et al.  Risk factors for sudden death after acute myocardial infarction: two-year follow-up. , 1984, The American journal of cardiology.

[27]  J. Anderson,et al.  Classification by type of ventricular arrhythmia predicts frequency of adverse cardiac events from flecainide. , 1986, Journal of the American College of Cardiology.

[28]  P. Tugwell,et al.  Definitions and validation criteria for biomarkers and surrogate endpoints: development and testing of a quantitative hierarchical levels of evidence schema. , 2007, The Journal of rheumatology.

[29]  D. DeMets,et al.  Considerations in the evaluation of surrogate endpoints in clinical trials. summary of a National Institutes of Health workshop. , 2001, Controlled clinical trials.

[30]  New drug, antibiotic, and biological drug product regulations; accelerated approval--FDA. Final rule. , 1992, Federal register.

[31]  Stuart G Baker,et al.  A simple meta-analytic approach for using a binary surrogate endpoint to predict the effect of intervention on true endpoint. , 2006, Biostatistics.

[32]  Marc Buyse,et al.  Surrogate threshold effect: an alternative measure for meta‐analytic surrogate endpoint validation , 2006, Pharmaceutical statistics.

[33]  A. Skene Surrogate end points in cardiovascular disease trials , 2000 .

[34]  D. Tritchler Reasoning about data with directed graphs. , 1999, Statistics in medicine.

[35]  R. Labianca,et al.  Disease-free survival (DFS) vs. overall survival (OS) as a primary endpoint for adjuvant colon cancer studies: Individual patient data from 12,915 patients on 15 randomized trials. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[36]  Geert Molenberghs,et al.  Validation of Surrogate Endpoints in Multiple Randomized Clinical Trials with Discrete Outcomes , 2002 .

[37]  S. Freud The Origin And Development Of Psychoanalysis , 1910 .

[38]  David M. Parenti,et al.  Phase I/II trial of thymosin fraction 5 and thymosin alpha one in HTLV-III seropositive subjects. , 1986, Journal of biological response modifiers.

[39]  W. Hong,et al.  Biomarkers as Intermediate Endpoints in Chemoprevention Trials: Biological Basis of Lung Cancer Prevention , 1998 .

[40]  C. Lathia Biomarkers and Surrogate Endpoints: How and When might They Impact Drug Development? , 2002, Disease markers.

[41]  M. Hughes Evaluating surrogate endpoints. , 2002, Controlled clinical trials.

[42]  R. Temple,et al.  Food and Drug Administration requirements for approval of new anticancer drugs. , 1985, Cancer treatment reports.

[43]  B. Kramer,et al.  A perfect correlate does not a surrogate make , 2003, BMC medical research methodology.

[44]  P. Prorok,et al.  Development Tracks for Cancer Prevention Markers , 2004, Disease markers.

[45]  D. Lin,et al.  Evaluating the role of CD4-lymphocyte counts as surrogate endpoints in human immunodeficiency virus clinical trials. , 1993, Statistics in medicine.

[46]  Geert Molenberghs,et al.  Relation between tumour response to first-line chemotherapy and survival in advanced colorectal cancer: a meta-analysis , 2000, The Lancet.

[47]  J. Richie,et al.  Appropriate endpoints for superficial bladder cancer clinical trials. , 1987, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[48]  L. Moyé,et al.  The Cardiac Arrhythmia Suppression Trial: background, interim results and implications. , 1990, The American journal of cardiology.

[49]  J. Bigger Long-term continuous electrocardiographic recordings and electrophysiologic testing to select patients with ventricular arrhythmias for drug trials and to determine antiarrhythmic drug efficacy. , 1986, The American journal of cardiology.

[50]  T. Fleming,et al.  Perspective: validating surrogate markers--are we being naive? , 1997, The Journal of infectious diseases.

[51]  Stuart G Baker,et al.  Surrogate endpoints: wishful thinking or reality? , 2006, Journal of the National Cancer Institute.

[52]  L. Lesko,et al.  Use of biomarkers from drug discovery through clinical practice: Report of the Ninth European Federation of Pharmaceutical Sciences Conference on Optimizing Drug Development , 2003, Clinical pharmacology and therapeutics.

[53]  W. Colburn Optimizing the Use of Biomarkers, Surrogate Endpoints, and Clinical Endpoints for More Efficient Drug Development , 2000, Journal of clinical pharmacology.

[54]  J. Herson The use of surrogate endpoints in clinical trials (an introduction to a series of four papers) , 1989 .

[55]  B. Graubard,et al.  Statistical validation of intermediate endpoints for chronic diseases. , 1992, Statistics in medicine.

[56]  Hongwei Wang,et al.  Proportion of treatment effect (PTE) explained by a surrogate marker , 2003, Statistics in medicine.

[57]  M Aickin,et al.  If there is gold in the labeling index hills, are we digging in the right place? , 1994, Journal of cellular biochemistry. Supplement.

[58]  D. Rubin,et al.  Principal Stratification in Causal Inference , 2002, Biometrics.

[59]  Jeremy M G Taylor,et al.  A Measure of the Proportion of Treatment Effect Explained by a Surrogate Marker , 2002, Biometrics.

[60]  S. Dawsey,et al.  Validation of intermediate end points in cancer research. , 1990, Journal of the National Cancer Institute.

[61]  J. Taylor,et al.  An evaluation of a measure of the proportion of the treatment effect explained by a surrogate marker. , 1998, Controlled clinical trials.

[62]  W. Colburn,et al.  Surrogate Biochemical Markers: Precise Measurement for Strategic Drug and Biologics Development , 1995, Journal of clinical pharmacology.

[63]  Jari Ylinen,et al.  Active neck muscle training in the treatment of chronic neck pain in women: a randomized controlled trial. , 2003, JAMA.

[64]  S. Ellenberg,et al.  Surrogate endpoints in clinical trials: cancer. , 1989, Statistics in medicine.

[65]  A. Curcio,et al.  Clinical value of a multiple biomarker assay in patients with bronchogenic carcinoma , 1986 .

[66]  Lin Gh,et al.  Urinary fibronectin: potential as a biomarker in prostatic cancer. , 1980 .

[67]  C. Weir,et al.  Statistical evaluation of biomarkers as surrogate endpoints: a literature review , 2006, Statistics in medicine.

[68]  W. Colburn Selecting and Validating Biologic Markers for Drug Development , 1997, Journal of clinical pharmacology.

[69]  C. Begg,et al.  On the use of surrogate end points in randomized trials , 2000 .

[70]  M. Meredith,et al.  A method to assess the proportion of treatment effect explained by a surrogate endpoint , 2001, Statistics in medicine.

[71]  M. Gail,et al.  On the use of laboratory markers as surrogates for clinical endpoints in the evaluation of treatment for HIV infection. , 1990, Journal of acquired immune deficiency syndromes.

[72]  John A. Wagner,et al.  Overview of Biomarkers and Surrogate Endpoints in Drug Development , 2002, Disease markers.

[73]  Cardiac Arrhythmia Pilot Study Investigators Effects of encainide, flecainide, imipramine and moricizine on ventricular arrhythmias during the year after acute myocardial infarction: the CAPS. , 1988, The American journal of cardiology.

[74]  J. Mrochek,et al.  Serum protein-bound carbohydrates for following the course of disease in patients with metastatic breast carcinoma. , 1978, Journal of the National Cancer Institute.

[75]  R. D'Agostino,et al.  Surrogate markers: back to the future , 2006, Statistics in medicine.

[76]  M J Daniels,et al.  CD4 cell count as a surrogate endpoint in HIV clinical trials: a meta‐analysis of studies of the AIDS Clinical Trials Group , 1998, AIDS.

[77]  Paul S Albert,et al.  Assessing surrogates as trial endpoints using mixed models , 2005, Statistics in medicine.

[78]  H L Greene,et al.  The Cardiac Arrhythmia Suppression Trial: first CAST ... then CAST-II. , 1992, Journal of the American College of Cardiology.

[79]  M. Gion,et al.  Cost/Effectiveness Ratio of Carcinoembryonic Antigen - Importance of Adequacy of Routine Requests of Tumor Markers , 1992, The International journal of biological markers.

[80]  M J Daniels,et al.  Meta-analysis for the evaluation of potential surrogate markers. , 1997, Statistics in medicine.

[81]  C. Boone,et al.  Intraepithelial neoplasia, surrogate endpoint biomarkers, and cancer chemoprevention , 1993, Journal of cellular biochemistry. Supplement.

[82]  T. Wilt,et al.  Immunotherapy for advanced renal cell cancer. , 2015, The Cochrane database of systematic reviews.

[83]  Yan Wang,et al.  Surrogate markers and joint models for longitudinal and survival data. , 2002, Controlled clinical trials.

[84]  R. Temple,et al.  Are surrogate markers adequate to assess cardiovascular disease drugs? , 1999, JAMA.

[85]  David Moher,et al.  Toward complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. , 2003, Academic radiology.

[86]  M. Buyse,et al.  Simulation studies of surrogate endpoint validation using single trial and multitrial statistical approaches. , 2007, The Journal of rheumatology.

[87]  L. Babiss,et al.  Commentary: where and how could biomarkers be used in 2016? , 2006, The AAPS journal.

[88]  J. Bigger The events surrounding the removal of encainide and flecainide from the Cardiac Arrhythmia Suppression Trial (CAST) and why CAST is continuing with moricizine. , 1990, Journal of the American College of Cardiology.

[89]  M. Cowles Bayesian estimation of the proportion of treatment effect captured by a surrogate marker , 2002, Statistics in medicine.

[90]  L. Lesko,et al.  Use of biomarkers and surrogate endpoints in drug development and regulatory decision making: criteria, validation, strategies. , 2001, Annual review of pharmacology and toxicology.

[91]  M. Case,et al.  Quantifying the indirect treatment effect via surrogate markers , 2006, Statistics in medicine.

[92]  Thomas R. Fleming,et al.  Surrogate Endpoints in Clinical Trials , 1996 .

[93]  R. Lotan,et al.  Biomarkers as intermediate end points in chemoprevention trials. , 1990, Journal of the National Cancer Institute.

[94]  Geert Molenberghs,et al.  Statistical Validation of Surrogate Endpoints: Problems and Proposals , 2000 .

[95]  M D Hughes,et al.  Evaluating surrogate markers. , 1995, Journal of acquired immune deficiency syndromes and human retrovirology : official publication of the International Retrovirology Association.

[96]  Daniel F. Hayes,et al.  Assessing the clinical impact of prognostic factors: When is "statistically significant" clinically useful? , 2004, Breast Cancer Research and Treatment.

[97]  A simple method for analyzing data from a randomized trial with a missing binary outcome , 2003, BMC medical research methodology.

[98]  Vance W Berger,et al.  Does the Prentice criterion validate surrogate endpoints? , 2004, Statistics in medicine.

[99]  V De Gruttola,et al.  Estimating the proportion of treatment effect explained by a surrogate marker. , 1997, Statistics in medicine.

[100]  G. Guyatt,et al.  Users' guides to the medical literature: XIX. Applying clinical trial results. A. How to use an article measuring the effect of an intervention on surrogate end points. Evidence-Based Medicine Working Group. , 1999, JAMA.

[101]  L. Hnnsson The Hypertension Optimal Treatment Study (the HOT Study). , 1993, Blood pressure.

[102]  M. Schiffman,et al.  Statistical validation of intermediate markers of precancer for use as endpoints in chemoprevention trials , 1992, Journal of cellular biochemistry. Supplement.

[103]  N. Stockbridge,et al.  Blood pressure as an example of a biomarker that functions as a surrogate , 2006, The AAPS Journal.

[104]  E. Szabo,et al.  Predicting success in cancer prevention trials. , 2003, Journal of the National Cancer Institute.

[105]  L. Lesko,et al.  Paving the Critical Path: How can Clinical Pharmacology Help Achieve the Vision? , 2007, Clinical pharmacology and therapeutics.

[106]  C. Levy,et al.  Influence of renal insufficiency on levels of serum ribonuclease in patients with multiple myeloma. , 1977, Journal of the National Cancer Institute.

[107]  L S Freedman,et al.  Sample size for studying intermediate endpoints within intervention trails or observational studies. , 1992, American journal of epidemiology.

[108]  P. Rolan The contribution of clinical pharmacology surrogates and models to drug development--a critical appraisal. , 2003, British journal of clinical pharmacology.

[109]  H. Stich,et al.  Use of intermediate endpoints in quantitating the response of precancerous lesions to chemopreventive agents. , 1987, Canadian journal of physiology and pharmacology.

[110]  Rodolphe Thiébaut,et al.  Counterfactual Links to the Proportion of Treatment Effect Explained by a Surrogate Marker , 2005, Biometrics.

[111]  V. De Gruttola,et al.  An approach to the validation of markers for use in AIDS clinical trials. , 1997, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[112]  I. Marschner,et al.  Advances in medical statistics arising from the AIDS epidemic , 2001 .

[113]  Geert Molenberghs,et al.  Prentice's Approach and the Meta‐Analytic Paradigm: A Reflection on the Role of Statistics in the Evaluation of Surrogate Endpoints , 2004, Biometrics.

[114]  G. S. Campbell,et al.  Program on the Surgical Control of the Hyperlipidemias (POSCH): design and methodology. POSCH Group. , 1989, Journal of clinical epidemiology.

[115]  R. Prentice Surrogate endpoints in clinical trials: definition and operational criteria. , 1989, Statistics in medicine.

[116]  S L Zeger,et al.  The Evaluation of Multiple Surrogate Endpoints , 2001, Biometrics.

[117]  G. Molenberghs,et al.  The validation of surrogate endpoints in meta-analyses of randomized experiments. , 2000, Biostatistics.

[118]  Robin Henderson,et al.  Identification and efficacy of longitudinal markers for survival. , 2002, Biostatistics.

[119]  Geert Molenberghs,et al.  Statistical challenges in the evaluation of surrogate endpoints in randomized trials. , 2002, Controlled clinical trials.

[120]  R. Baker Preoperative assessment of the patient with breast cancer. , 1978, The Surgical clinics of North America.

[121]  Stacey L Knobler,et al.  The Critical Path to New Medical Products , 2005 .

[122]  Ron Kikinis,et al.  Structural modeling of dynamic changes in memory and brain structure using longitudinal data from the normative aging study. , 2004, The journals of gerontology. Series B, Psychological sciences and social sciences.

[123]  S. Dawsey,et al.  Surrogate end points in cancer research: a critique. , 1996, Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology.

[124]  G. Molenberghs,et al.  A perspective on surrogate endpoints in controlled clinical trials , 2004, Statistical methods in medical research.

[125]  J. Wagner,et al.  Biomarkers and Surrogate End Points for Fit‐for‐Purpose Development and Regulatory Evaluation of New Drugs , 2007, Clinical pharmacology and therapeutics.