How to deal with multiple endpoints in clinical trials

Multiple endpoints are common in clinical trials. This article discusses statistical methods that can be applied to control the rate of false positive conclusions at an acceptable level. The considered methods include the Bonferroni adjustment and related methods, the intersection‐union test, ordered hypotheses and gatekeeper procedures, composite endpoints and global assessment measures, closed testing procedures, and combinations of different approaches.

[1]  K. Gabriel,et al.  On closed testing procedures with special reference to ordered analysis of variance , 1976 .

[2]  P. O'Brien.  Procedures for comparing samples with multiple endpoints. , 1984, Biometrics.

[3]  P Bauer,et al.  Multiple testing in clinical trials. , 1991, Statistics in medicine.

[4]  Kenneth F Schulz,et al.  Multiplicity in randomised trials I: endpoints and treatments , 2005, The Lancet.

[5]  S. S. Young,et al.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[6]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[7]  Frank Bretz,et al.  The Evaluation of Multiple Clinical Endpoints, with Application to Asthma , 1999 .

[8]  Xun Chen,et al.  The application of enhanced parallel gatekeeping strategies , 2005, Statistics in medicine.

[9]  S James,et al.  Approximate multinormal probabilities applied to correlated multiple endpoints in clinical trials. , 1991, Statistics in medicine.

[10]  N. Geller.  Design and Analysis of Clinical Trials with Multiple Endpoints , 2003 .

[11]  T. Morikawa,et al.  A useful testing strategy in phase III trials: combined test of superiority and test of equivalence. , 1995, Journal of biopharmaceutical statistics.

[12]  Ester Samuel-Cahn,et al.  Is the Simes improved Bonferroni procedure conservative , 1996 .

[13]  R Bender,et al.  Multiple test procedures other than Bonferroni's deserve wider use , 1999, BMJ.

[14]  J. J. Chen,et al.  A power study of a sequential method of p-value adjustment for correlated continuous endpoints. , 1998, Journal of biopharmaceutical statistics.

[15]  M F Huque,et al.  Some comments on frequently used multiple endpoint adjustment methods in clinical trials. , 1997, Statistics in medicine.

[16]  G Wassmer,et al.  Procedures for two-sample comparisons with multiple endpoints controlling the experimentwise error rate. , 1991, Biometrics.

[17]  S. Kropf.  Application of multiple test procedures to the combination of multivariate and univariate tests with varying variable sets , 2007 .

[18]  Iris Pigeot,et al.  Basic concepts of multiple tests — A survey , 2000 .

[19]  Nick Freemantle,et al.  Composite outcomes in randomized trials: greater precision but with greater uncertainty? , 2003, JAMA.

[20]  Jurgen Lauter,et al.  Exact t and F Tests for Analyzing Studies with Multiple Endpoints , 1996 .

[21]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[22]  B. Wiens.  A fixed sequence Bonferroni procedure for testing multiple endpoints , 2003 .

[23]  D. Allison,et al.  Microarray data analysis: from disarray to consolidation and consensus , 2006, Nature Reviews Genetics.

[24]  K. Hörmann,et al.  The phosphodiesterase 4 inhibitor roflumilast is effective in the treatment of allergic rhinitis. , 2001, The Journal of allergy and clinical immunology.

[25]  Alan Agresti,et al.  Multivariate tests comparing binomial probabilities, with application to safety studies for drugs , 2005 .

[26]  P. Westfall,et al.  Gatekeeping strategies for clinical trials that do not require all primary effects to be significant , 2003, Statistics in medicine.

[27]  D. Moher,et al.  The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration , 2001, Annals of Internal Medicine.

[28]  Ji Zhang,et al.  Testing the Hypothesis that Matters for Multiple Primary Endpoints , 1996 .

[29]  Rian,et al.  A COMPARISON OF LOW-DOSE INHALED BUDESONIDE PLUS THEOPHYLLINE AND HIGH-DOSE INHALED BUDESONIDE FOR MODERATE ASTHMA , 2000 .

[30]  R. Berger,et al.  Bioequivalence trials, intersection-union tests and equivalence confidence sets , 1996 .

[31]  H. Keselman,et al.  Multiple Comparison Procedures , 2005 .

[32]  H. Watanabe,et al.  Points to Consider on Multiplicity Issues in Clinical Trials , 2006 .

[33]  B. Wiens,et al.  The Fallback Procedure for Evaluating a Single Family of Hypotheses , 2005, Journal of biopharmaceutical statistics.

[34]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[35]  R. D'Agostino,et al.  Efficacy endpoint selection and multiplicity adjustment methods in clinical trials with inherent multiple endpoint issues , 2003, Statistics in medicine.

[36]  P. Good.  Permutation, Parametric, and Bootstrap Tests of Hypotheses , 2005 .

[37]  Koen J. F. Verhoeven,et al.  Implementing false discovery rate control: increasing your power , 2005 .

[38]  H P Beck-Bornholdt,et al.  Potential pitfalls in the use of p-values and in interpretation of significance levels. , 1994, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[39]  ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials. International Conference on Harmonisation E9 Expert Working Group. , 1999, Statistics in medicine.

[40]  Lang Wu,et al.  A Note on One‐Sided Tests with Multiple Endpoints , 2004, Biometrics.

[41]  K. Chung,et al.  A comparison of low-dose inhaled budesonide plus theophylline and high-dose inhaled budesonide for moderate asthma. , 1997, The New England journal of medicine.

[42]  J. Shaffer.  Modified Sequentially Rejective Multiple Test Procedures , 1986 .

[43]  J Zhang,et al.  Some statistical methods for multiple endpoints in clinical trials. , 1997, Controlled clinical trials.

[44]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[45]  P. Westfall,et al.  Optimally weighted, fixed sequence and gatekeeper multiple testing procedures , 2001 .

[46]  T. Lai,et al.  One‐Sided Tests in Clinical Trials with Multiple Endpoints , 2001, Biometrics.

[47]  Yosef Hochberg,et al.  Extensions of multiple testing procedures based on Simes' test , 1995 .

[48]  Frank Bretz,et al.  Comparison of Methods for the Computation of Multivariate t Probabilities , 2002 .

[49]  G. Hommel.  A stagewise rejective multiple test procedure based on a modified Bonferroni test , 1988 .

[50]  A. Leon,et al.  A Comparison of Multiplicity Adjustment Strategies for Correlated Binary Endpoints , 2005, Journal of biopharmaceutical statistics.

[51]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[52]  V. Steinijans,et al.  Presentation of results from bioequivalence studies. , 1992, International journal of clinical pharmacology, therapy, and toxicology.