MULTIPLE COMPARISON PROCEDURES UPDATED

1. A common statistical flaw in articles submitted to or published in biomedical research journals is to test multiple null hypotheses that originate from the results of a single experiment without correcting for the inflated risk of type 1 error (false positive statistical inference) that results from this. Multiple comparison procedures (MCP) are designed to minimize this risk. The present review focuses on pairwise contrasts, the most common sort of multiple comparisons made by biomedical investigators.

[1]  Joel R. Levin,et al.  A controlled, powerful multiple-comparison strategy for several situations. , 1994 .

[2]  T. A. Ryan.  Multiple comparison in psychological research. , 1959 .

[3]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[4]  T. A. Ryan,et al.  Multiple comparisons in psychological research. , 1959, Psychological bulletin.

[5]  J. Fleiss,et al.  Some Statistical Methods Useful in Circulation Research , 1980, Circulation research.

[6]  John Ludbrook,et al.  Why Permutation Tests are Superior to t and F Tests in Biomedical Research , 1998 .

[7]  S. Pocock,et al.  Statistical problems in the reporting of clinical trials. A survey of three medical journals. , 1987, The New England journal of medicine.

[8]  Peter H. Westfall,et al.  Multiple Testing of General Contrasts Using Logical Constraints and Correlations , 1997 .

[9]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[10]  S D Walter,et al.  Methods of reporting statistical results from medical research studies. , 1995, American journal of epidemiology.

[11]  J. Shaffer.  Modified Sequentially Rejective Multiple Test Procedures , 1986 .

[12]  E. Gracely,et al.  Impact of multiple comparisons in randomized clinical trials. , 1987, The American journal of medicine.

[13]  S. P. Wright,et al.  Adjusted P-values for simultaneous inference , 1992 .

[14]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[15]  G. H. Freeman,et al.  Note on an exact treatment of contingency, goodness of fit and other problems of significance. , 1951, Biometrika.

[16]  J. Booth,et al.  Resampling-Based Multiple Testing. , 1994 .

[17]  F. E. Satterthwaite.  Synthesis of variance , 1941 .

[18]  T. Morikawa,et al.  Power evaluation of various modified Bonferroni procedures by a Monte Carlo study. , 1996, Journal of biopharmaceutical statistics.

[19]  G. Glass,et al.  Consequences of Failure to Meet Assumptions Underlying the Fixed Effects Analyses of Variance and Covariance , 1972 .

[20]  R. Anderson,et al.  Comparing the means of several groups. , 1986, The New England journal of medicine.

[21]  G. Hommel.  A stagewise rejective multiple test procedure based on a modified Bonferroni test , 1988 .

[22]  D. Rom.  A sequentially rejective test procedure based on a modified Bonferroni inequality , 1990 .

[23]  Yosef Hochberg,et al.  Extensions of multiple testing procedures based on Simes' test , 1995 .

[24]  P. E. Korsog,et al.  The Correlation and Dependence between Two F Statistics with the Same Denominator , 1986 .

[25]  B. Levin,et al.  On the Holm, Simes, and Hochberg multiple test procedures. , 1996, American journal of public health.

[26]  J Ludbrook,et al.  ON MAKING MULTIPLE COMPARISONS IN CLINICAL AND EXPERIMENTAL PHARMACOLOGY AND PHYSIOLOGY , 1991, Clinical and experimental pharmacology & physiology.

[27]  Z. Šidák.  Rectangular Confidence Regions for the Means of Multivariate Normal Distributions , 1967 .

[28]  L. Havlicek,et al.  Robustness of the T Test: A Guide for Researchers on Effect of Violations of Assumptions , 1974 .

[29]  B W Brown,et al.  Methods of correcting for multiple testing: operating characteristics. , 1997, Statistics in medicine.

[30]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[31]  B. Holland,et al.  A new closed multiple testing procedure for hierarchical families of hypotheses , 1995 .

[32]  Anthony J. Hayter,et al.  On the Relationship between Stepwise Decision Procedures and Confidence Sets , 1994 .

[33]  J Ludbrook,et al.  Repeated measurements and multiple comparisons in cardiovascular research. , 1994, Cardiovascular research.

[34]  J. Shaffer.  Multiple Hypothesis Testing , 1995 .

[35]  B. Holland,et al.  An Improved Sequentially Rejective Bonferroni Test Procedure , 1987 .

[36]  B. L. Welch.  THE SIGNIFICANCE OF THE DIFFERENCE BETWEEN TWO MEANS WHEN THE POPULATION VARIANCES ARE UNEQUAL , 1938 .