Comparing Three Groups

We revisit simple and powerful methods for multiple pairwise comparisons that can be used in designs with three groups. We argue that the proper choice of method should be determined by the assessment which of the comparisons are considered primary and which are secondary, as determined by subject-matter considerations. We review four different methods that are simple to use with any standard software, but are substantially more powerful than frequently-used methods such as an ANOVA test followed by Tukey's method.

[1]  H. Keselman,et al.  Multiple Comparison Procedures , 2005 .

[2]  James P. Stevens,et al.  Intermediate Statistics: A Modern Approach, Third Edition , 1999 .

[3]  K. Gabriel,et al.  SIMULTANEOUS TEST PROCEDURES-SOME THEORY OF MULTIPLE COMPARISONS' , 1969 .

[4]  L. H. C. Tippett,et al.  ON THE EXTREME INDIVIDUALS AND THE RANGE OF SAMPLES TAKEN FROM A NORMAL POPULATION , 1925 .

[5]  A. Hayter.  The Maximum Familywise Error Rate of Fisher's Least Significant Difference Test , 1986 .

[6]  Thorsten Dickhaus,et al.  Simultaneous Statistical Inference , 2014, Springer Berlin Heidelberg.

[7]  W. Brannath,et al.  A graphical approach to sequentially rejective multiple test procedures , 2009, Statistics in medicine.

[8]  K. Ruben Gabriel,et al.  Multiple comparisons by rerandomization tests , 1983 .

[9]  Isaac Dialsingh,et al.  Multiple testing problems in pharmaceutical statistics , 2011 .

[10]  Clyde Young Kramer,et al.  Extension of multiple range tests to group means with unequal numbers of replications , 1956 .

[11]  Donald B. Rubin,et al.  Ensemble-Adjusted p Values , 1983 .

[12]  K. Gabriel,et al.  On closed testing procedures with special reference to ordered analysis of variance , 1976 .

[13]  Steven P. Isham,et al.  Exact Simultaneous Confidence Intervals for Pairwise Comparisons of Three Normal Means , 1985 .

[14]  Eckart Sonnemann,et al.  General Solutions to Multiple Testing Problems , 2008, Biometrical journal. Biometrische Zeitschrift.

[15]  T. Hothorn,et al.  Simultaneous Inference in General Parametric Models , 2008, Biometrical journal. Biometrische Zeitschrift.

[16]  Joseph P. Romano,et al.  Consonance and the Closure Method in Multiple Testing , 2009 .

[17]  On the modified s-method and directional errors , 1990 .

[18]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[19]  Emma B. Saxon.  Multiple comparisons , 2015, BMC Biology.

[20]  J. Goeman,et al.  The Sequential Rejection Principle of Familywise Error Control , 2010, 1211.3313.

[21]  Abgeschlossene multiple Spannweitentests , 1988 .

[22]  H. O. Hartley,et al.  Some recent developments in analysis of variance , 1955 .

[23]  S. P. Wright,et al.  Adjusted P-values for simultaneous inference , 1992 .

[24]  Umesh D. Naik,et al.  Some selection rules for comparing p processes with a standard , 1975 .

[25]  Philip Sedgwick.  One way analysis of variance: post hoc testing , 2014, BMJ : British Medical Journal.

[26]  A. Tamhane,et al.  A class of improved hybrid Hochberg-Hommel type step-up multiple test procedures , 2014 .

[27]  T. Hothorn,et al.  Multiple Comparisons Using R , 2010 .

[28]  D. Newman,et al.  THE DISTRIBUTION OF RANGE IN SAMPLES FROM A NORMAL POPULATION, EXPRESSED IN TERMS OF AN INDEPENDENT ESTIMATE OF STANDARD DEVIATION , 1939 .

[29]  O. Guilbaud,et al.  A recycling framework for the construction of Bonferroni‐based multiple tests , 2009, Statistics in medicine.

[30]  Juliet Popper Shaffer,et al.  Comparison of Means: An F Test Followed by a Modified Multiple Range Procedure , 1979 .

[31]  John Ludbrook,et al.  Why Permutation Tests are Superior to t and F Tests in Biomedical Research , 1998 .

[32]  Roy Robertson,et al.  An Introduction to Statistical Modelling , 2000, Technometrics.

[33]  A. Tamhane,et al.  Multiple Comparison Procedures , 2009 .

[34]  J. Shaffer.  Modified Sequentially Rejective Multiple Test Procedures , 1986 .

[35]  Charles W. Dunnett,et al.  A Step-Up Multiple Test Procedure , 1992 .

[36]  J. Shaffer.  Multiple comparisons emphasizing selected contrasts: an extension and generalization of Dunnett's procedure. , 1977, Biometrics.

[37]  K. Ruben Gabriel,et al.  Closure of the Newman-Keuls Multiple Comparisons Procedure , 1981 .

[38]  A. Tamhane,et al.  Step-down multiple tests for comparing treatments with a control in unbalanced one-way layouts. , 1991, Statistics in medicine.

[39]  Frank Bretz,et al.  Power and sample size when multiple endpoints are considered , 2007, Pharmaceutical statistics.

[40]  Peter R. Nelson,et al.  Multiple Comparisons: Theory and Methods , 1997 .

[41]  C. Dunnett.  A Multiple Comparison Procedure for Comparing Several Treatments with a Control , 1955 .

[42]  G. Hommel,et al.  Improvements of General Multiple Test Procedures for Redundant Systems of Hypotheses , 1988 .

[43]  Alex Dmitrienko,et al.  General Multistage Gatekeeping Procedures , 2008, Biometrical journal. Biometrische Zeitschrift.

[44]  J. Tukey.  Comparing individual means in the analysis of variance. , 1949, Biometrics.

[45]  Jesse Hemerik,et al.  Exact testing with random permutations , 2014, TEST.