A Comparison of the Modified-Tukey and Scheffé Methods of Multiple Comparisons for Pairwise Contrasts

Abstract The Kramer (1956), Spjotvoll and Stoline (1975), Hochberg (1976), and Games and Howell (1976) modified forms of the Tukey test are compared with the Scheffe (1959) test for (1) rates of Type I error and (2) sensitivity to varying degrees of sample-size imbalance and variance heterogeneity when sampling from normal and skewed distributions. Only the Hochberg (1976) and Games and Howell (1976) procedures control their rates of Type I error at or below the nominal five percent level for all conditions investigated; however, the Games and Howell (1976) procedure is more powerful and always results in Type I error values which are closer to the level of significance.

[1]  Paul A. Games,et al.  Multiple Comparisons of Means , 1971 .

[2]  H. Scheffé.  The Analysis of Variance , 1960 .

[3]  H. J. Keselman,et al.  Assumption Violations and Rates of Type I Error for the Tukey Multiple Comparison Test , 1977 .

[4]  George Marsaglia,et al.  A fast procedure for generating normal random variables , 1964, CACM.

[5]  E. R. Golder,et al.  The Box‐Müller Method for Generating Pseudo‐Random Normal Deviates , 1976 .

[6]  H. Leon Harter,et al.  Tables of Range and Studentized Range , 1960 .

[7]  H. Keselman,et al.  Comparison of Tukey's T-Method and Scheffé's S-Method for Various Numbers of All Possible Differences of Averages Contrasts Under Violation of Assumptions , 1974 .

[8]  Robert A. Smith,et al.  The effect of unequal group size on Tukey's HSD procedure , 1971 .

[9]  H. Keselman,et al.  Effect of Very Unequal Group Sizes On Tukey's Multiple Comparison Test , 1976 .

[10]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[11]  M. E. Muller,et al.  A Note on the Generation of Random Normal Deviates , 1958 .

[12]  Ying Y. Wang,et al.  Probabilities of the Type I Errors of the Welch Tests for the Behrens-Fisher Problem , 1971 .

[13]  H. Keselman,et al.  An Evaluation of Two Unequal nk Forms of the Tukey Multiple Comparison Statistic , 1975 .

[14]  S. G. Carmer,et al.  An Evaluation of Ten Pairwise Multiple Comparison Procedures by Monte Carlo Methods , 1973 .

[15]  J. F. Howell,et al.  Pairwise Multiple Comparison Procedures with Unequal N’s and/or Variances: A Monte Carlo Study , 1976 .

[16]  Clyde Young Kramer,et al.  Extension of multiple range tests to group means with unequal numbers of replications , 1956 .

[17]  Rupert G. Miller.  Simultaneous Statistical Inference , 1966 .

[18]  Maurice G. Kendall,et al.  The advanced theory of statistics , 1945 .

[19]  Yosef Hochberg,et al.  A Modification of the T -Method of Multiple Comparisons for a One-Way Layout with Unequal Variances , 1976 .

[20]  On the Behrens-Fisher problem , 1970 .

[21]  G. Box.  Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification , 1954 .

[22]  K. Gabriel,et al.  A Study of the Powers of Several Methods of Multiple Comparisons , 1975 .

[23]  Emil Spjøtvoll,et al.  An Extension of the T-Method of Multiple Comparison to Include the Cases with Unequal Sample Sizes , 1973 .