Global testing method for clustering means in ANOVA

Abstract For the comparison of treatment means in the analysis of variance, it is reasonable to partition the treatments into disjoint groups such that treatment means in the same group are not significantly different. From the overall consideration of the coherence of the current partition with the whole data, we propose some clustering procedures based on the global p -value for each partition. The new procedures are applied in both homogeneous and heterogeneous variances cases. We show the consistency of our procedures, and investigate their theoretical FWER behavior. Simulation studies reveal that our procedures have better overall performance than some existing methods, in terms of the number of total errors, power, and the proportion of picking out the true partition.

[1]  Xingzhong Xu,et al.  New multiple testing method under no dependency assumption, with application to multiple comparisons problem , 2016 .

[2]  Walter D. Fisher On Grouping for Maximum Homogeneity , 1958 .

[3]  A. Scott,et al.  A Cluster Analysis Method for Grouping Means in the Analysis of Variance , 1974 .

[4]  Daniel Yekutieli False discovery rate control for non-positively regression dependent test statistics , 2008 .

[5]  Rory A. Fisher,et al.  The concepts of inverse probability and fiducial probability referring to unknown parameters , 1933 .

[6]  S. G. Carmer,et al.  An Evaluation of Ten Pairwise Multiple Comparison Procedures by Monte Carlo Methods , 1973 .

[7]  S. S. Young,et al.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[8]  Hu Hui The generalized p-value of the one-way layout analysis of variance model , 2007 .

[9]  Cluster Formation as a Measure of Interpretability in Multiple Testing , 2008, Biometrical journal. Biometrische Zeitschrift.

[10]  D. Newman,et al.  THE DISTRIBUTION OF RANGE IN SAMPLES FROM A NORMAL POPULATION, EXPRESSED IN TERMS OF AN INDEPENDENT ESTIMATE OF STANDARD DEVIATION , 1939 .

[11]  G. B. Wetherill,et al.  The Present State of Multiple Comparison Methods , 1971 .

[12]  K. R. Gabriel A Procedure for Testing the Homogeneity of All Sets of Means in Analysis of Variance , 1964 .

[13]  D. B. Duncan MULTIPLE RANGE AND MULTIPLE F TESTS , 1955 .

[14]  T. Caliński,et al.  Clustering means in ANOVA by simultanuous testing , 1985 .

[15]  D. Saville Multiple Comparison Procedures: The Practical Solution , 1990 .

[16]  M. Keuls,et al.  The use of the „studentized range” in connection with an analysis of variance , 1952, Euphytica.

[17]  R. A. Waller,et al.  A Bayes Rule for the Symmetric Multiple Comparisons Problem , 1969 .

[18]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .