Analysis of means: a generalized approach using R

Papers on the analysis of means (ANOM) have been circulating in the quality control literature for decades, routinely describing it as a statistical stand-alone concept. Therefore, we clarify that ANOM should rather be regarded as a special case of a much more universal approach known as multiple contrast tests (MCTs). Perceiving ANOM as a grand-mean-type MCT paves the way for implementing it in the open-source software R. We give a brief tutorial on how to exploit R's versatility and introduce the R package ANOM for drawing the familiar decision charts. Beyond that, we illustrate two practical aspects of data analysis with ANOM: firstly, we compare merits and drawbacks of ANOM-type MCTs and ANOVA F-test and assess their respective statistical powers, and secondly, we show that the benefit of using critical values from multivariate t-distributions for ANOM instead of simple Bonferroni quantiles is oftentimes negligible.

[1]  Norbert Lloyd Enrick An Analysis of Means in a Three-Way Factorial , 1976 .

[2]  D. A. Williams,et al.  A test for differences between treatment means when several dose levels are compared with a zero dose control. , 1971, Biometrics.

[3]  Thomas P. Ryan The Analysis of Means: A Graphical Method for Comparing Means, Rates, and Proportions , 2006 .

[4]  P. J. Huber The behavior of maximum likelihood estimates under nonstandard conditions , 1967 .

[5]  A. B. Yeh,et al.  A likelihood-ratio-based EWMA control chart for monitoring variability of multivariate normal processes , 2004 .

[6]  Mariano Ruiz Espejo,et al.  The Analysis of Means: A Graphical Method for Comparing Means, Rates, and Proportions , 2006, Technometrics.

[7]  Nabendu Pal,et al.  Comparing several population means: a parametric bootstrap method, and its comparison with usual ANOVA F test as well as ANOM , 2010, Comput. Stat..

[8]  P. Wludyka,et al.  Two non-parametric, analysis-of-means-type tests for homogeneity of variances , 1999 .

[9]  J. Cornfield,et al.  Tables of Percentage Points for the Studentized Maximum Absolute Deviate in Normal Samples , 1955 .

[10]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[11]  Williams Da,et al.  The comparison of several dose levels with a zero dose control. , 1972 .

[12]  P. R. Nelson,et al.  Analysis of means type tests for variances using subsampling and jackknifing , 1997 .

[13]  Peter R. Nelson,et al.  Power Curves for the Analysis of Means , 1985 .

[14]  Edward J. Dudewicz,et al.  Exact Analysis of Means With Unequal Variances , 2002, Technometrics.

[15]  T. Hothorn,et al.  Simultaneous Inference in General Parametric Models , 2008, Biometrical journal. Biometrische Zeitschrift.

[16]  J. Hess,et al.  Analysis of variance , 2018, Transfusion.

[17]  H. White,et al.  Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties☆ , 1985 .

[18]  A robust I-sample analysis of means type randomization test for variances for unbalanced designs , 2004 .

[19]  P. F. Ramig,et al.  Applications of the Analysis of Means , 1983 .

[20]  U P Arborelius,et al.  The effects of a pneumatic stool and a one-legged stool on lower limb joint load and muscular activity during sitting and rising. , 1993, Ergonomics.

[21]  T. Hothorn,et al.  Multiple Comparisons Using R , 2010 .

[22]  Ellis R. Ott,et al.  Analysis of Means--A Graphical Procedure , 1983 .

[23]  R. Tobias,et al.  On the Computation of the Distribution for the Analysis of Means , 2004 .

[24]  K. Homa Analysis of Means Used to Compare Providers' Referral Patterns , 2007, Quality management in health care.

[25]  Ludwig A Hothorn,et al.  Multiple Contrast Tests in the Presence of Heteroscedasticity , 2008, Biometrical journal. Biometrische Zeitschrift.

[26]  C. Dunnett A Multiple Comparison Procedure for Comparing Several Treatments with a Control , 1955 .

[27]  R. Holder,et al.  Introducing analysis of means to medical statistics , 2012, BMJ quality & safety.

[28]  C. Rao,et al.  A graphical method for testing the equality of several variances , 1997 .

[29]  J. S. Long,et al.  Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model , 2000 .

[30]  W. Wien,et al.  Econometric Computing with HC and HAC Covariance Matrix Estimators , 2004 .

[31]  Peter R. Nelson,et al.  A Comparison of Sample Sizes for the Analysis of Means and the Analysis of Variance , 1983 .

[32]  Frank Bretz An extension of the Williams trend test to general unbalanced linear models , 2006, Comput. Stat. Data Anal..

[33]  C. Rao,et al.  Anom - type graphical method for testing the equality of several variances , 1998 .

[34]  Edgar Brunner,et al.  Rank-based multiple test procedures and simultaneous confidence intervals , 2012 .

[35]  Edward G. Schilling A Systematic Approach to the Analysis of Means, Part I. Analysis of Treatment Effects , 1973 .

[36]  Peter R. Nelson,et al.  Additional Uses for the Analysis of Means and Extended Tables of Critical Values , 1993 .

[37]  J. Subramani Analysis of means for experimental designs with missing observations , 1992 .

[38]  M. Hasler Heteroscedasticity: multiple degrees of freedom vs. sandwich estimation , 2014, Statistical Papers.

[39]  Philip Pallmann,et al.  A Levene-type test of homogeneity of variances against ordered alternatives , 2014, Comput. Stat..

[40]  Peter R. Nelson,et al.  An analysis-of-means-type test for variances from normal populations , 1997 .

[41]  Williams Da,et al.  A test for differences between treatment means when several dose levels are compared with a zero dose control. , 1971 .

[42]  L. Hothorn,et al.  Approximate Simultaneous Confidence Intervals for Multiple Contrasts of Binomial Proportions , 2008, Biometrical journal. Biometrische Zeitschrift.

[43]  P. R. Nelson,et al.  Power Curves for the Analysis of Means for Variances , 2001 .

[44]  H. Levene Robust tests for equality of variances , 1961 .

[45]  Alan Agresti,et al.  Simple and Effective Confidence Intervals for Proportions and Differences of Proportions Result from Adding Two Successes and Two Failures , 2000 .

[46]  L. S. Nelson Exact Critical Values for Use with the Analysis of Means , 1983 .

[47]  T. Hothorn,et al.  A Robust Procedure for Comparing Multiple Means under Heteroscedasticity in Unbalanced Designs , 2010, PloS one.

[48]  Edgar Brunner,et al.  Are Multiple Contrast Tests Superior to the ANOVA? , 2013, The international journal of biostatistics.

[49]  Peter R. Nelson,et al.  Exact critical points for the analysis of means , 1982 .

[50]  S. Yiğit,et al.  Comparison of ANOVA-F and ANOM tests with regard to type I error rate and test power , 2013 .

[51]  A. Genz,et al.  Computation of Multivariate Normal and t Probabilities , 2009 .

[52]  Edward J. Dudewicz,et al.  Heteroscedastic Analysis of Means (Hanom) , 2003 .

[53]  S. Bakir Analysis of means using ranks for the randomized complete block design , 1994 .

[54]  F. T. Wright,et al.  Comparison of Several Treatments with a Control Using Multiple Contrasts , 1987 .

[55]  Thomas J. Santner,et al.  Design of Experiments: Ranking and Selection , 1984 .

[56]  Saad T. Bakir,et al.  Analysis of Means Using Ranks , 1989 .

[57]  D. A. Williams,et al.  The comparison of several dose levels with a zero dose control. , 1972, Biometrics.

[58]  C. Rao,et al.  Analysis of Means—A Review , 2005 .

[59]  Edward G. Schilling,et al.  A Systematic Approach to the Analysis of Means, Part II. Analysis of Contrasts, Part III. Analysis of Non-Normal Data , 1973 .

[60]  Gemechis D. Djira,et al.  Detecting Relative Changes in Multiple Comparisons with an Overall Mean , 2009 .

[61]  J. Neher A problem of multiple comparisons , 2011 .

[62]  A. Genz,et al.  On the Numerical Availability of Multiple Comparison Procedures , 2001 .

[63]  P. Wludyka,et al.  Robust I-sample analysis of means type randomization tests for variances , 2001 .