Is It Really Robust

Empirical evidence to the robustness of the analysis of variance (ANOVA) concerning violation of the normality assumption is presented by means of Monte Carlo methods. High-quality samples underlying normally, rectangularly, and exponentially distributed basic populations are created by drawing samples which consist of random numbers from respective generators, checking their goodness of fit, and allowing only the best 10% to take part in the investigation. A one-way fixed-effect design with three groups of 25 values each is chosen. Effect-sizes are implemented in the samples and varied over a broad range. Comparing the outcomes of the ANOVA calculations for the different types of distributions, gives reason to regard the ANOVA as robust. Both, the empirical type I error α and the empirical type II error β remain constant under violation. Moreover, regression analysis identifies the factor “type of distribution” as not significant in explanation of the ANOVA results.

[1]  G. Glass,et al.  Consequences of Failure to Meet Assumptions Underlying the Fixed Effects Analyses of Variance and Covariance , 1972 .

[2]  S. K. Park,et al.  Random number generators: good ones are hard to find , 1988, CACM.

[3]  T. Micceri.  The unicorn, the normal curve, and other improbable creatures. , 1989 .

[4]  Jacob Cohen,et al.  Statistical Power Analysis for Multiple Regression/Correlation: A Computer Program , 1990 .

[5]  Michael R. Harwell,et al.  Summarizing Monte Carlo Results in Methodological Research: The One- and Two-Factor Fixed Effects ANOVA Cases , 1992 .

[6]  Edgar Erdfelder,et al.  GPOWER: A general power analysis program , 1996 .

[7]  H. Keselman,et al.  Consequences of Assumption Violations Revisited: A Quantitative Review of Alternatives to the One-Way Analysis of Variance F Test , 1996 .

[8]  Hisashi Tanizaki,et al.  Power comparison of non-parametric tests: Small-sample properties from Monte Carlo experiments , 1997 .

[9]  Carl J. Huberty,et al.  Statistical Practices of Educational Researchers: An Analysis of their ANOVA, MANOVA, and ANCOVA Analyses , 1998 .

[10]  D. W. Zimmerman,et al.  Invalidation of Parametric and Nonparametric Statistical Tests by Concurrent Violation of Two Assumptions , 1998 .

[11]  Brian Gough,et al.  GNU Scientific Library Reference Manual - Third Edition , 2003 .

[12]  G. Cumming,et al.  Inference by eye: confidence intervals and how to read pictures of data. , 2005, The American psychologist.

[13]  James Algina,et al.  A generally robust approach for testing hypotheses and setting confidence intervals for effect sizes. , 2008, Psychological methods.

[14]  Eugene S. Edgington,et al.  Randomization Tests , 2011, International Encyclopedia of Statistical Science.