A power‐analytic examination of contemporary communication research

While Type I error has enjoyed widespread attention in communication research, the interrelated concepts of statistical power and Type II error have been generally neglected. In order to assess the extent of the disregard for these considerations, a statistical power analysis of the articles published in the 1973 volumes of the nine major communication journals was conducted. The results indicated that published communication research was generally lacking in statistical power. The average power estimates for small, medium, and large effects were .18, .52, and .79, respectively. These estimates correlate with previously conducted power analyses by psychological and educational researchers, thus evidencing the fact that low statistical power pervades behavioral research. Recommendations for the elimination of this problem were advanced, and the role of power analysis as an important consideration in experimental design was explicated.

[1]  John E. Overall.  Classical statistical hypotheses testing within the context of Bayesian theory. , 1969 .

[2]  Quinn McNemar,et al.  At random: Sense and nonsense. , 1960 .

[3]  Jacob Cohen,et al.  The statistical power of abnormal-social psychological research: a review. , 1962, Journal of abnormal and social psychology.

[4]  Jeffrey Katzer,et al.  An Analysis of the Use of Statistical Testing in Communication Research , 1973 .

[5]  H. Friedman.  Magnitude of experimental effect and a table for its rapid estimation. , 1968 .

[6]  Gordon Tullock.  Publication Decisions and Tests of Significance—A Comment , 1959 .

[7]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[8]  D. Bakan,et al.  The test of significance in psychological research. , 1966, Psychological bulletin.

[9]  H. Scheffé.  A METHOD FOR JUDGING ALL CONTRASTS IN THE ANALYSIS OF VARIANCE , 1953 .

[10]  Robert Rosenthal,et al.  The Interpretation of Levels of Significance by Psychological Researchers , 1963 .

[11]  M. Sidman.  Tactics of Scientific Research , 1960 .

[12]  Jacob Cohen,et al.  Statistical Power Analysis and Research Results. , 1973 .

[13]  Jacob Cohen,et al.  Approximate Power and Sample Size Determination for Common one-Sample and two-Sample Hypothesis Tests , 1970 .

[14]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[15]  J. Tukey.  The Future of Data Analysis , 1962 .

[16]  T. Sterling.  Publication Decisions and their Possible Effects on Inferences Drawn from Tests of Significance—or Vice Versa , 1959 .

[17]  Allen L. Edwards,et al.  Experimental Design in Psychological Research. , 1951 .

[18]  James K. Brewer,et al.  On the Power of Statistical Tests in the American Educational Research Journal 1 , 1972 .