On Making Progress in Communication Science

This essay advances practices for designing, analyzing, and reporting communication research. The arguments presented center around improving researchers' abilities to cumulate results across studies, but also apply to improving the utility of the individual study. Practices advocated include: (a) sophistication, falsification, and replication as important criteria for evaluating research design; (b) diminishing the importance of the null hypothesis statistical significance test, employing confidence intervals, and correcting correlations for both measurement error and range restriction when analyzing data; and (c) including both descriptive statistics and measures of the strength of bivariate relationships when reporting results.

[1]  D. Bakan,et al.  The test of significance in psychological research. , 1966, Psychological bulletin.

[2]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[3]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[4]  Franklin J. Boster,et al.  The Relative Effectiveness of a Direct Request Message and a Pregiving Message on Friends and Strangers , 1995 .

[5]  K. Popper,et al.  Conjectures and refutations;: The growth of scientific knowledge , 1972 .

[6]  D. T. Regan,et al.  Effects of a favor and liking on compliance , 1971 .

[7]  R. Abelson.  Statistics As Principled Argument , 1995 .

[8]  K. Weick.  Small wins: Redefining the scale of social problems. , 1984 .

[9]  A. D. Jones,et al.  Obedience to Authority , 1974 .

[10]  Donald B. Rubin,et al.  A Note on Percent Variance Explained as A Measure of the Importance of Effects , 1979 .

[11]  Muzafer Sherif,et al.  A study of some social factors in perception. , 1935 .

[12]  L. Cronbach,et al.  Time-limit tests: Estimating their reliability and degree of speeding , 1951, Psychometrika.

[13]  D. R. Heise.  Separating reliability and stability in test-retest correlation. , 1969 .

[14]  C. Spearman.  CORRELATION CALCULATED FROM FAULTY DATA , 1910 .

[15]  B. Latané,et al.  The Unresponsive Bystander: Why Doesn't He Help? , 1972 .

[16]  G C Chu,et al.  Fear arousal, efficacy, and imminency. , 1966, Journal of personality and social psychology.

[17]  L. Festinger,et al.  Cognitive consequences of forced compliance. , 2011, Journal of abnormal psychology.

[18]  H. Leventhal,et al.  A FIELD EXPERIMENT ON FEAR AROUSAL WITH DATA ON THE VALIDITY OF QUESTIONNAIRE MEASURES. , 1964, Journal of personality.

[19]  J. Hunter.  Needed: A Ban on the Significance Test , 1997 .

[20]  D. Wegner.  The Premature Demise of the Solo Experiment , 1992 .

[21]  W. Brown.  SOME EXPERIMENTAL RESULTS IN THE CORRELATION OF MENTAL ABILITIES1 , 1910 .

[22]  G. Gigerenzer,et al.  Do studies of statistical power have an effect on the power of studies , 1989 .

[23]  P. Rozin.  Social Psychology and Science: Some Lessons From Solomon Asch , 2001 .

[24]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[25]  Idries Shah,et al.  Caravan of Dreams , 1968 .

[26]  S. Asch.  Studies of independence and conformity: I. A minority of one against a unanimous majority. , 1956 .

[27]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[28]  R. P. Carver.  The Case Against Statistical Significance Testing , 1978 .

[29]  D. Kahneman,et al.  Do Frequency Representations Eliminate Conjunction Effects? An Exercise in Adversarial Collaboration , 2001, Psychological science.

[30]  Thomas S. Frentz.  Falsification procedures for behavioral research in communication , 1983 .