Hawthorne Control Procedures in Educational Experiments: A Reconsideration of Their Use and Effectiveness

This article reports on a descriptive analysis of research practices and a meta-analysis of effect sizes associated with control groups employed to address Hawthorne effects in educational experiments. The descriptive analysis of 86 studies revealed a diversity of practices designed to control one of three artifact variables: special attention, activity related to the experimental task, or awareness of participation in an experiment. The meta-analysis provided no evidence for a Hawthorne versus no-treatment control difference. Moreover, a detailed analysis of these studies by their control procedure, and subsequently by other moderator variables, also revealed no systematic trends to suggest a specific artifact source. A within-study analysis of the pattern of treatment/Hawthorne/control group effect sizes suggested that the artifact controls were of limited utility. Increased research is urged into other artifacts and alternative control procedures that the educational researcher should consider.

[1]  Cam-Loi Huynh,et al.  Placebo, Hawthorne, and Other Artifact Controls: Researchers’ Opinions and Practices , 1989 .

[2]  M. Wittrock.  Handbook of research on teaching , 1986 .

[3]  J. G. Adair,et al.  The Hawthorne effect: A reconsideration of the methodological artifact. , 1984 .

[4]  Carvin L. Brown,et al.  The use and abuse of control groups in program evaluation , 1982 .

[5]  L. Hedges.  Fitting Categorical Models to Effect Sizes from a Series of Experiments , 1982 .

[6]  L. Hedges.  Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[7]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[8]  The Effects of Instruction on Test-Taking Skills in Second-Grade Black Children , 1981 .

[9]  Gene V. Glass,et al.  The benefits of psychotherapy , 1980 .

[10]  Chasey Wc,et al.  Effect of motor development on body image scores for institutionalized mentally retarded children. , 1974 .

[11]  W. C. Chasey,et al.  Effect of motor development on body image scores for institutionalized mentally retarded children. , 1974, American journal of mental deficiency.

[12]  M. Orne,et al.  COMMUNICATION BY THE TOTAL EXPERIMENTAL SITUATION: WHY IT IS IMPORTANT, HOW IT IS EVALUATED, AND ITS SIGNIFICANCE FOR THE ECOLOGICAL VALIDITY OF FINDINGS , 1973 .

[13]  Jason Millman,et al.  Research on human behavior;: A systematic guide to method , 1972 .

[14]  Conwell Higgins,et al.  Remedial teaching of multiplication and division: programmed textbook versus workbook–a pilot study , 1965 .

[15]  The use of the white films in the teaching of physics , 1962 .

[16]  F. J. Roethlisberger,et al.  Management and the Worker , 1941 .