The Placebo Control Group: An Analysis of Its Effectiveness in Educational Research

This article reports a review and meta-analysis of placebo control groups in educational experiments. Studies were clustered into control procedures that included explicit manipulation of attentional elements (Attn + ), explicit descrip tion of the placebo activity plus implied reference to attention (Act + ), and exclusive reference to the activity (Act-Only). The Act + procedure was the practice most con sistent with the model for a placebo control. Compared with the other two proce dures, Act + controls were employed more often in interpersonal rather than aca demic studies in which subjects knew they were participating in an experiment, had an expectancy for performance change, and the placebo activity resembled the treat ment task. Significantly larger effect sizes in Act + studies were found with the ab sence of experimenter controls and child subjects. The results were compared with findings from Hawthorne-labeled control groups in educational studies, and the dif ferences between placebo-labeled control groups in education and those used in psy chotherapy research were considered. ORIGINATING IN MEDICAL RESEARCH, the application of the concepts of placebo effect and placebo controls to non-drug research was first suggested by Rosenthal and Frank (1956; see Goldstein, 1962). The concepts were borrowed because researchers in psychology and education recognized that reactive effects arising in the conduct of drug research were also encountered in research in the behavioral sciences. In the drug context, a placebo is defined as an inert substance with no known pharmacological effect (Shapiro, 1960). Its meaning, when applied to tests of the outcome ef fectiveness of therapy or to classroom tests of new curricula or teaching methods, is less clear. Indeed, the fundamental questions of whether and how the placebo concept applies to behavioral research has never been ade quately addressed.

[1]  H. Schroeder,et al.  Self-statement modification in the treatment of child behavior disorders: a meta-analysis. , 1989, Psychological bulletin.

[2]  J. G. Adair,et al.  Hawthorne Control Procedures in Educational Experiments: A Reconsideration of Their Use and Effectiveness , 1989 .

[3]  M. Sprangers,et al.  On delay and reassessment of retrospective preratings , 1988 .

[4]  Gene V. Glass,et al.  Research and Evaluation in Education and the Social Sciences , 1986 .

[5]  Joseph C. Rotter,et al.  Anxiety management training and study skills counseling for students on self-esteem and test anxiety and performance. , 1986 .

[6]  S. Spence,et al.  Responsiveness of isolated versus rejected children to social skills training. , 1986, Journal of child psychology and psychiatry, and allied disciplines.

[7]  M. Parloff Placebo controls in psychotherapy research: a sine qua non or a placebo for research problems? , 1986, Journal of consulting and clinical psychology.

[8]  M. Wittrock Handbook of research on teaching , 1986 .

[9]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[10]  Irving Kirsch,et al.  Response expectancy as a determinant of experience and behavior. , 1985 .

[11]  H. Eysenck Psychotherapy effects: Real or imaginary? , 1985 .

[12]  W. Henry The time-released placebo: A reply to Critelli and Neumann. , 1985 .

[13]  W. Borg Dealing with Threats to Internal Validity That Randomization Does not Rule Out , 1984 .

[14]  W. Wilkins Psychotherapy: the powerful placebo. , 1984, Journal of consulting and clinical psychology.

[15]  THE EVALUATION OF INNOVATION , 1984 .

[16]  G. Pallrand,et al.  Spatial Ability and Achievement in Introductory Physics. , 1984 .

[17]  J. G. Adair,et al.  The Hawthorne effect: A reconsideration of the methodological artifact. , 1984 .

[18]  O. R. Evans An investigation of the motivational-study skills-self-regulatory skills model for improving academic competence in community college students , 1984 .

[19]  B. Hayslip,et al.  THE USE OF STRESS INOCULATION IN THE TREATMENT OF TEST ANXIETY IN OLDER STUDENTS , 1984 .

[20]  Natalino S. Carrea Effects of andragogical teacher training on adult student attendance and satisfaction , 1984 .

[21]  J. Critelli,et al.  The placebo. Conceptual analysis of a construct in transition. , 1984, The American psychologist.

[22]  P. Suedfeld The subtractive expectancy placebo procedure: a measure of non-specific factors in behavioural interventions. , 1984, Behaviour research and therapy.

[23]  D. Tosi,et al.  Modification of irrational ideas and test anxiety through rational stage directed hypnotherapy [RSDH]. , 1983, Journal of clinical psychology.

[24]  A. Stolberg,et al.  Modification of anger in children by affective imagery training , 1983, Journal of abnormal child psychology.

[25]  D. Shapiro,et al.  Comparative therapy outcome research: methodological implications of meta-analysis. , 1983, Journal of consulting and clinical psychology.

[26]  Carvin L. Brown,et al.  The use and abuse of control groups in program evaluation , 1982 .

[27]  D. Thompson,et al.  Values Clarification and Behavioral Group Counseling with Ninth-Grade Boys in a Residential School. , 1982 .

[28]  R. Lent,et al.  Cue-controlled relaxation and systematic desensitization versus nonspecific factors in treating test anxiety. , 1982 .

[29]  J. M. Olson,et al.  An expectancy-attribution model of the effects of placebos. , 1981, Psychological review.

[30]  W. Rasbury,et al.  Cognitive self-instruction for the control of impulsive classroom behavior: Ensuring the treatment package , 1981, Journal of abnormal child psychology.

[31]  A. Barabasz,et al.  Effects of rational-emotive therapy on psychophysiological and reported measures of test anxiety arousal. , 1981, Journal of clinical psychology.

[32]  Mohamed Ally,et al.  Can images provide contextual support for prose? , 1981 .

[33]  L. Hedges Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[34]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[35]  S. Spence,et al.  Social skills training with adolescent male offenders--II. Short-term, long-term and generalized effects. , 1981, Behaviour research and therapy.

[36]  J. Horan Experimentation in Counseling and Psychotherapy Part I: New Myths About Old Realities , 1980 .

[37]  A. La Greca,et al.  Social skills training with elementary school students: a behavioral group approach. , 1980, Journal of consulting and clinical psychology.

[38]  E. Cole,et al.  The Effect of Two School-based Intervention Programs on Depressive Symptoms in Preadolescents , 1980 .

[39]  Gene V. Glass,et al.  The benefits of psychotherapy , 1980 .

[40]  E. T. Hallberg,et al.  Effects of Assertion Training on Aggressive Behavior of Adolescents. , 1979 .

[41]  Alan E. Kazdin,et al.  Therapy outcome questions requiring control of credibility and treatment-generated expectancies* , 1979 .

[42]  William J. Fremouw,et al.  Peer versus Professional Models for Study Skills Training. , 1978 .

[43]  J. Alcorn,et al.  Use of electromyographic biofeedback and cue-controlled relaxation in the treatment of test anxiety. , 1978, Journal of consulting and clinical psychology.

[44]  K. O’leary,et al.  Conceptual, methodological, and ethical problems of placebo groups in psychotherapy research. , 1978, The American psychologist.

[45]  N. Jacobson,et al.  Design and assessment of nonspecific control groups in behavior modification research , 1977 .

[46]  M. O'connor The effect of role-taking training on role-taking and social behaviors in young children , 1977 .

[47]  P. Rupert,et al.  Desensitization and Self-Control in the Treatment of Test Anxiety. , 1977 .

[48]  J. Wine Test Anxiety and Self-Attention. , 1974 .

[49]  D. Randolph,et al.  Covert Reinforcement in the Treatment of Test Anxiety. , 1974 .

[50]  Joyce A. Smith,et al.  Effect of Videotaped Models on the Communications of College Students in Counseling. , 1974 .

[51]  W. W. Wenrich,et al.  Treatment of Test Anxiety by Group Implosive Therapy , 1973, Psychological reports.

[52]  W. W. Wenrich,et al.  Massed Group Desensitization in Reduction of Test-Anxiety , 1973, Psychological reports.

[53]  M. Orne,et al.  COMMUNICATION BY THE TOTAL EXPERIMENTAL SITUATION: WHY IT IS IMPORTANT, HOW IT IS EVALUATED, AND ITS SIGNIFICANCE FOR THE ECOLOGICAL VALIDITY OF FINDINGS , 1973 .

[54]  P. Payne,et al.  Effects of Supervisor Style on the Learning of Empathy in a Supervision Analogue. , 1972 .

[55]  J. A. Hamilton,et al.  Peer Social Modeling in Promoting Career Behaviors , 1972 .

[56]  Gary Saretsky,et al.  The OEO P.C. Experiment and the John Henry Effect. , 1972 .

[57]  F. W. Hughes Self-Concept Development in Inner-City Seventh Grade Youth as Affected by the Influence of Community School Counseling on Significant Others. , 1972 .

[58]  Anthony Sporborg The Effect of Programmed Productive Thinking Materials on the Divergent and Convergent Test Scores of Sixth Grade Students. , 1971 .

[59]  C. Madsen,et al.  Group Desensitization for Anxious Children with Reading Problems. , 1970 .

[60]  John C. Mellon Transformational Sentence Combining: A Method for Enhancing the Development of Syntactic Fluency in English Composition , 1969 .

[61]  Glenn H. Bracht,et al.  The External Validity of Experiments1 , 1968 .

[62]  R. Rosenthal,et al.  Teachers' Expectancies: Determinants of Pupils' IQ Gains , 1966, Psychological reports.

[63]  M. Maxwell,et al.  AN EXPERIMENT ON THE EFFECT OF MOTIVATIONAL APPEAL VS. TECHNIQUES UPON READING RATE IMPROVEMENT IN A GROUP OF COLLEGE STUDENTS. , 1965 .

[64]  A. Goldstein,et al.  Therapist-patient expectancies in psychotherapy , 1962 .

[65]  J. Frank,et al.  Psychotherapy and the placebo effect. , 2011, Psychological bulletin.

[66]  F. J. Roethlisberger,et al.  Management and the Worker , 1941 .