Internal Invalidity in Pretest-Posttest Self-Report Evaluations and a Re-evaluation of Retrospective Pretests

True experimental designs (Designs 4, 5, and 6 of Campbell & Stanley, 1963) are thought to provide internally valid results. This paper describes five studies involving the evaluation of various treat ment interventions and identifies a source of inter nal invalidity when self-report measures are used in a Pretest-Posttest manner. An alternative approach (Retrospective Pretest-Posttest design) to measuring change is suggested, and data comparing its ac curacy with the traditional Pretest-Posttest design in measuring treatment effects is presented. Finally, the implications of these findings for evaluation re search using self-report instruments and the strengths and limitations of retrospective measures are discussed.

[1]  Robert L. Linn,et al.  The Determination of the Significance of Change Between Pre- and Posttesting Periods , 1977 .

[2]  J. Galassi,et al.  Behavioral performance in the validation of an assertiveness scale , 1976 .

[3]  R. Mclean,et al.  Using a repeated measures ANOVA to analyze the data from a pretest-posttest design : a potentially confusing task , 1975 .

[4]  J. Galassi,et al.  An assertiveness inventory for adults. , 1975 .

[5]  C. Hill.  a process approach for establishing counseling goals and outcomes , 1975 .

[6]  S. Bem.  The measurement of psychological androgyny. , 1974, Journal of consulting and clinical psychology.

[7]  J. Galassi,et al.  The college self-expression scale: A measure of assertiveness , 1974 .

[8]  M. Hersen,et al.  Components of assertive behavior. , 1973, Journal of clinical psychology.

[9]  S. Rathus.  Instigation of assertive behavior through videotape-mediated assertive models and directed practice. , 1973, Behaviour research and therapy.

[10]  Leslie L. Roos,et al.  Quasi-experimental approaches; testing theory and evaluating policy , 1973 .

[11]  John M. Neale,et al.  Science and behavior : an introduction to methods of research / John M. Neale , 1973 .

[12]  James E. Birren,et al.  Age changes and cohort difference in personality. , 1972 .

[13]  Ruth Scheeffer.  Toward effective counseling and psychotherapy , 1971 .

[14]  R Cawley,et al.  Evaluation of psychotherapy. , 1971, Psychological medicine.

[15]  L. Cronbach,et al.  How we should measure "change": Or should we? , 1970 .

[16]  R. Carkhuff.  Helping and human relations : a primer for lay and professional helpers , 1971 .

[17]  F. J. McGuigan.  The G statistic. An index of amount learned , 1967 .

[18]  L. Wolberg.  THE EVALUATION OF PSYCHOTHERAPY. , 1964, Proceedings of the annual meeting of the American Psychopathological Association.

[19]  Hans J. Eysenck,et al.  The Open and Closed Mind , 1961 .

[20]  M. Deutsch,et al.  Interracial Housing: A Psychological Evaluation of a Social Experiment , 1951 .