Synthesizing Outcomes: How to Use Research Evidence from Many Studies.

As evidence about a new program or curriculum accumulates from many studies, a time comes to synthesize findings. What does all the research show? Is a program effective? Does it work broadly, or only with certain people in special settings? Literature reviews are designed to answer such questions, but all too often the effort is unsystematic. In this essay, David Pillemer and Richard Light suggest that these reviews are a major scientific challenge. They discuss several ways of extracting information from a group of related studies, and argue that a key ingredient of a strong synthesis is an analyst's attention to detailed features of each study: who participated, in what setting, with what exact program or treatment. Knowing such details is a prerequisite to explaining conflicting outcomes, an effort the authors believe makes fullest use of the varied information the studies offer.

[1]  Harry Munsinger,et al.  The adopted child's IQ: A critical review. , 1975 .

[2]  P. Gallo.  Meta-analysis: A mixed meta-phor? , 1978 .

[3]  R. P. Carver.  The Case Against Statistical Significance Testing , 1978 .

[4]  H. Munsinger.  Reply to Kamin. , 1978 .

[5]  Sherryl Browne Graves,et al.  Children's Television More than Mere Entertainment , 1974 .

[6]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[7]  R. Mccall.  Challenges to a science of developmental psychology. , 1977 .

[8]  R. Rosenthal.  Combining results of independent studies. , 1978 .

[9]  R. Light,et al.  Accumulating Evidence: Procedures for Resolving Contradictions among Different Research Studies. , 1971 .

[10]  Chen-Lin C. Kulik,et al.  A Meta-Analysis of Outcome Studies of Keller's Personalized System of Instruction. , 1979 .

[11]  R. Fowler,et al.  The effects of primary reward on the I.Q. performance of grade-school children as a function of initial I.Q. level. , 1976, Journal of applied behavior analysis.

[12]  Judith A. Hall.  Gender Effects in Decoding Nonverbal Cues , 1978 .

[13]  L. Kamin.  Comment on Munsinger's review of adoption studies. , 1978 .

[14]  M. L. Smith,et al.  Meta-analysis of psychotherapy outcome studies. , 1977, The American psychologist.

[15]  Marshall S. Smith,et al.  Report Analysis: The Impact of Head Start. , 1970 .

[16]  G. Glass.  9: Integrating Findings: The Meta-Analysis of Research , 1977 .

[17]  H. Eysenck.  An exercise in mega-silliness. , 1978 .

[18]  J. Shaver.  The Productivity of Educational Research and the Applied-Basic Research Distinction1 , 1979 .