Examining Bilingual Education Research Through Meta-Analysis and Narrative Review: A Response to Baker

In this response to Baker’s (1987) “Comment on Willig’s ‘A Meta-Analysis of Selected Studies on the Effectiveness of Bilingual Education,’” I address major questions raised by Baker and present counter arguments to each. First, I contend that the questions addressed in the meta-analysis were more appropriate for answering the concerns of the White House review team than were those addressed in Baker and de Kanter (1981); second, I provide evidence suggesting that one of Baker’s major points—that Willig (1985) did not include the studies from Baker and de Kanter (1983)—is primarily a rhetorical strategy; third, I explain the process of information gathering in the meta-analysis and compare my information from specific studies to that reported in Baker and de Kanter (1981), demonstrating pitfalls in Baker’s review methods; fourth, I present my rationale for the exclusion of specific studies not included in the meta-analysis and demonstrate that Baker’s treatment of these studies is flawed; finally, I clarify several technical questions raised by Baker.

[1]  A. Cohen,et al.  A sociolinguistic approach to bilingual education , 1970 .

[2]  John Bernard Lum.  An Effectiveness Study of English as a Second Language (ESL) and Chinese Bilingual Methods. , 1971 .

[3]  Tracy Gray,et al.  Response to AIR Study "Evaluation of the Impact of ESEA Title VII Spanish/English Bilingual Education Program.". , 1977 .

[4]  Malcolm N. Danoff.  Evaluation of the Impact of ESEA Title VII Spanish/English Bilingual Education Program. Volume III: Year Two Impact Data, Educational Process, and In-Depth Analyses. , 1978 .

[5]  Gene V. Glass,et al.  Meta-Analysis of Research on Class Size and Achievement , 1979 .

[6]  D. Legarreta.  The Effects of Program Models on Language Acquisition by Spanish Speaking Children. , 1979 .

[7]  A. J. Barr,et al.  SAS user's guide , 1979 .

[8]  Gene V. Glass,et al.  Choice of the Metric for Effect Size in Meta-analysis , 1980 .

[9]  Gene V. Glass,et al.  Meta-analysis of Research on Class Size and Its Relationship to Attitudes and Instruction , 1980 .

[10]  Keith Baker,et al.  Effectiveness of Bilingual Education: A Review of the Literature. Final Draft Report. , 1981 .

[11]  R. Freund,et al.  SAS for linear models : a guide to the ANOVA and GLM procedures , 1981 .

[12]  A. C. Willig.  The Effectiveness of Bilingual Education: Review of a Report. , 1981 .

[13]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[14]  Paul R. Thompson.  AUTHOR! , 1982, The Lancet.

[15]  Larry V. Hedges,et al.  The Effects of Class Size: An Examination of Rival Hypotheses , 1983 .

[16]  Fred Genesee,et al.  Second Language Learning Through Immersion: A Review of U.S. Programs , 1985 .

[17]  Ann Cecelia Willig,et al.  A Meta-Analysis of Selected Studies on the Effectiveness of Bilingual Education , 1985 .

[18]  Walter G. Secada.  This Is 1987, Not 1980: A Comment on a Comment , 1987 .

[19]  K. Baker.  Comment on Willig’s “A Meta-Analysis of Selected Studies in the Effectiveness of Bilingual Education” , 1987 .