E. Regression Discontinuity Design: An Effectiveness-Based Evaluation of Five State Pre-Kindergarten Programs

Since 1980, the number of state pre-kindergarten (pre-K) programs has more than doubled, with 38 states enrolling more than one million children in 2006 alone. This study evaluates how five state pre-K programs affected children's receptive vocabulary, math, and print awareness skills. Taking advantage of states' strict enrollment policies determined by a child's date of birth, a regression-discontinuity design was used to estimate effects in Michigan, New Jersey, Oklahoma, South Carolina, and West Virginia. For receptive vocabulary, only New Jersey and Oklahoma yielded significant standardized impacts, though two of the three other coefficients were in a direction indicating positive effects. For math, all the coefficients were positive but only Michigan and New Jersey yielded reliable results. The largest impacts were for print awareness, where all five coefficients were positive and four were reliable in Michigan, New Jersey, South Carolina, and West Virginia. The five states were not randomly selected and, on average, have higher quality program standards than non-studied states, precluding formal extrapolation to the nation at large. However, our sample of states differed in many other ways, permitting the conclusion that state pre-K programs can have positive effects on children's cognitive skills, though the magnitude of these effects varies by state and outcome. © 2008 by the Association for Public Policy Analysis and Management.

[1]  K. McGrew,et al.  Woodcock-Johnson tests of achievement. , 2009 .

[2]  Graciela Ardoino Batería III Woodcock-Muñoz. Muñoz-Sandoval, A. F.; Woodcock, R. W.; McGrew, K. S. y Mather, N. Batería III Woodcock-Muñoz.Itasca. IL: Riverside Publishing , 2009 .

[3]  John O. Willis,et al.  Peabody Picture Vocabulary Test–Third Edition , 2008 .

[4]  Arthur S. Goldberger,et al.  Selection bias in evaluating treatment effects: Some formal illustrations , 2008 .

[5]  Thomas D. Cook,et al.  "Waiting for Life to Arrive": A history of the regression-discontinuity design in Psychology, Statistics and Economics , 2008 .

[6]  D. Black Evaluating the Regression Discontinuity Design Using Experimental Data , 2008 .

[7]  S. Loeb,et al.  Early childhood and the achievement gap , 2007 .

[8]  Janet Currie How should we interpret the evidence about head start , 2007 .

[9]  W. Barnett Surprising agreement on head start: Compli|ementing Currie and Besharov , 2007 .

[10]  William T. Gormley Early childhood care and education: Lessons and puzzles , 2007 .

[11]  Head start: Mend it, don't expand it (yet) , 2007 .

[12]  Response to Barnett and Currie , 2007 .

[13]  Peter Z. Schochet,et al.  National Evaluation of Early Reading First. Final Report to Congress. NCEE 2007-4007. , 2007 .

[14]  Dimitriy V. Masterov,et al.  The Productivity Argument for Investing in Young Children , 2007 .

[15]  Rafaella Asfora Siqueira Campos Lima,et al.  Tradução, adaptação e validação do test de vocabulario en Imágenes Peabody (TVIP) , 2007 .

[16]  Vivian C. Wong,et al.  Empirical Tests of the Validity of the Regression Discontinuity Design (WP-07-02) , 2007 .

[17]  William T. Gormley,et al.  Classroom Quality and Time Allocation in Tulsa's Early Childhood Programs , 2007 .

[18]  J. Heckman,et al.  The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior , 2006, Journal of Labor Economics.

[19]  B. Fuller,et al.  How Much is Too Much? The Influence of Preschool Centers on Children's Social and Cognitive Development , 2005 .

[20]  William T. Gormley,et al.  Childhood Programs and Practices in the First Decade of Life: Small Miracles in Tulsa: The Effects of Universal Pre-K on Cognitive Development , 2010 .

[21]  Douglas L. Miller,et al.  Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design , 2005, SSRN Electronic Journal.

[22]  C. Belfield,et al.  Lifetime Effects: The High/Scope Perry Preschool Study Through Age 40 , 2005 .

[23]  Camilla A. Heid,et al.  Head Start Impact Study: First Year Findings. , 2005 .

[24]  A. Stenner,et al.  Assessment Issues in the Testing of Children at School Entry , 2005, The Future of children.

[25]  Dale L. Johnson,et al.  The Parent Child Development Centers and School Achievement: A Follow-Up , 2004, Journal of Primary Prevention.

[26]  Emmanuel Skoufias,et al.  An Evaluation of the Performance of Regression Discontinuity Design on Progresa , 2004 .

[27]  C. Ruhm,et al.  Does prekindergarten improve school preparation and performance? Economics of Education Review, , . , 2007 .

[28]  B. Fuller,et al.  Child Care in Poor Communities: Early Learning Effects of Type, Quality, and Stability , 2003, Child development.

[29]  Jane Waldfogel,et al.  Inequality in Preschool Education and School Readiness , 2004 .

[30]  Steve Barnett,et al.  THE STATE OF PRESCHOOL 2006 STATE PRESCHOOL YEARBOOK , 2004 .

[31]  P. L. Chase‐Lansdale,et al.  Child care and low-income children's development: direct and moderated effects. , 2004, Child development.

[32]  William T. Gormley,et al.  The Effects of Universal Pre-K in Oklahoma: Research Highlights and Policy Implications. CROCUS Working Paper. , 2005 .

[33]  Andrew J. Mashburn,et al.  Report of the Findings from the Early Childhood Study: 2001-02. , 2003 .

[34]  Christine Ross,et al.  Child care quality matters: how conclusions may vary with context. , 2003, Child development.

[35]  Oshua,et al.  USING MAIMONIDES’ RULE TO ESTIMATE THE EFFECT OF CLASS SIZE ON SCHOLASTIC ACHIEVEMENT* , 2003 .

[36]  W. V. D. Klaauw,et al.  Estimating the Effect of Financial Aid Offers on College Enrollment: A Regression-Discontinuity Approach , 2002 .

[37]  Brian A. Jacob,et al.  The Impact of Teacher Training on Student Achievement: Quasi-Experimental Evidence from School Reform Efforts in Chicago , 2002 .

[38]  L. Schweinhart,et al.  Effects Five Years Later: The Michigan School Readiness Program Evaluation through Age 10. , 2002 .

[39]  C. Ramey,et al.  Early Childhood Education: Young Adult Outcomes From the Abecedarian Project , 2002 .

[40]  A. Reynolds,et al.  Long-term effects of an early childhood intervention on educational achievement and juvenile arrest: A 15-year follow-up of low-income children in public schools. , 2001, JAMA.

[41]  Donald J. Yarosz,et al.  WHO READS TO YOUNG CHILDREN?: IDENTIFYING PREDICTORS OF FAMILY READING ACTIVITIES , 2001 .

[42]  J. Hahn,et al.  IDENTIFICATION AND ESTIMATION OF TREATMENT EFFECTS WITH A REGRESSION-DISCONTINUITY DESIGN , 2001 .

[43]  Janet Currie Journal of Economic Perspectives—Volume 15, Number 2—Spring 2001—Pages 213–238 Early Childhood Education Programs , 2022 .

[44]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[45]  Walter S. Gilliam,et al.  A critical meta-analysis of all evaluations of state-funded preschool from 1977 to 1998: implications for policy, service delivery and program evaluation , 2000 .

[46]  M. Burchinal,et al.  Relating quality of center-based child care to early cognitive and language development longitudinally. , 2000, Child development.

[47]  Rachelle M. Bruno,et al.  Comprehensive Test of Phonological Processing (CTOPP) , 1999 .

[48]  A. Ullah,et al.  Nonparametric Econometrics: Semiparametric and Nonparametric Estimation of Simultaneous Equation Models , 1999 .

[49]  A. Ullah,et al.  Nonparametric Econometrics , 1999 .

[50]  Leona S. Aiken,et al.  Comparison of a Randomized and Two Quasi-Experimental Designs in a Single Outcome Evaluation , 1998 .

[51]  D. Rubin,et al.  Estimating Outcome Distributions for Compliers in Instrumental Variables Models , 1997 .

[52]  J. Tyson,et al.  Results at age 8 years of early intervention for low-birth-weight premature infants. The Infant Health and Development Program. , 1997, JAMA.

[53]  J. Angrist,et al.  Using Maimonides&Apos; Rule to Estimate the Effect of Class Size on Student Achievement , 1997 .

[54]  H. Robbins,et al.  Clinical and prophylactic trials with assured new treatment for those at greater risk: I. A design proposal. , 1996, American journal of public health.

[55]  C. Ramey,et al.  Cognitive and School Outcomes for High-Risk African-American Students at Middle Adolescence: Positive Effects of Early Intervention , 1995 .

[56]  A. Reynolds,et al.  Quasi-Experimental Estimates of the Effects of a Preschool Intervention , 1995 .

[57]  Zig Ziglar,et al.  Head Start , 1995 .

[58]  W. Barnett,et al.  Long-Term Effects of Early Childhood Programs on Cognitive and School Outcomes. , 1995 .

[59]  Joseph C. Cappelleri,et al.  Power Analysis of Cutoff-Based Randomized Clinical Trials , 1994 .

[60]  C. Ramey,et al.  Effects of early intervention on intellectual and academic achievement: a follow-up study of children from low-income families. , 1994, Child development.

[61]  Duncan C. Thomas,et al.  Does Head Start Make a Difference? , 1993 .

[62]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1994 .

[63]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[64]  H. Robbins,et al.  Estimating a treatment effect under biased sampling. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[65]  Larry F. Lacey,et al.  Long-term effects of on , 1987 .

[66]  B. Flay Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. , 1986, Preventive medicine.

[67]  D. A. Kenny,et al.  Estimating the effects of social interventions , 1981 .

[68]  Burt S. Barnow,et al.  Issues in the Analysis of Selectivity Bias. Discussion Papers. Revised. , 1980 .

[69]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[70]  D. Weikart,et al.  The Ypsilanti Perry Preschool Project: Preschool Years and Longitudinal Results Through Fourth Grade. Monograph Number 3. , 1978 .

[71]  William R. Shadish,et al.  Evaluation studies : review annual , 1976 .

[72]  Thomas D. Cook,et al.  Sesame Street Revisited , 1975 .

[73]  J. Minton The Impact of Sesame Street on Readiness. , 1975 .

[74]  Thomas D. Cook The medical and tailored models of evaluation research , 1974 .

[75]  J. Minton THE IMPACT OF "SESAME STREET" ON READING READINESS OF KINDERGARTEN CHILDREN. , 1972 .

[76]  J. Kean The Impact of Head Start: An Evaluation of the Effects of Head Start on Children's Cognitive and Affective Development by Victor G. Cicirelli. , 1970 .

[77]  Botanic Gardens,et al.  In Early Childhood , 2017 .