Can Value-Added Measures of Teacher Performance Be Trusted?

We investigate whether commonly used value-added estimation strategies produce accurate estimates of teacher effects under a variety of scenarios. We estimate teacher effects in simulated student achievement data sets that mimic plausible types of student grouping and teacher assignment scenarios. We find that no one method accurately captures true teacher effects in all scenarios, and the potential for misclassifying teachers as high- or low-performing can be substantial. A dynamic ordinary least squares estimator is more robust across scenarios than other estimators. Misspecifying dynamic relationships can exacerbate estimation problems.

[1]  E. Hanushek.  Conceptual and Empirical Issues in the Estimation of Educational Production Functions , 1979 .

[2]  Stephen W. Raudenbush.  Adaptive Centering with Random Effects: An Alternative to the Fixed Effects Model for Time-Varying Treatments , 2008 .

[3]  T. Dee.  Teachers, Race, and Student Achievement in a Randomized Experiment , 2001, Review of Economics and Statistics.

[4]  Hairul Azlan Annuar,et al.  Foreign investors' interests and corporate tax avoidance: Evidence from an emerging economy , 2015 .

[5]  Michelle Croft,et al.  Recent Validity Evidence for Value-Added Measures of Teacher Performance , 2014 .

[6]  C. Morris.  Parametric Empirical Bayes Inference: Theory and Applications , 1983 .

[7]  Mark D. Reckase,et al.  An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures , 2015 .

[8]  Jeffrey M. Woodbridge.  Econometric Analysis of Cross Section and Panel Data , 2002 .

[9]  Margaret K. Koenigs,et al.  Teachers and Student Achievement in the Chicago Public High Schools , 2003 .

[10]  Eric A. Hanushek,et al.  The Economics of Schooling: Production and Efficiency in Public Schools , 1986 .

[11]  Raj Chetty,et al.  The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood , 2011 .

[12]  Stephen W. Raudenbush,et al.  Adaptive Centering with Random Effects: An Alternative to the Fixed Effects Model for Studying Time-Varying Treatments in School Settings , 2009, Education Finance and Policy.

[13]  Richard J. Murnane,et al.  Using Panel Data to Improve Estimates of the Determinants of Educational Achievement. , 1979 .

[14]  Doris R. Entwisle,et al.  Summer Setback: Race, Poverty, School Composition, and Mathematics Achievement in the First Two Years of School. , 1992 .

[15]  Raj Chetty,et al.  The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood. NBER Working Paper No. 17699. , 2011 .

[16]  Tim R. Sass,et al.  Value-Added Models and the Measurement of Teacher Quality , 2006 .

[17]  Mark D. Reckase,et al.  An Evaluation of Empirical Bayes' Estimation of Value- Added Teacher Performance Measures. Working Paper #31. Revised. , 2014 .

[18]  Petra E. Todd,et al.  On the Specification and Estimation of the Production Function for Cognitive Achievement , 2003 .

[19]  Faculteit der Sociale Wetenschappen,et al.  Evaluation of education , 2015 .

[20]  Thomas A Louis,et al.  Jump down to Document , 2022 .

[21]  Jesse Rothstein,et al.  Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement , 2008 .

[22]  Patrick McGuinn.  The State of Teacher Evaluation Reform: State Education Agency Capacity and the Implementation of New Teacher-Evaluation Systems. , 2012 .

[23]  Cassandra M. Guarino,et al.  How Do Principals Assign Students to Teachers? Finding Evidence in Administrative Data and the Implications for Value-Added , 2013, SSRN Electronic Journal.

[24]  Daniel F. McCaffrey,et al.  The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures , 2007 .

[25]  P. Albert,et al.  Models for longitudinal data: a generalized estimating equation approach. , 1988, Biometrics.

[26]  Mark D. Reckase,et al.  Evaluating Specification Tests in the Context of Value-Added Estimation , 2014 .

[27]  C. Guarino.  An Evaluation of Empirical Bayes ’ Estimation of Value-Added Teacher Performance Measures August 19 , 2014 , 2014 .

[28]  Paul Wright,et al.  Controlling for Student Background in Value-Added Assessment of Teachers , 2004 .

[29]  Jeffrey M. Wooldridge,et al.  Solutions Manual and Supplementary Materials for Econometric Analysis of Cross Section and Panel Data , 2003 .

[30]  Mark D. Reckase,et al.  The Difficulty of Test Items That Measure More Than One Ability , 1985 .

[31]  M. Lechner,et al.  Matching Estimating of Dynamic Treatment Models: Some Practical Issues , 2006 .

[32]  Matthew M. Chingos,et al.  Teacher Effectiveness, Mobility, and Attrition in Florida: A descriptive analysis , 2008 .

[33]  Derek C. Briggs,et al.  The Sensitivity of Value-Added Modeling to the Creation of a Vertical Score Scale , 2009, Education Finance and Policy.

[34]  L. Hedges,et al.  How Large Are Teacher Effects? , 2004 .

[35]  Josh Kinsler,et al.  Assessing Rothstein's critique of teacher value‐added models , 2012 .

[36]  Joseph A. Martineau.  Distorting Value Added: The Use of Longitudinal, Vertically Scaled Student Achievement Data for Growth-Based, Value-Added Accountability , 2006 .

[37]  Cory Koedel,et al.  Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique , 2009, Education Finance and Policy.

[38]  Mark D. Reckase,et al.  That Measure More Than One Ability , 1985 .

[39]  Tristan Zajonc,et al.  Do Value-Added Estimates Add Value? Accounting for Learning Dynamics , 2009 .

[40]  Richard Buddin,et al.  Measuring teacher and school effectiveness at improving student achievement in Los Angeles elementary schools , 2011 .

[41]  Dan Goldhaber,et al.  Assessing the Rothstein Test: Does It Really Show Teacher Value-Added Models Are Biased? , 2012 .

[42]  William L. Sanders,et al.  The tennessee value-added assessment system (TVAAS): Mixed-model methodology in educational assessment , 1994 .

[43]  Tristan Zajonc,et al.  Do Value-Added Estimates Add Value? Accounting for Learning Dynamics , 2009 .

[44]  Michael Wooldridge,et al.  Econometric Analysis of Cross Section and Panel Data, 2nd Edition , 2001 .

[45]  Matthew G. Springer.  Performance Incentives: Their Growing Impact on American K-12 Education , 2009 .

[46]  Tim R. Sass,et al.  Value-Added Models and the Measurement of Teacher Productivity. CALDER Working Paper No. 54. , 2010 .

[47]  R. Blundell,et al.  Initial Conditions and Moment Restrictions in Dynamic Panel Data Models , 1998 .

[48]  Beckett A. Broh,et al.  Are Schools the Great Equalizer? Cognitive Inequality during the Summer Months and the School Year , 2004 .

[49]  Gary Chamberlain,et al.  Comment: Sequential Moment Restrictions in Panel Data , 1992 .

[50]  M. Lechner.  Matching Estimating of Dynamic Treatment Models: Some Practical Issues , 2006 .

[51]  Thomas J. Kane,et al.  Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation , 2008 .