A Comparison of Student Growth Percentile and Value-Added Models of Teacher Performance

School districts and state departments of education frequently must choose among a variety of methods to estimate teacher quality. This article investigates the consequences of some of these choices. We examine estimates derived from student growth percentile and commonly used value-added models. Using simulated data, we examine how well the estimators can rank teachers and avoid misclassification errors under a variety of assignment scenarios of teachers to students. We find that growth percentile measures perform worse than value-added measures that control for prior year student test scores and include teacher fixed effects when assignment of students to teachers is nonrandom. In addition, using actual data from a large diverse anonymous state, we find evidence that growth percentile measures are less correlated with value-added measures that include teacher fixed effects when there is evidence of nonrandom grouping of students in schools. This evidence suggests that the choice between estimators is most consequential under nonrandom assignment of teachers to students and that value-added measures controlling for teacher fixed effects may be better suited to estimating teacher quality in this case.

[1]  Mark Ehlert,et al.  Selecting Growth Measures for Use in School Evaluation Systems , 2016 .

[2]  Mark D. Reckase,et al.  An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures , 2015 .

[3]  Mark D. Reckase,et al.  Can Value-Added Measures of Teacher Performance Be Trusted? , 2012, Education Finance and Policy.

[4]  C. Koedel,et al.  The Sensitivity of Value-Added Estimates to Specification Adjustments: Evidence From School- and Teacher-Level Models in Missouri , 2014 .

[5]  Cassandra M. Guarino An Evaluation of Empirical Bayes ’ Estimation of Value-Added Teacher Performance Measures August 19 , 2014 , 2014 .

[6]  Cassandra M. Guarino,et al.  How Do Principals Assign Students to Teachers? Finding Evidence in Administrative Data and the Implications for Value-Added , 2013, SSRN Electronic Journal.

[7]  Dan Goldhaber,et al.  Does the Model Matter? Exploring the Relationship Between Different Student Achievement-Based Teacher Assessments , 2012 .

[8]  Mark Ehlert,et al.  Selecting Growth Measures for School and Teacher Evaluations , 2012 .

[9]  Gregory J. Cizek,et al.  Setting performance standards : foundations, methods, and innovations , 2012 .

[10]  Damian W. Betebenner A Technical Overview of the Student Growth Percentile Methodology: Student Growth Percentiles and Percentile Growth Projections/Trajectories. , 2011 .

[11]  Gadi Barlevy,et al.  Pay for Percentile. NBER Working Paper No. 17194. , 2011 .

[12]  Tim R. Sass,et al.  Value-Added Models and the Measurement of Teacher Productivity. CALDER Working Paper No. 54. , 2010 .

[13]  Damian W. Betebenner Norm- and Criterion-Referenced Student Growth. , 2009 .

[14]  Gadi Barlevy,et al.  Pay for Percentile , 2009, SSRN Electronic Journal.

[15]  Derek C. Briggs,et al.  The Sensitivity of Value-Added Modeling to the Creation of a Vertical Score Scale , 2009, Education Finance and Policy.

[16]  Dale Ballou,et al.  Test Scaling and Value-Added Measurement , 2009, Education Finance and Policy.

[17]  Thomas J. Kane,et al.  Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation , 2008 .

[18]  Jesse Rothstein,et al.  Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement , 2008 .

[19]  Brian A. Jacob,et al.  Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education , 2008, Journal of Labor Economics.

[20]  Daniel F. McCaffrey,et al.  The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures , 2007 .

[21]  Daniel Aaronson,et al.  Teachers and Student Achievement in the Chicago Public High Schools , 2003, Journal of Labor Economics.

[22]  L. Hedges,et al.  How Large Are Teacher Effects? , 2004 .

[23]  Thomas A Louis,et al.  Jump down to Document , 2022 .

[24]  Petra E. Todd,et al.  On the Specification and Estimation of the Production Function for Cognitive Achievement , 2003 .

[25]  Thomas J. Kane,et al.  The Promise and Pitfalls of Using Imprecise School Accountability Measures , 2002 .

[26]  Jeffrey M. Wooldridge,et al.  Solutions Manual and Supplementary Materials for Econometric Analysis of Cross Section and Panel Data , 2003 .

[27]  C. Morris Parametric Empirical Bayes Inference: Theory and Applications , 1983 .

[28]  E. Hanushek Conceptual and Empirical Issues in the Estimation of Educational Production Functions , 1979 .