Value-Added Modeling of Teacher Effectiveness: An Exploration of Stability across Models and Contexts

Recent policy interest in tying student learning to teacher evaluation has led to growing use of value-added methods for assessing student learning gains linked to individual teachers. VAM analyses rely on complex assumptions about the roles of schools, multiple teachers, student aptitudes and efforts, homes and families in producing measured student learning gains. This article reports on analyses that examine the stability of high school teacher effectiveness rankings across differing conditions. We find that judgments of teacher effectiveness for a given teacher can vary substantially across statistical models, classes taught,

[1]  Donald B. Rubin,et al.  A Potential Outcomes View of Value-Added Assessment in Education , 2004 .

[2]  T. Good,et al.  Accountability and Educational Reform: A Critical Analysis of Four Perspectives and Considerations for Enhancing Reform Efforts , 2010 .

[3]  Henry Braun Using Student Progress to Evaluate Teachers: A Primer on Value-Added Models. Policy Information Perspective. , 2005 .

[4]  T. Sass The Stability of Value-Added Measures of Teacher Quality and Implications for Teacher Compensation Policy. Brief 4. , 2008 .

[5]  Daniel F. McCaffrey,et al.  The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures , 2007 .

[6]  R. Buddin How effective are Los Angeles elementary teachers and schools , 2010 .

[7]  Education Professional Standards Board Evaluating Value-Added models for Teacher Accountability , 2004 .

[8]  L. Cronbach,et al.  How we should measure "change": Or should we? , 1970 .

[9]  Leonidas Kyriakides,et al.  Assessing Teacher Effectiveness: Different models , 2004 .

[10]  Jesse Rothstein,et al.  Do Value-Added Models Add Value? Tracking, Fixed Effects, and Causal Inference , 2007 .

[11]  Joseph E. Morsh,et al.  Identifying the Effective Instructor: A Review of the Quantitative Studies. 1900-1952. , 1954 .

[12]  J. Brophy,et al.  Stability of Teacher Effectiveness1 , 1973 .

[13]  Eric M. Anderman,et al.  Value-Added Models of Assessment: Implications for Motivation and Accountability , 2010 .

[14]  Paul Wright,et al.  Controlling for Student Background in Value-Added Assessment of Teachers , 2004 .

[15]  James Algina,et al.  An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance , 2004 .

[16]  Daniel F. McCaffrey,et al.  The Intertemporal Variability of Teacher Effect Estimates , 2009, Education Finance and Policy.

[17]  H. Braun,et al.  Getting Value Out of Value-Added: Report of a Workshop , 2010 .

[18]  Walter Doyle,et al.  4: Paradigms for Research on Teacher Effectiveness , 1977 .

[19]  Stephen W. Raudenbush,et al.  The Estimation of School Effects , 1995 .

[20]  Thomas A Louis,et al.  Jump down to Document , 2022 .

[21]  Helen F. Ladd,et al.  Problems with the Use of Student Test Scores to Evaluate Teachers. EPI Briefing Paper #278. , 2010 .

[22]  Haggai Kupermintz,et al.  Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System , 2003 .

[23]  Robert L. Linn,et al.  Methodological issues in achieving school accountability 1 , 2008 .

[24]  B. Rosenshine The Stability of Teacher Effects Upon Student Achievement , 1970 .

[25]  S. Corcoran Can Teachers Be Evaluated by Their Students' Test Scores? Should They Be? , 2010 .

[26]  Eric A. Hanushek,et al.  Generalizations about Using Value-Added Measures of Teacher Quality , 2010 .

[27]  A. Amrein-Beardsley Methodological Concerns About the Education Value-Added Assessment System , 2008 .

[28]  William L. Sanders,et al.  Research Findings from the Tennessee Value-Added Assessment System (TVAAS) Database: Implications for Educational Evaluation and Research , 1998 .

[29]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[30]  Robert L. Linn,et al.  The Determination of the Significance of Change Between Pre- and Posttesting Periods , 1977 .