Methodological Concerns About the Education Value-Added Assessment System

Value-added models help to evaluate the knowledge that school districts, schools, and teachers add to student learning as students progress through school. In this article, the well-known Education Value-Added Assessment System (EVAAS) is examined. The author presents a practical investigation of the methodological issues associated with the model. Specifically, she argues that, although EVAAS is probably the most sophisticated value-added model, it has flaws that must be addressed before widespread adoption. She explores in depth the shortage of external reviews and validity studies of the model, its insufficient user-friendliness, and methodological issues about missing data, regression to the mean, and student background variables. She also examines a paradigm case in which the model was used to advance unfounded assertions.

[1]  A. Mood,et al.  Equality of Educational Opportunity. , 1967 .

[2]  Alexander M. Mood,et al.  Equality of Educational Opportunity. , 1967 .

[3]  K. White.  The relation between socioeconomic status and academic achievement. , 1982 .

[4]  William L. Sanders,et al.  The tennessee value-added assessment system (TVAAS): Mixed-model methodology in educational assessment , 1994 .

[5]  Commentary: Life in the real world is more complicated , 1995, BMJ.

[6]  J. Millman.  Grading Teachers, Grading Schools: Is Student Achievement a Valid Evaluation Measure? , 1997 .

[7]  Sandra P. Horn,et al.  Teacher and Classroom Context Effects on Student Achievement: Implications for Teacher Evaluation , 1997 .

[8]  Robert H. Meyer,et al.  Value-added indicators of school performance: A primer , 1997 .

[9]  J. Levin,et al.  Reflections on Statistical and Substantive Significance, with a Slice of Replication. , 1997 .

[10]  Daniel H. Robinson,et al.  Research news and Comment: Reflections on Statistical and Substantive Significance, With a Slice of Replication , 1997 .

[11]  William L. Sanders,et al.  Research Findings from the Tennessee Value-Added Assessment System (TVAAS) Database: Implications for Educational Evaluation and Research , 1998 .

[12]  William L. Sanders,et al.  Value-Added Assessment. , 1998 .

[13]  William,et al.  Cumulative and Residual Effects of Teachers on Future Student Academic Achievement , 1999 .

[14]  David L. Weimer,et al.  Organizational report cards , 1999 .

[15]  W. Sanders.  Annual CREATE Jason Millman Memorial Lecture: "Value-Added Assessment from Student Achievement Data: Opportunities and Hurdles.". , 2000 .

[16]  K. Topping,et al.  Teacher Effectiveness and Computer Assessment of Reading Relating Value Added and Learning Information System Data , 2000 .

[17]  William L. Sanders,et al.  Value-Added Assessment from Student Achievement Data: Opportunities and Hurdles CREATE NATIONAL EVALUATION INSTITUTE July 21, 2000 , 2000 .

[18]  Steven M. Ross,et al.  Two- and Three-Year Achievement Results From the Memphis Restructuring Initiative , 2001 .

[19]  S. P. Wright,et al.  Fourth-Year Achievement Results on the Tennessee Value-Added Assessment System for Restructuring Schools in Memphis. , 2001 .

[20]  Dale Ballou.  Sizing Up Test Scores. , 2002 .

[21]  D. Koretz.  Limitations in the Use of Achievement Tests as Measures of Educators' Productivity , 2002 .

[22]  Haggai Kupermintz,et al.  Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System , 2003 .

[23]  Daniel F. McCaffrey,et al.  Using R for Estimating Longitudinal Student Achievement Models , 2003 .

[24]  Steven M. Ross,et al.  Inside Systemic Elementary School Reform: Teacher Effects and Teacher Mobility , 2003 .

[25]  G. Patil,et al.  Rejoinder , 2004, Environmental and Ecological Statistics.

[26]  Value-Added Student Assessment , 2004 .

[27]  Paul Wright,et al.  Controlling for Student Background in Value-Added Assessment of Teachers , 2004 .

[28]  Let’s See More Empirical Studies on Value-Added Modeling of Teacher Effects: A Reply to Raudenbush, Rubin, Stuart and Zanutto, and Reckase , 2004 .

[29]  Daniel F. McCaffrey,et al.  Evaluating Value-Added Models for Teacher Accountability , 2004 .

[30]  Stephen W. Raudenbush,et al.  What Are Value-Added Models Estimating and What Does This Imply for Statistical Practice? , 2004 .

[31]  Mark D. Reckase.  The Real World is More Complicated than We Would Like , 2004 .

[32]  David C. Berliner,et al.  National Board Certified Teachers and Their Students' Achievement , 2004 .

[33]  James Algina,et al.  An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance , 2004 .

[34]  Value-Added Assessment: A View from a Practitioner , 2004 .

[35]  Thomas A Louis,et al.  Jump down to Document , 2022 .

[36]  Donald B. Rubin,et al.  A Potential Outcomes View of Value-Added Assessment in Education , 2004 .

[37]  NCLB Law Bestows Bounty on Test Industry. , 2004 .

[38]  Linda C. Cavalluzzo,et al.  Is National Board Certification an Effective Signal of Teacher Quality , 2004 .

[39]  William L. Sanders,et al.  Comparison of the Effects of NBPTS Certified Teachers with Other Teachers on the Rate of Student Academic Progress. Final Report. , 2005 .

[40]  Henry Braun.  Using Student Progress to Evaluate Teachers: A Primer on Value-Added Models. Policy Information Perspective. , 2005 .

[41]  Gail L. Sunderman,et al.  Measuring Academic Proficiency Under the No Child Left Behind Act: Implications for Educational Equity , 2005 .

[42]  Gregory J. Marchant,et al.  Relationships between high-stakes testing policies and student achievement after controlling for demographic factors in aggregated data. , 2006 .

[43]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[44]  S. Loeb,et al.  Complex by Design , 2006 .

[45]  Bruce Thompson,et al.  Research Synthesis: Effect Sizes , 2006 .

[46]  G. Gage Kingsbury,et al.  Achievement Gaps: An Examination of Differences in Student Achievement and Growth. The Full Report. , 2006 .

[47]  INVESTIGATING PATHWAYS INTO TEACHING IN NEW YORK CITY SCHOOLS , 2006 .

[48]  Dan Goldhaber,et al.  Can Teacher Quality Be Effectively Assessed? National Board Certification as a Signal of Effective Teaching , 2005, The Review of Economics and Statistics.

[49]  Lowell C. Rose,et al.  The 39th Annual Phi Delta Kappa/Gallup Poll of the Public's Attitudes toward the Public Schools , 2007 .