Comparative Analysis of Common Statistical Models Used for Value-Added Assessment of School Performance

The purpose of this study was to compare four popular value-added models used in measuring school effectiveness based on their distinguishing characteristics. In this study, the simple fixed effects model (SFEM), two hierarchical models (UHLMM and AHLMM), and the layered mixed effects model (LMEM) were analyzed using value-added measures obtained from a common data set with two years standard assessment data. Value-added measures obtained from these four models were analyzed to determine the impact of the differences of each model. Correlational analyses were also conducted to see whether there were meaningful relationships among these value-added models. SFEM and UHLMM models produced very similar rank orders of school effects while SFEM and AHLMM had only a moderate correlations. Thus there was not much difference between SFEM and two HLM models in terms of the rank orders of schools. Further, there was no agreement between LMEM and the other models.   Bu calismanin amaci, okul etkililigini olcmede yaygin olarak kullanilan uc katma-degerli modeli ayirt edici ozelliklerine dayanarak karsilastirmaktir.

[1]  Helen F. Ladd,et al.  Implementing value-added measures of school effectiveness: getting the incentives right , 2002 .

[2]  Anthony S. Bryk,et al.  A Hierarchical Model for Studying School Effects , 1986 .

[3]  Eric A. Hanushek,et al.  Education and race;: An analysis of the educational production process , 1972 .

[4]  Jennifer L. Green,et al.  Estimating Teacher Effects Using Value-Added Models. , 2010 .

[5]  Stephen Raudenbush,et al.  A longitudinal hierarchical linear models for estimating school e?ects and their stability , 1989 .

[6]  William L. Sanders,et al.  Research Findings from the Tennessee Value-Added Assessment System (TVAAS) Database: Implications for Educational Evaluation and Research , 1998 .

[7]  E. Hanushek,et al.  Teachers, Schools, and Academic Achievement , 1998 .

[8]  Cecil R. Reynolds,et al.  Educational Testing Service , 2008 .

[9]  H. Wainer.  Introduction to a Special Issue of the Journal of Educational and Behavioral Statistics on Value-Added Assessment , 2004 .

[10]  W. Sanders.  Annual CREATE Jason Millman Memorial Lecture: "Value-Added Assessment from Student Achievement Data: Opportunities and Hurdles.". , 2000 .

[11]  A. Amrein-Beardsley.  Methodological Concerns About the Education Value-Added Assessment System , 2008 .

[12]  Haggai Kupermintz,et al.  Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System , 2003 .

[13]  Mark D. Reckase,et al.  Can Value-Added Measures of Teacher Performance Be Trusted? , 2012, Education Finance and Policy.

[14]  Peter Z. Schochet,et al.  Error Rates in Measuring Teacher and School Performance Based on Student Test Score Gains , 2010 .

[15]  Value-Added Student Assessment , 2004 .

[16]  James Algina,et al.  An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance , 2004 .

[17]  Daniel F. McCaffrey,et al.  Using R for Estimating Longitudinal Student Achievement Models , 2003 .

[18]  Stephen W. Raudenbush,et al.  What Are Value-Added Models Estimating and What Does This Imply for Statistical Practice? , 2004 .

[19]  Daniel F. McCaffrey,et al.  Evaluating Value-Added Models for Teacher Accountability , 2004 .

[20]  Matthew G. Springer,et al.  Using Student Test Scores to Measure Teacher Performance , 2015 .

[21]  Jorge Manzi,et al.  School System Evaluation by Value Added Analysis Under Endogeneity , 2013, Psychometrika.

[22]  Harold C. Doran,et al.  Challenges of Value-Added Assessment. , 2005 .

[23]  William L. Sanders,et al.  The tennessee value-added assessment system (TVAAS): Mixed-model methodology in educational assessment , 1994 .

[24]  M. S. Franco.  The Relationships Among Building Level School/Non-School Factors and Value-Added Scores in Ohio , 2006 .

[25]  Paul Wright,et al.  Controlling for Student Background in Value-Added Assessment of Teachers , 2004 .

[26]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[27]  A. Amrein-Beardsley.  Rethinking Value-Added Models in Education: Critical Perspectives on Tests and Assessment-Based Accountability , 2014 .

[28]  AERA Statement on Use of Value-Added Models (VAM) for the Evaluation of Educators and Educator Preparation Programs , 2015 .