Exploring Teacher Effectiveness Using Hierarchical Linear Models: Student- and Classroom-Level Predictors and Cross-Year Stability in Elementary School Reading.

Teacher effectiveness and evaluation using student growth measures is a popular reform strategy in education. Teachers can make a difference in student academic growth, but a question that begs an answer is how to go about measuring this impact. This study examines models of teacher effectiveness and the development of hierarchical linear models (HLM) using fourth grade end-of-year state accountability reading test scores as the outcome variable. An extensive review of literature was conducted to assess the use of HLM in educational settings, particularly as related to teacher effectiveness analyses. Although multiple student variables were explored, previous reading test scores was the most significant student-level variable while teachers’ years of experience was used as a classroom-level variable. This model produced a classroom effectiveness index that was notably consistent across three years of data for the same teachers. Implications for policy, practice, and research are discussed.

[1]  William L. Sanders,et al.  The tennessee value-added assessment system (TVAAS): Mixed-model methodology in educational assessment , 1994 .

[2]  Jesse Rothstein,et al.  Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement , 2008 .

[3]  S. Caldas,et al.  White Enrollment in Nonpublic Schools, Public School Racial Composition, and Student Performance , 2000 .

[4]  Diane Ravitch,et al.  The Death and Life of the Great American School System: How Testing and Choice Are Undermining Education , 2010 .

[5]  R. Heck,et al.  Direct and Indirect Writing Assessments: Examining Issues of Equity and Utility , 2001 .

[6]  E. Hanushek,et al.  Schoolhouses, Courthouses, and Statehouses: Solving the Funding-Achievement Puzzle in America's Public Schools , 2009 .

[7]  L. Darling-Hammond.  Teacher Quality and Student Achievement: A Review of State Policy Evidence , 2000 .

[8]  R. Burns,et al.  Class Composition and Student Achievement in Elementary Schools , 2002 .

[9]  W. Sanders.  Annual CREATE Jason Millman Memorial Lecture: "Value-Added Assessment from Student Achievement Data: Opportunities and Hurdles.". , 2000 .

[10]  Haggai Kupermintz,et al.  Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System , 2003 .

[11]  Garrett K. Mandeville,et al.  School Effectiveness Indices Revisited: Cross-Year Stability. , 1988 .

[12]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[13]  C. Swanson,et al.  Standards-Based Reform in Practice: Evidence on State Policy and Classroom Instruction from the NAEP State Assessments , 2002 .

[14]  James H. Stronge,et al.  What Makes Good Teachers Good? A Cross-Case Analysis of the Connection Between Teacher Effectiveness and Student Achievement , 2011 .

[15]  H. Marsh,et al.  Multilevel Causal Ordering of Academic Self-Concept and Achievement: Influence of Language of Instruction (English Compared With Chinese) for Hong Kong Students , 2002 .

[16]  James H. Stronge,et al.  Qualities of Effective Teachers , 2002 .

[17]  Megan Tschannen-Moran,et al.  A Theoretical and Empirical Investigation of Teacher Collaboration for School Improvement and Student Achievement in Public Elementary Schools , 2007, Teachers College Record: The Voice of Scholarship in Education.

[18]  Pamela D. Tucker,et al.  What is the Relationship Between Teacher Quality and Student Achievement? An Exploratory Study , 2007 .

[19]  H. Goldstein,et al.  Meta‐analysis using multilevel models with an application to the study of class size effects , 2000 .

[20]  Garrett K. Mandeville,et al.  The Stability of School Effectiveness Indices Across Grade Levels and Subject Areas , 1987 .

[21]  Daniel F. McCaffrey,et al.  Evaluating Value-Added Models for Teacher Accountability , 2004 .

[22]  Adam Gamoran,et al.  The Production of Achievement Inequality in High School English , 2002 .

[23]  J. Wilkins,et al.  Predicting Student Growth in Mathematical Content Knowledge , 2002 .

[24]  E. Pedhazur.  Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[25]  L. Hedges,et al.  How Large Are Teacher Effects? , 2004 .

[26]  Anthony S. Bryk,et al.  A Multilevel Model of the Social Distribution of High School Achievement. , 1989 .

[27]  Laura M. Desimone,et al.  Effects of Professional Development on Teachers’ Instruction: Results from a Three-year Longitudinal Study , 2002 .

[28]  L. Darling-Hammond.  What Matters Most: A Competent Teacher for Every Child. , 1996 .

[29]  Stephen E. Anderson,et al.  How leadership influences student learning (Review of Research). New York: The Wallace Foundation. , 2004 .

[30]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[31]  David Keeling,et al.  The Widget Effect: Our National Failure to Acknowledge and Act on Differences in Teacher Effectiveness. Second Edition. , 2009 .

[32]  Xin Ma,et al.  Health Outcomes of Elementary School Students in New Brunswick , 2000, Evaluation review.

[33]  Gregory J. Palardy,et al.  Teacher Effectiveness in First Grade: The Importance of Background Qualifications, Attitudes, and Instructional Practices for Student Learning , 2008 .

[34]  Mark Berends,et al.  Teacher-Reported Effects of New American School Designs: Exploring Relationships to Teacher Background and School Context , 2000 .

[35]  E. Hanushek,et al.  Teachers, Schools, and Academic Achievement , 1998 .

[36]  Kenneth M. Zeichner,et al.  Studying Teacher Education : The Report of the AERA Panel on Research and Teacher Education , 2005 .

[37]  Stephen W. Raudenbush,et al.  Inequality of Access to Educational Resources: A National Report Card for Eighth-Grade Math , 1998 .

[38]  Brian Rowan,et al.  What Large-Scale, Survey Research Tells Us About Teacher What Large-Scale, Survey Research Tells Us About Teacher Effects on Student Achievement: Insights From the Prospectus Effects on Student Achievement: Insights From the Prospectus Study of Elementary Schools Study of Elementary Schools , 2015 .

[39]  M. Muñoz,et al.  The Elusive Relationship Between Teacher Characteristics and Student Academic Growth: A Longitudinal Multilevel Model for Change , 2007 .

[40]  Keenan A. Pituch,et al.  Describing School Effects with Residual Terms , 1999 .

[41]  Valerie E. Lee,et al.  Using Hierarchical Linear Modeling to Study Social Contexts: The Case of School Effects , 2000 .

[42]  Jonah E. Rockoff.  The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data , 2004 .

[43]  Peter A. Youngs,et al.  Teacher Characteristics and Student Achievement Gains: A Review , 2003 .