Classroom observation for evaluating and improving teaching: An international perspective

Abstract Teacher evaluation and development policies around the world are undergoing significant reform. Classroom observation often carries a considerable weight in teacher appraisal and improvement systems, and provides the critical formative anchor informing professional development. This study examined a purposively selected sample of sixteen classroom observation systems in six countries, including high performing Singapore and Japan, regional exemplar Chile, the three largest school districts in the United States, and other interesting examples in Australia, Germany and the United States to add diversity to the sample. The study offers an analytic framework for understanding classroom observation systems across contexts, distinguishing conceptual, methodological and policy aspects that shape these systems. The sixteen systems were remarkably consistent in their stated overall purposes, but there was variation in terms of how they operationalized good teaching, the degree of standardization of the observation process, emphasis on validation, and information uses. The paper describes and discusses these characteristics in order to help researchers and policymakers reflect on the available options and take more informed decisions in designing classroom observation for evaluating and improving teaching.

[1]  George A. Marcoulides,et al.  Maximizing Power in Generalizability Studies Under Budget Constraints , 1993 .

[2]  W. A. Mehrens.  Combining Evaluation Data from Multiple Sources , 1990 .

[3]  Helen F. Ladd,et al.  Problems with the Use of Student Test Scores to Evaluate Teachers. EPI Briefing Paper #278. , 2010 .

[4]  M. Patton.  Qualitative research and evaluation methods , 1980 .

[5]  L. Darling-Hammond.  Getting Teacher Evaluation Right: What Really Matters for Effectiveness and Improvement , 2013 .

[6]  M. Kennedy.  Teacher assessment and the quest for teacher quality : a handbook , 2014 .

[7]  Courtney A. Bell,et al.  Effect of Observation Mode on Measures of Secondary Mathematics Teaching , 2013 .

[8]  Karen S. Loup,et al.  Ten years later: Findings from a replication of a study of teacher evaluation practices in our 100 largest school districts , 1996 .

[9]  G. Yukl,et al.  Effects of multisource feedback and a feedback facilitator on the influence behavior of managers toward subordinates. , 2003, The Journal of applied psychology.

[10]  Daniel F. McCaffrey,et al.  A Composite Estimator of Effective Teaching , 2013 .

[11]  Richard F. Elmore,et al.  Instructional Rounds in Education: A Network Approach to Improving Teaching and Learning , 2009 .

[12]  L. Hedges,et al.  How Large Are Teacher Effects? , 2004 .

[13]  Anna-Katharina Praetorius,et al.  One lesson is all you need? Stability of instructional quality across lessons. , 2014 .

[14]  Xiaoxia Newton.  Developing indicators of classroom practice to evaluate the impact of district mathematics reform initiative: A generalizability analysis , 2010 .

[15]  Lorna Earl,et al.  OECD Reviews of Evaluation and Assessment in Education: Norway 2011 , 2011 .

[16]  Anthony Milanowski,et al.  The Relationship Between Teacher Performance Evaluation Scores and Student Achievement: Evidence From Cincinnati , 2004 .

[17]  R. Shavelson,et al.  THE SEARCH FOR CORRELATIONS BETWEEN MEASURES OF TEACHER BEHAVIOR AND STUDENT ACHIEVEMENT: MEASUREMENT PROBLEM, CONCEPTUALIZATION PROBLEM, OR BOTH? , 1978 .

[18]  Sarah McKay,et al.  Improving Observer Training: The Trends and Challenges. Issue Brief. , 2015 .

[19]  Joan Garland,et al.  Teacher evaluation practices in our largest school districts: Are they measuring up to ‘state-of-the-art’ systems? , 1987 .

[20]  K. Rowe,et al.  Conceptualising and Evaluating Teacher Quality: Substantive and Methodological Issues , 2008 .

[21]  J. Hattie,et al.  The Power of Feedback , 2007 .

[22]  W. Kopp,et al.  Teaching as leadership : the highly effective teacher's guide to closing the achievement gap , 2010 .

[23]  Susan M. Brookhart,et al.  Educational Assessment Knowledge and Skills for Teachers , 2011 .

[24]  Lars Lefgren,et al.  Principals as Agents: Subjective Performance Measurement in Education , 2005 .

[25]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[26]  Charlotte F. Danielson.  Enhancing Professional Practice: A Framework for Teaching , 1996 .

[27]  Charalambos Y. Charalambous,et al.  When Rater Reliability Is Not Enough , 2012 .

[28]  Ralph T. Putnam,et al.  What Do New Views of Knowledge and Thinking Have to Say About Research on Teacher Learning? , 2000 .

[29]  Glenn Rowley,et al.  Policy, Practice, and Readiness to Teach Primary and Secondary Mathematics in 17 Countries: Findings from the IEA Teacher Education and Development Study in Mathematics (TEDS-M) , 2012 .

[30]  K. Peterson.  Teacher Evaluation: A Comprehensive Guide to New Directions and Practices. Second Edition. , 1995 .

[31]  Mona Mourshed,et al.  How the worlds most improved school systems keep getting better , 2011 .

[32]  J. Brophy.  Teacher behavior and student achievement , 1984 .

[33]  L. Goe,et al.  Methods of Evaluating Teacher Effectiveness. Research-to-Practice Brief. , 2009 .

[34]  Richard F. Elmore,et al.  Leadership as the practice of improvement , 2006 .

[35]  Andreas Schleicher.  Building a High-Quality Teaching Profession. Lessons from around the world , 2012 .

[36]  M. F. Astiz.  El Curriculum Escolar y su Abordaje desde la Teoría de la Sociedad Mundial: Revisión y Prospectiva , 2014 .

[37]  Brian M. Stecher,et al.  Validation of a National Teacher Assessment and Improvement System , 2012 .

[38]  Courtney A. Bell,et al.  Approaches to Evaluating Teacher Effectiveness: A Research Synthesis. , 2008 .

[39]  Courtney A. Bell,et al.  Improving Observational Score Quality , 2015 .

[40]  M. H. Elliott.  Assessing Accomplished Teaching AdvancedLevel Certification Programs , 2008 .

[41]  M. Fullan.  Successful School Improvement: The Implementation Perspective and Beyond. Modern Educational Thought. , 1992 .

[42]  Heather C. Hill,et al.  Learning from Teacher Observations: Challenges and Opportunities Posed by New Teacher Evaluation Systems. , 2013 .

[43]  Robert C. Pianta,et al.  An Argument Approach to Observation Protocol Validity , 2012 .

[44]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[45]  M. Davidson,et al.  Creating Effective Teaching and Learning Environments: First Results from TALIS , 2009 .

[46]  Charalambos Y. Charalambous,et al.  Mathematical Knowledge for Teaching and the Mathematical Quality of Instruction: An Exploratory Study , 2008 .

[47]  E. Baker,et al.  Assessment Policy: Making Sense of the Babel , 2012 .

[48]  Richard Halverson,et al.  IMPLEMENTING TEACHER EVALUATION SYSTEMS How Principals Make Sense of Complex Artifacts to Shape Local Instructional Practice 1 , 2004 .

[49]  David Keeling,et al.  The Widget Effect: Our National Failure to Acknowledge and Act on Differences in Teacher Effectiveness. Second Edition. , 2009 .

[50]  John H. Tyler,et al.  The Effect of Evaluation on Teacher Performance , 2012 .

[51]  Sandy Taut,et al.  The Development and Implementation of a National, Standards-based, Multi-method Teacher Performance Assessment System in Chile , 2014 .

[52]  Sandy Taut,et al.  Theory underlying a national teacher evaluation program. , 2010, Evaluation and program planning.

[53]  Javier Luque,et al.  Great Teachers: How to Raise Student Learning in Latin America and the Caribbean--Overview , 2014 .

[54]  L. Darling-Hammond,et al.  The New Handbook of Teacher Evaluation: Assessing Elementary and Secondary School Teachers , 1989 .

[55]  Richard J. Shavelson,et al.  Generalizability Theory: A Primer , 1991 .

[56]  Steven M. Kimball.  Analysis of Feedback, Enabling Conditions and Fairness Perceptions of Teachers in Three School Districts with New Standards-Based Evaluation Systems , 2002 .