Measuring Instructional Quality in Accountability Systems: Classroom Assignments and Student Achievement

This article reports the technical quality of a measure describing the quality of classroom assignments piloted in the Los Angeles Unified School District's proposed new accountability system. For this study, 181 teachers were sampled from 35 schools selected at random. Participating teachers submitted three language arts assignments with samples of student work (N = 50). Results indicated a fair level of agreement among the raters who scored the assignments and a high level of internal consistency within each dimension of assignment quality. Results presented a mixed picture with regard to the stability of the ratings at the different levels of schooling and the number of assignments needed to yield a consistent estimate of quality. However, secondary students who received higher quality assignments produced higher quality written work and scored higher as a group on the reading and language portions of the Stanford Achievement Test, 9th edition (Stanford 9) adjusted for student background and prior achievement.

[1]  Robert E. Slavin,et al.  What Works for Students at Risk: A Research Synthesis. , 1989 .

[2]  L. Darling-Hammond.  Teacher Quality and Student Achievement: A Review of State Policy Evidence , 2000 .

[3]  Ed O’Malley.  Reading/Language Arts Framework for California Public Schools: Kindergarten through Grade Twelve. , 1999 .

[4]  Daniel P. Mayer.  Measuring Instructional Practice: Can Policymakers Trust Survey Data? , 1999 .

[5]  R. Gallimore,et al.  Rousing Minds to Life: Teaching, Learning, and Schooling in Social Context , 1988 .

[6]  Lindsay Clare Matsumura,et al.  Teachers’ assignments as indicators of classroom practice in elementary schools (CSE Technical Report 545) , 2001 .

[7]  J Abedi.  Interrater/Test Reliability System (ITRS). , 1996, Multivariate behavioral research.

[8]  L. Darling-Hammond.  Teacher Quality and Student Achievement , 2000 .

[9]  Pamela R. Aschbacher,et al.  Exploring the Technical Quality of Using Assignments and Student Work as Indicators of Classroom Practice , 2001 .

[10]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[11]  Lauren B. Resnick,et al.  From Aptitude to Effort: A New Foundation for Our Schools. , 1999 .

[12]  Pamela R. Aschbacher.  Developing Indicators of Classroom Practice To Monitor and Support School Reform. CSE Technical Report. , 1999 .

[13]  Yuk Fai Cheong,et al.  HLM 6: Hierarchical Linear and Nonlinear Modeling , 2000 .

[14]  Arthur N. Applebee.  Contexts for Learning to Write: Studies of Secondary School Instruction. Writing Research: Multidisciplinary Inquiries into the Nature of Writing Series. , 1984 .

[15]  D. Ball,et al.  Relations Between Policy and Practice: A Commentary , 1990 .

[16]  J. Snyder,et al.  Restoring Balance: A Chronology of the Development and Uses of the California Standards for the Teaching Profession. , 2001 .

[17]  Charlotte F. Danielson.  Enhancing Professional Practice: A Framework for Teaching , 1996 .

[18]  Lauren B. Resnick,et al.  Standards, Assessments--and What Else? The Essential Elements of Standards-Based School Improvement. CSE Technical Report. , 2000 .

[19]  Lindsay Clare Matsumura,et al.  Using teachers’ assignments as an indicator of classroom practice (CSE Technical Report 532) , 2000 .

[20]  Lindsay Clare Matsumura,et al.  Teacher Feedback, Writing Assignment Quality, and Third-Grade Students' Revision in Lower-And Higher-Achieving Urban Schools , 2002, The Elementary School Journal.

[21]  Fred M. Newmann,et al.  Authentic Intellectual Work and Standardized Tests , 2001 .

[22]  James P. Spillane,et al.  Reform and Teaching: Exploring Patterns of Practice in the Context of National and State Mathematics Reforms , 1999 .

[23]  STANDARDS, ASSESSMENTS—AND WHAT ELSE? THE ESSENTIAL ELEMENTS OF STANDARDS-BASED SCHOOL IMPROVEMENT1 , 2000 .

[24]  Anthony S. Bryk,et al.  Authentic Intellectual Work and Standardized Tests: Conflict or Coexistence? Improving Chicago's Schools. , 2001 .

[25]  Andrew C. Porter,et al.  Synthesis of Research on Good Teaching: Insights from the Work of the Institute for Research on Teaching. , 1988 .