From Testing to Teaching: The Use of Interim Assessments in Classroom Instruction

The past ten years have witnessed an explosion in the use of interim assessments by school districts across the country. A primary reason for this rapid growth is the assumption that interim assessments can inform and improve instructional practice and thereby contribute to increased student achievement. Testing companies, states, and districts have become invested in selling or creating interim assessments and data management systems designed to help teachers, principals, and district leaders make sense of student data, identify areas of strengths and weaknesses, identify instructional strategies for targeted students, and much more. Districts are keeping their interim tests even under pressure to cut budgets (Sawchuk, 2009). The U.S. Department of Education is using its Race to the Top program to encourage school districts to develop formative or interim assessments as part of comprehensive state assessment systems. Much of the rhetoric around interim assessments paints a rosy picture, often with the ultimate claim that such measures will lead to increased student achievement. Much of the belief in the potential of interim assessments to improve student learning comes from the growing body of research on formative assessment. However, the majority of this research has not focused on interim assessments themselves, but rather practices that are embedded within classroom instruction. Very few studies exist on how interim assessments are actually used, by individual teachers in classrooms, by principals, and by districts. Furthermore, we know little about how teachers and other educators use the results from such assessments, the conditions that support their ability to use these data to improve instruction, or the interaction of interim assessments with other classroom assessment practices. Our study begins to fill that vacuum. Disciplines Curriculum and Instruction | Educational Administration and Supervision | Educational Assessment, Evaluation, and Research Comments View on the CPRE website. This report is available at ScholarlyCommons: http://repository.upenn.edu/cpre_researchreports/58 The Consortium for Policy Research in Education includes: University of Pennsylvania Teachers College Columbia University Harvard University Stanford University University of Michigan University of Wisconsin-Madison Northwestern University From Testing to Teaching: The Use of Interim Assessments in Classroom Instruction

[1]  James P. Spillane,et al.  Evidence in Practice: A Framing of the Terrain , 2007, Teachers College Record: The Voice of Scholarship in Education.

[2]  J. Supovitz The Case for District-Based Reform: Leading, Building, and Sustaining School Improvement , 2006 .

[3]  Eva L. Baker,et al.  Making Benchmark Testing Work. , 2005 .

[4]  Amy M. Hightower,et al.  School districts and instructional renewal , 2002 .

[5]  J. Stigler,et al.  Mathematics classrooms in Japan, Taiwan, and the United States. , 1987, Child development.

[6]  R. Tierney Changing practices: influences on classroom assessment , 2006 .

[7]  Gary Natriello The Impact of Evaluation Processes on Students , 1987 .

[8]  A. Su,et al.  The National Council of Teachers of Mathematics , 1932, The Mathematical Gazette.

[9]  ANZJFT and AAFT , 2010 .

[10]  J. Bransford,et al.  Preparing Teachers for a Changing World: What Teachers Should Learn and Be Able to Do. , 2005 .

[11]  D. Cohen A Revolution in One Classroom: The Case of Mrs. Oublier , 1990 .

[12]  M. Franke,et al.  Teachers' knowledge and its impact. , 1992 .

[13]  R. Maranto A Tale of Two Cities: School Privatization in Philadelphia and Chester , 2005, American Journal of Education.

[14]  D. Ball With an Eye on the Mathematical Horizon: Dilemmas of Teaching Elementary School Mathematics , 1993, The Elementary School Journal.

[15]  Anthony Ralston,et al.  Knowing and teaching elementary mathematics , 1999 .

[16]  Lorrie A. Shepard,et al.  The Role of Classroom Assessment in Teaching and Learning. CSE Technical Report. , 2000 .

[17]  Richard S. Prawat,et al.  Teaching Mathematics for Understanding: Discussing Case Studies of Four Fifth-Grade Teachers , 1992, The Elementary School Journal.

[18]  R. Duschl,et al.  Strategies and Challenges to Changing the Focus of Assessment and Instruction in Science Classrooms. , 1997 .

[19]  James P. Spillane Cognition and Policy Implementation: District Policymakers and the Reform of Mathematics Education , 2000 .

[20]  L. Shulman Knowledge and Teaching: Foundations of the New Reform , 1987 .

[21]  J. Gardner Assessment and learning , 2006 .

[22]  Joseph Moses Juran,et al.  Juran Institute's Six Sigma Breakthrough and Beyond , 2004 .

[23]  Michael S. Knapp,et al.  How Can Organizational and Sociocultural Learning Theories Shed Light on District Instructional Reform? , 2008, American Journal of Education.

[24]  Ann Dowker,et al.  The Development of Arithmetic Concepts and Skills , 2003 .

[25]  Jeffrey C. Wayman,et al.  Technology‐Supported Involvement of Entire Faculties in Examination of Student Data for Instructional Improvement , 2006, American Journal of Education.

[26]  Bronwen Cowie,et al.  Formative assessment and science education , 2000 .

[27]  D. Greenwood,et al.  Introduction to Action Research: Social Research for Social Change , 1998 .

[28]  Scott Naftel,et al.  Explore RAND Education , 2004 .

[29]  Zhonghe Wu,et al.  The Pedagogical Content Knowledge of Middle School, Mathematics Teachers in China and the U.S. , 2004 .

[30]  Miki K. Tomita,et al.  On the Impact of Curriculum-Embedded Formative Assessment on Learning: A Collaboration between Curriculum and Assessment Developers , 2008 .

[31]  Jonathan Arnowitz,et al.  Pay attention! , 2006, INTR.

[32]  Elizabeth Fennema,et al.  Using Children’s Mathematical Knowledge in Instruction , 1993 .

[33]  W. Clune,et al.  Policy Effectiveness of Interim Assessments in Providence Public Schools. WCER Working Paper No. 2008-10. , 2008 .

[34]  J. Hiebert Conceptual and procedural knowledge : the case of mathematics , 1987 .

[35]  Jonathan A. Supovitz,et al.  Mapping a Course for Improved Student Learning: How Innovative Schools Systematically Use Student Performance Data to Guide Improvement , 2003 .

[36]  B. Hamre,et al.  Classroom processes and positive youth development: conceptualizing, measuring, and improving the capacity of interactions between teachers and students. , 2009, New directions for youth development.

[37]  P. Moss Evidence and decision making , 2007 .

[38]  Helen Timperley,et al.  Teacher professional learning and development: Best evidence synthesis iteration , 2007 .

[39]  Meredith D. Gall,et al.  Northwest Regional Educational Laboratory. , 1971 .

[40]  David Kauffman,et al.  "Lost at Sea": New Teachers' Experiences with Curriculum and Assessment. , 2002 .

[41]  Anthonius J.M. de Jong,et al.  Types and qualities of knowledge , 1993 .

[42]  Donald A. Schön,et al.  Organizational Learning: A Theory Of Action Perspective , 1978 .

[43]  Bethan Marshall,et al.  How teachers engage with Assessment for Learning: lessons from the classroom , 2006 .

[44]  T. Delamothe Look at ME , 1994 .

[45]  Sarah Guckenburg,et al.  Measuring how benchmark assessments affect student achievement , 2007 .

[46]  Andrew C. Porter,et al.  External Standards and Good Teaching: The Pros and Cons of Telling Teachers What to Do , 1988 .

[47]  M. Lachat,et al.  Practices That Support Data Use in Urban High Schools , 2005 .

[48]  L. Shepard Formative assessment: Caveat emptor , 2005 .

[49]  R. Stiggins Facing Challenges of a New Era of Educational Assessment , 1991 .

[50]  Brian Rowan,et al.  What Large-Scale, Survey Research Tells Us About Teacher What Large-Scale, Survey Research Tells Us About Teacher Effects on Student Achievement: Insights From the Prospectus Effects on Student Achievement: Insights From the Prospectus Study of Elementary Schools Study of Elementary Schools , 2015 .

[51]  G. Cizek,et al.  Handbook of Formative Assessment. , 2010 .

[52]  P. Black,et al.  Developing the theory of formative assessment , 2009 .

[53]  Mathematics Classrooms in Japan, Taiwan, and the United States. , 1987 .

[54]  John F. Pane,et al.  Making Sense of Data-Driven Decision Making in Education , 2006 .

[55]  L. Shepard,et al.  Effects of Introducing Classroom Peflormance Assessments on Student Learning , 2005 .

[56]  Ann Dowker,et al.  The development of arithmetic concepts and skills: Constructing adaptive expertise , 2003 .

[57]  L. Darling-Hammond,et al.  Teaching as the Learning Profession : Handbook of Policy and Practice , 1999 .

[58]  Reforming primary science assessment practices: A case study of one teacher's professional development through action research , 2002 .

[59]  K. Lewin Action Research and Minority Problems , 1946 .

[60]  Richard J. Stiggins,et al.  THE ECOLOGY OF CLASSROOM ASSESSMENT , 1985 .

[61]  C. Palau,et al.  ASSESSMENT IN EDUCATION , 2015 .

[62]  Charalambos Y. Charalambous,et al.  Mathematical Knowledge for Teaching and the Mathematical Quality of Instruction: An Exploratory Study , 2008 .

[63]  D. Ball,et al.  Developing Measures of Teachers’ Mathematics Knowledge for Teaching , 2004, The Elementary school journal.

[64]  Douglas A. Grouws,et al.  Handbook of research on mathematics teaching and learning , 1992 .

[65]  A. Goverde,et al.  Train the trainers! , 2006 .

[66]  Some difficulties in informal assessment in mathematics , 2006 .

[67]  Chris Donlan,et al.  The Development of Mathematical Skills , 2021 .

[68]  Lee S. Shulman,et al.  Teacher Development: Roles of Domain Expertise and Pedagogical Knowledge , 2000 .

[69]  Viki M. Young Teachers’ Use of Data: Loose Coupling, Agenda Setting, and Team Norms , 2006, American Journal of Education.

[70]  P. Black,et al.  Working inside the Black Box: Assessment for Learning in the Classroom , 2004 .

[71]  Heather C. Hill,et al.  Effects of Teachers’ Mathematical Knowledge for Teaching on Student Achievement , 2005 .

[72]  Using Student Data to Improve Teaching and Learning: Findings from an Evaluation of the Formative Assessments of Students Thinking in Reading (FAST-R) Program in Boston Elementary Schools. , 2008 .

[73]  T. Crooks The Impact of Classroom Evaluation Practices on Students , 1988 .

[74]  Susan B. Empson,et al.  A Longitudinal Study of Learning to Use Children's Thinking in Mathematics Instruction , 1996, Journal for Research in Mathematics Education.

[75]  Meredith I. Honig,et al.  Adaptive Assistance for Learning Improvement Efforts: The Case of the Institute for Learning , 2008 .

[76]  S. Epstein,et al.  Pain and Gain: Implementing No Child Left Behind in Three States, 2004-2006 , 2008 .

[77]  A. Baroody,et al.  An Alternative Reconceptualization of Procedural and Conceptual Knowledge. , 2007 .

[78]  J. R. Lockwood,et al.  Using Structured Classroom Vignettes to Measure Instructional Practices in Mathematics , 2006 .

[79]  Bertram C. Bruce The inquiry Cycle , 2008 .

[80]  Heather C. Hill,et al.  Validating the Ecological Assumption: The Relationship of Measure Scores to Classroom Teaching and Student Learning , 2007 .

[81]  Erin Marie Furtak,et al.  Informal Formative Assessment of Students' Understanding of Scientific Inquiry. CSE Report 639. , 2004 .

[82]  Katrina E. Bulkley,et al.  Making the Most of Interim Assessment Data. Lessons from Philadelphia. , 2009 .

[83]  Robert S. Siegler,et al.  The relation between conceptual and procedural knowledge in learning mathematics: A review , 2021, The Development of Mathematical Skills.

[84]  Penelope L. Peterson,et al.  Teachers ' Pedagogical Content Knowledge of Students ' Problem Solving in Elementary Arithmetic Author ( s ) : , 2007 .

[85]  R. Stiggins,et al.  Measuring Thinking Skills Through Classroom Assessment , 1989 .

[86]  Julie A. Marsh,et al.  Strategies to Promote Data Use for Instructional Improvement: Actions, Outcomes, and Lessons fromThree Urban Districts , 2006, American Journal of Education.

[87]  Rose Mary Carroll-Johnson,et al.  Point and click. , 2003, Oncology nursing forum.

[88]  J. Hiebert,et al.  Conceptual and Procedural Knowledge in Mathematics: An Introductory Analysis , 1986 .

[89]  Nancy S. Sharkey,et al.  Tough Choices in Designing a Formative Assessment System , 2006, American Journal of Education.

[90]  Margaret Heritage,et al.  Toward a Framework for Using Student Mathematical Representations as Formative Assessments , 2006 .

[91]  G. Cizek,et al.  Th e Practical Implications of Educational Aims and Contexts for Formative Assessment , 2010 .

[92]  chapter 6 Culture and Processes Affecting Data Use in School Districts , 2007 .

[93]  Brian W. Junker,et al.  Measuring Reading Comprehension and Mathematics Instruction in Urban Middle Schools: A Pilot Study of the Instructional Quality Assessment , 2006 .

[94]  L. L. Winslow Art in elementary education , 1942 .

[95]  Eric Sotto,et al.  When Teaching Becomes Learning: A Theory and Practice of Teaching , 1994 .

[96]  Alicia C. Alonzo,et al.  Examining the Utility of Elementary Science Notebooks for Formative Assessment Purposes , 2006 .

[97]  David Steven Scott Curriculum and Assessment , 2000 .

[98]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[99]  R. Schroeder,et al.  Accountability Policies and Teacher Decision Making: Barriers to the Use of Data to Improve Practice. , 2004 .

[100]  chapter 4 Understanding the Promise and Dynamics of Data‐Informed Leadership , 2007 .

[101]  Julie A. Marsh,et al.  Cutting through the “Data-Driven” Mantra: Different Conceptions of Data-Driven Decision Making , 2007, Teachers College Record: The Voice of Scholarship in Education.

[102]  Jolley Bruce Christman,et al.  The Limits and Contradictions of Systemic Reform: The Philadelphia Story. , 2002 .

[103]  Michael J. Timms,et al.  The Nature and Impact of Teachers' Formative Assessment Practices. CSE Technical Report 703. , 2006 .

[104]  Arthur J. Baroody The development of adaptive expertise and flexibility: The integration of conceptual and procedural knowledge , 2003 .

[105]  Scott Marion,et al.  Moving toward a Comprehensive Assessment System: A Framework for Considering Interim Assessments. , 2009 .

[106]  Katrina E. Bulkley,et al.  Building With Benchmarks: The Role of the District in Philadelphia's Benchmark Assessment System , 2010 .

[107]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[108]  Barbara Means,et al.  Implementing Data-Informed Decision Making in Schools: Teacher Access, Supports and Use. , 2009 .

[109]  D. Sadler,et al.  Formative Assessment: revisiting the territory , 1998 .