On the Fidelity of Implementing Embedded Formative Assessments and Its Relation to Student Learning

Given the current emphasis on conducting high-quality experimental studies, it is becoming increasingly important for researchers to accompany their studies with evaluations of the fidelity of implementation of the experimental treatments. This article compares the form and extent of an experimental treatment to student learning. The study involved six middle-school physical science teachers and their students. Videotaped lessons were coded according to their alignment with the treatment's intended structure and processes; results identified a 0.71 correlation between teachers' enactment of formative assessment and student learning. The article suggests that the results of the study may have been due, at least in part, to the failure of many of the experimental-group teachers to implement the treatment as intended.

[1]  A. Ahlgren,et al.  Science for all Americans , 1990 .

[2]  J. Shea National Science Education Standards , 1995 .

[3]  Shirley Simon,et al.  Enhancing the quality of argumentation in school science , 2004 .

[4]  Maria Araceli Ruiz-Primo,et al.  A Multi-Method and Multi-Source Approach for Studying Fidelity of Implementation. CSE Report 677. , 2006 .

[5]  R. Prinz,et al.  Treatment fidelity in outcome studies , 1991 .

[6]  V. Richardson The role of attitudes and beliefs in learning to teach , 1996 .

[7]  F. Rutherford Science for all Americans / F. James Rutherford , 1990 .

[8]  Ginette Delandshere,et al.  Assessment as Inquiry. , 2002 .

[9]  J. Dossey,et al.  The Underachieving Curriculum : Assessing U. S. School Mathematics from an International Perspective , 1987 .

[10]  H. Ireys,et al.  Reinventing fidelity: The transfer of social technology among settings , 1991, American journal of community psychology.

[11]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[12]  Erin Marie Furtak,et al.  Exploring teachers' informal formative assessment practices and students' understanding in the context of scientific inquiry , 2007 .

[13]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[14]  Deborah Bybee,et al.  Fidelity Criteria: Development, Measurement, and Validation , 2003 .

[15]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[16]  A. Collins National Science Education Standards: A Political Document. , 1998 .

[17]  P. Black,et al.  Classroom Assessment and the National Science Education Standards. , 2001 .

[18]  E. Craig,et al.  Teachers' Characteristics: Research on the Indicators of Quality. , 2005 .

[19]  J. Osborne,et al.  The place of argumentation in the pedagogy of school science , 1999 .

[20]  Edgar W. Jenkins,et al.  Benchmarks for Science Literacy: a review symposium∗ , 1995 .

[21]  D. Sadler Formative assessment and the design of instructional systems , 1989 .

[22]  Erin Marie Furtak,et al.  Informal Formative Assessment and Scientific Inquiry: Exploring Teachers' Practices and Student Learning , 2006 .