Embedded Formative Assessment and Classroom Process Quality

In this study we examine the interplay between curriculum-embedded formative assessment—a well-known teaching practice—and general features of classroom process quality (i.e., cognitive activation, supportive climate, classroom management) and their combined effect on elementary school students’ understanding of the scientific concepts of floating and sinking. We used data from a cluster-randomized controlled trial and compared curriculum-embedded formative assessment (17 classes) with a control group (11 classes). Curriculum-embedded formative assessment and classroom process quality promoted students’ learning. Moreover, classroom process quality and embedded formative assessment interacted in promoting student learning. To ensure effective instruction and consequently satisfactory learning outcomes, teachers need to combine specific teaching practices with high classroom process quality.

[1]  J. Gustafsson,et al.  General and Specific Abilities as Predictors of School Achievement. , 1993, Multivariate behavioral research.

[2]  Jürgen Baumert,et al.  Who is the expert? Construct and criteria validity of student and teacher ratings of instruction , 2007 .

[3]  Miki K. Tomita,et al.  On the Impact of Curriculum-Embedded Formative Assessment on Learning: A Collaboration between Curriculum and Assessment Developers , 2008 .

[4]  E. Stern,et al.  Effects of instructional support within constructivist learning environments for elementary school students' understanding of "floating and sinking." , 2006 .

[5]  S. Hertel.  Beratungskompetenz von Lehrern : Kompetenzdiagnostik, Kompetenzförderung, Kompetenzmodellierung , 2009 .

[6]  Shirley Simon,et al.  Enhancing the quality of argument in school science , 2001 .

[7]  K. Gwet.  Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Raters , 2014 .

[8]  Shirley Simon,et al.  Enhancing the quality of argumentation in school science , 2004 .

[9]  Ida Rose Florez,et al.  Effective Teaching: an Emerging Synthesis , 2009 .

[10]  Ulrich Trautwein,et al.  Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modeling , 2009 .

[11]  J. Schafer,et al.  A comparison of inclusive and restrictive strategies in modern missing data procedures. , 2001, Psychological methods.

[12]  Laura M. Stough,et al.  Classroom Management: A Critical Part of Educational Psychology, With Implications for Teacher Education , 2001 .

[13]  P. Black,et al.  Developing the theory of formative assessment , 2009 .

[14]  Timothy W. Curby,et al.  Teacher–child interactions and children’s achievement trajectories across kindergarten and first grade. , 2009 .

[15]  Kurt Reusser,et al.  Quality of geometry instruction and its short-term impact on students' understanding of the Pythagorean Theorem , 2009 .

[16]  Mark Wilson,et al.  From Principles to Practice: An Embedded Assessment System , 2000 .

[17]  Jaap Scheerens,et al.  The Foundations of Educational Effectiveness , 1997 .

[18]  Ian Findley,et al.  Assessing Impact, Handbook of EIA and SEA Follow-up , 2004 .

[19]  Ina V. S. Mullis,et al.  TIMSS 2011 International Results in Science. , 2012 .

[20]  William E. Cashin,et al.  Student Ratings of Teaching : A Summary of Research and Literature , 2012 .

[21]  Jörgen Sandberg,et al.  Unveiling Professional Development: A Critical Review of Stage Models , 2006 .

[22]  Erin Marie Furtak,et al.  Science Classroom Discussion as Scientific Argumentation: A Study of Conceptually Rich (and Poor) Student Talk , 2010 .

[23]  Craig K. Enders,et al.  Centering predictor variables in cross-sectional multilevel models: a new look at an old issue. , 2007, Psychological methods.

[24]  Amelia Wenk Gotwals,et al.  Learning progressions in science : current challenges and future directions , 2012 .

[25]  Charlotte F. Danielson.  Enhancing Professional Practice: A Framework for Teaching , 1996 .

[26]  S. Krauss,et al.  Teachers’ Mathematical Knowledge, Cognitive Activation in the Classroom, and Student Progress , 2010 .

[27]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[28]  Daniel F. McCaffrey,et al.  Have We Identified Effective Teachers? Validating Measures of Effective Teaching Using Random Assignment. Research Paper. MET Project. , 2013 .

[29]  S. Elliott,et al.  Opportunity to Learn , 2016 .

[30]  A. Greenwald.  Validity concerns and usefulness of student ratings of instruction. , 1997, The American psychologist.

[31]  R. Pianta,et al.  Mother-child relationships, teacher-child relationships, and school outcomes in preschool and kindergarten , 1997 .

[32]  Pam Grossman,et al.  Measure for Measure: The Relationship between Measures of Instructional Practice in Middle School English Language Arts and Teachers' Value-Added Scores. NBER Working Paper No. 16015. , 2010 .

[33]  B. P. Foley,et al.  Student Perceptions of Classroom Learning Environments: Development of the ClassMaps Survey , 2010 .

[34]  Ulrich Trautwein,et al.  Reliability and agreement of student ratings of the classroom environment: A reanalysis of TIMSS data , 2007 .

[35]  Carol L. O'Donnell.  Fidelity of implementation to instructional strategies as a moderator of curriculum unit effectiveness in a large -scale middle school science quasi -experiment , 2007 .

[36]  Bronwen Cowie,et al.  The Characteristics of Formative Assessment in Science Education. , 2001 .

[37]  Jean-Philippe Laurenceau,et al.  Power analysis for intensive longitudinal studies. , 2012 .

[38]  Neal M. Kingston,et al.  Formative Assessment: A Meta-Analysis and a Call for Research , 2011 .

[39]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[40]  S. Raudenbush.  Advancing Educational Policy by Advancing Research on Instruction , 2008 .

[41]  G. Masters.  A rasch model for partial credit scoring , 1982 .

[42]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[43]  Michael Schneider,et al.  Profiles of inconsistent knowledge in children's pathways of conceptual change. , 2013, Developmental psychology.

[44]  T. Seidel,et al.  Teaching Effectiveness Research in the Past Decade: The Role of Theory and Research Design in Disentangling Meta-Analysis Results , 2007 .

[45]  H. Davis,et al.  Conceptualizing the Role and Influence of Student-Teacher Relationships on Children's Social and Cognitive Development , 2003 .

[46]  C. Atman,et al.  How people learn. , 1985, Hospital topics.

[47]  B. Hamre,et al.  Conceptualization, Measurement, and Improvement of Classroom Processes: Standardized Observation Can Leverage Capacity , 2009 .

[48]  J. Brophy.  Classroom Organization and Management , 1983, The Elementary School Journal.

[49]  Deborah Loewenberg Ball,et al.  Building a Common Core for Learning to Teach: And Connecting Professional Learning to Practice. , 2011 .

[50]  T. A. Warm.  Weighted likelihood estimation of ability in item response theory , 1989 .

[51]  Marc A. Brackett,et al.  Classroom emotional climate, student engagement, and academic achievement , 2012 .

[52]  Amelia Wenk Gotwals,et al.  Learning Progressions in Science , 2012 .

[53]  Mark W. Lipsey,et al.  The positive effects of cognitive–behavioral programs for offenders: A meta-analysis of factors associated with effective treatment , 2005 .

[54]  Dylan Wiliam,et al.  Embedded Formative Assessment , 2011 .

[55]  Eckhard Klieme,et al.  Written feedback in mathematics: Mediated by students' perception, moderated by goal orientation , 2013 .

[56]  J. Kounin.  Discipline and group management in classrooms , 1970 .

[57]  B. Hamre,et al.  Can instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure? , 2005, Child development.

[58]  Jürgen Baumert,et al.  Professional Competence of Teachers: Effects on Instructional Quality and Student Development , 2013 .

[59]  Okhee Lee.  Science Education With English Language Learners: Synthesis and Research Agenda , 2005 .

[60]  Ilonca Hardy,et al.  Impact of Additional Guidance in Science Education on Primary Students’ Conceptual Understanding , 2015 .

[61]  H. Walberg,et al.  Toward a Knowledge Base for School Learning , 1993 .

[62]  R. Duschl,et al.  Learning progressions and teaching sequences: a review and analysis , 2011 .

[63]  E. Klieme,et al.  Implementing curriculum-embedded formative assessment in primary school science classrooms , 2016 .

[64]  Frederick S. Breed,et al.  Classroom organization and management , 1934 .

[65]  Eckhard Klieme,et al.  Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes , 2014 .

[66]  Erin Marie Furtak,et al.  On the Fidelity of Implementing Embedded Formative Assessments and Its Relation to Student Learning , 2008 .

[67]  Lorin W. Anderson,et al.  The IEA classroom environment study , 1989 .

[68]  D. Sadler.  Formative assessment and the design of instructional systems , 1989 .

[69]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[70]  Barry J. Fraser,et al.  Parent and student perceptions of classroom learning environment and its association with student outcomes , 2007 .

[71]  Jeffrey H. D. Cornelius-White.  Learner-Centered Teacher-Student Relationships Are Effective: A Meta-Analysis , 2007 .