Helping preservice teachers learn to assess writing: Practice and feedback in a Web-based environment

Abstract Writing is a highly valued skill that is often neglected in the classroom; one reason is that teachers often do not receive adequate training in writing assessment and instruction. Teachers, particularly preservice teachers, need practice making detailed assessments of student writing and to build their confidence for assessing student writing, but practical issues of time and resources often constrain the frequency and quality of training they receive. This mixed method study focused on the design and evaluation of an online tool for building preservice teachers’ writing assessment skills and self-efficacy for writing assessment. In the study, teacher education students interacted with actual 4th-graders’ writing samples via a Web-based critical thinking tool. They received scaffolded practice in assessing multiple student papers and justified their assessments using analytic criteria. After each paper, they received feedback that included access to expert assessments and those of their peers, along with both teacher and peer rationales for their ratings. Participants significantly improved in ability to accurately assess student writing using an analytic approach and in knowledge of the writing traits. They also showed significantly greater self-efficacy for assessing student writing and high levels of satisfaction with the Web-based tool and their overall learning experience.

[1]  S. Graham,et al.  Improving the writing performance, knowledge, and self-efficacy of struggling young writers: The effects of self-regulated strategy development , 2005 .

[2]  Karen R. Harris,et al.  Making the Writing Process Work : Strategies for Composition and Self-Regulation , 1999 .

[3]  John R. Anderson ACT: A simple theory of complex cognition. , 1996 .

[4]  J. Isernhagen,et al.  A Statewide Writing Assessment Model: Student Proficiency and Future Implications. , 2008 .

[5]  Anastasia Kitsantas,et al.  Acquiring writing revision skill : Shifting from process to outcome self-regulatory goals , 1999 .

[6]  Judith A. Langer,et al.  Writing and Reading Relationships: Constructive Tasks , 2000 .

[7]  H. Mandl,et al.  Learning from Worked-Out Examples: The Effects of Example Variability and Elicited Self-Explanations , 1998, Contemporary educational psychology.

[8]  Gregory Schraw Knowledge: Structures and Processes. , 2006 .

[9]  J. Hayes A new framework for understanding cognition and affect in writing. , 1996 .

[10]  L. Resnick,et al.  Knowing, Learning, and Instruction , 2018 .

[11]  S. Palthepu,et al.  Learning by Teaching , 1991 .

[12]  Duane F. Shell,et al.  Self-efficacy, attribution, and outcome expectancy mechanisms in reading and writing achievement: Grade-level and achievement-level differences. , 1995 .

[13]  David Newman,et al.  Evaluating the Quality of Learning in Computer Supported Co-Operative Learning , 1997, J. Am. Soc. Inf. Sci..

[14]  R. Bangert-Drowns,et al.  The Effects of School-Based Writing-to-Learn Interventions on Academic Achievement: A Meta-Analysis , 2004 .

[15]  Mark A. Smylie The Enhancement Function of Staff Development: Organizational and Psychological Antecedents to Individual Teacher Change , 1988 .

[16]  S. Graham,et al.  Self-Regulated Strategy Development: Helping Students with Learning Problems Develop as Writers , 1993, The Elementary School Journal.

[17]  Dale H. Schunk,et al.  Strategy Fading and Progress Feedback , 1993 .

[18]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[19]  M. Chi,et al.  Eliciting Self‐Explanations Improves Understanding , 1994 .

[20]  D L Morgan,et al.  Practical Strategies for Combining Qualitative and Quantitative Methods: Applications to Health Research , 1998, Qualitative health research.

[21]  Steve Graham,et al.  Strategy Instruction and the Teaching of Writing: A Meta-Analysis. , 2006 .

[22]  Boyd Co,et al.  Combining qualitative and quantitative approaches. , 1993, NLN publications.

[23]  George Hillocks,et al.  SYNTHESIS OF RESEARCH ON TEACHING WRITING , 1986 .

[24]  Charles A. MacArthur,et al.  Handbook of Writing Research , 2005 .

[25]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[26]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[27]  R. Moreno Decreasing Cognitive Load for Novice Students: Effects of Explanatory versus Corrective Feedback in Discovery-Based Multimedia , 2004 .

[28]  Carl Nagin,et al.  Because Writing Matters: Improving Student Writing in Our Schools , 2003 .

[29]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[30]  R. Atkinson,et al.  Transitioning From Studying Examples to Solving Problems: Effects of Self-Explanation Prompts and Fading Worked-Out Steps. , 2003 .

[31]  Frank Pajares,et al.  SELF-EFFICACY BELIEFS, MOTIVATION, AND ACHIEVEMENT IN WRITING: A REVIEW OF THE LITERATURE , 2003 .

[32]  Richard C. Anderson,et al.  Feedback Procedures in Programmed Instruction. , 1971 .

[33]  Robert Ochsner,et al.  Playing Devil’s Advocate: Evaluating the Literature of the WAC/WID Movement , 2004 .

[34]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[35]  J. Hayes,et al.  Images, Plans, and Prose , 1984 .

[36]  Abbas Tashakkori,et al.  Mixed Methodology: Combining Qualitative and Quantitative Approaches , 1998 .

[37]  Andrea R. McCrindle,et al.  The impact of learning journals on metacognitive and cognitive processes and learning performance , 1995 .

[38]  John R. Anderson Problem solving and learning. , 1993 .

[39]  Alexander Renkl,et al.  Learning from Worked-Out-Examples: A Study on Individual Differences , 1997, Cogn. Sci..

[40]  K. Yancey Looking Back as We Look Forward: Historicizing Writing Assessment. , 1999 .

[41]  Linda Flower,et al.  Problem Solving Strategies for Writing in College and Community , 1997 .

[42]  Min Liu,et al.  The Effects of Modeling Expert Cognitive Strategies during Problem-Based Learning , 2002 .

[43]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[44]  Mark T. Keane,et al.  Cognitive Psychology: A Student's Handbook , 1990 .

[45]  J. M. Webb,et al.  Form of Feedback Effects on Verb Learning and Near-Transfer Tasks by Sixth Graders. , 1995 .

[46]  Paul B. Diederich,et al.  Measuring Growth in English , 1974 .

[47]  Roger Bruning,et al.  Developing Motivation to Write , 2000 .

[48]  Judith A. Langer,et al.  How Writing Shapes Thinking: A Study of Teaching and Learning. NCTE Research Report No. 22. , 1987 .

[49]  Stephen Tchudi,et al.  Alternatives to Grading Student Writing , 1997 .

[50]  M. Scardamalia,et al.  The psychology of written composition , 1987 .