Learning by Assessing in an EFL Writing Class

This study used many-faceted Rasch measurement to research peer assessment in EFL writing classes, following previous research which reported acceptance of the pedagogical benefits by students of attention paid to a rubric during peer assessment. Pre and post treatment writing was compared on two rubrics, one targeting specific instructional items, the second intended to measure general academic writing. Students used the instructional rubric to conduct peer assessment, but were not exposed to the secondary rubric. Substantively and statistically significant gains were observed on the instructional rubric but not on the secondary rubric, providing evidence of learning by assessing. Response patterns suggested holistic rating by peer raters, resulting in effective rank ordering of overall performances but an inability to provide formative feedback, supporting the view that the mechanism of learning was awareness arising from learning by assessing.

[1]  Joseph P. Magliano,et al.  Collaborative dialogue patterns in naturalistic one-to-one tutoring , 1995 .

[2]  S. Petersen,et al.  The neurobiology of attention , 1986 .

[3]  Carol A. Chapelle,et al.  Building a validity argument for the test of english as a foreign language , 2011 .

[4]  Lyle F. Bachman.  语言测试要略 = Fundamental considerations in language testing , 1990 .

[5]  Mary Kay Stein,et al.  Instructional explanations in the disciplines , 2010 .

[6]  Richard Badger,et al.  A comparative study of peer and teacher feedback in a Chinese EFL writing class , 2006 .

[7]  J. Mok.  A case study of students' perceptions of peer assessment in Hong Kong , 2011 .

[8]  Hebe Wong Mei Ha,et al.  Knowing and Doing in the ESL Writing Class , 2006 .

[9]  J. Schumann,et al.  The neurobiology of learning , 2014 .

[10]  Christian D. Schunn,et al.  Developing Writing Skills Through Students Giving Instructional Explanations , 2010 .

[11]  Tomoko Fujita,et al.  Characteristics and user acceptance of peer rating in EFL writing classrooms , 2004 .

[12]  Winnie Cheng,et al.  Peer assessment of language proficiency , 2005 .

[13]  Luma Balaa,et al.  Developing Detailed Rubrics for Assessing Critique Writing: Impact on EFL University Students' Performance and Attitudes , 2011 .

[14]  A. Tsui,et al.  Do Secondary L2 Writers Benefit from Peer Comments , 2000 .

[15]  Tim Roskams.  Chinese Efl Students' Attitudes To Peer Feedback and Peer Assessment in an Extended Pairwork Setting , 1999 .

[16]  Carol A. Chapelle,et al.  The Toefl Validity Argument , 2011 .

[17]  Lan Li,et al.  Assessor or assessee: How student learning improves by giving and receiving peer feedback , 2010, Br. J. Educ. Technol..

[18]  James Dean Brown,et al.  An Investigation of Second Language Task-Based Performance Assessments , 2002 .

[19]  Hui-Tzu Min,et al.  The effects of trained peer review on EFL students’ revision types and writing quality , 2006 .

[20]  Karen E. Johnson,et al.  Peer Review Negotiations: Revision Activities in ESL Writing Instruction , 1994 .

[21]  K. Topping.  Peer Assessment Between Students in Colleges and Universities , 1998 .

[22]  F. Farrokhi,et al.  A Many-Facet Rasch Measurement of Differential Rater Severity/Leniency in Three Types of Assessment , 2012 .

[23]  Bruce Thompson,et al.  Statistical Significance Tests, Effect Size Reporting and the Vain Pursuit of Pseudo-Objectivity , 1999 .

[24]  K. Topping,et al.  Collaborative writing: the effects of metacognitive prompting and structured peer interaction. , 2001, The British journal of educational psychology.

[25]  Willem J. van der Linden,et al.  Book reviews: Applying the Rasch Model , 2001 .

[26]  George Engelhard,et al.  Using Item Response Theory and Model—Data Fit to Conceptualize Differential Item and Person Functioning for Students With Disabilities , 2009 .

[27]  C. MacArthur,et al.  Student revision with peer and expert reviewing , 2010 .

[28]  A. Hughes.  Testing for language teachers , 1989 .

[29]  Hidetoshi Saito,et al.  EFL classroom peer assessment: Training effects on rating and commenting , 2008 .

[30]  Naoko Ito,et al.  Applicability of Peer Assessment for Classroom Oral Performance , 2011 .

[31]  Kwangsu Cho,et al.  Learning by reviewing , 2011 .

[32]  Jacques Crinon,et al.  The role of peer feedback in learning to write explanatory texts: why the tutors learn the most , 2010 .

[33]  T. McNamara.  Measuring Second Language Performance , 1996 .

[34]  Young Hoan Cho,et al.  Peer reviewers learn from giving comments , 2011 .

[35]  Sara Cushing Weigle,et al.  Effects of training on raters of ESL compositions , 1994 .

[36]  R. Schmidt.  The role of consciousness in second language learning , 1990 .

[37]  James Dean Brown,et al.  Criterion-Referenced Language Testing , 2002 .

[38]  J. Linacre,et al.  Many-facet Rasch measurement , 1994 .