Synchronous discussion between assessors and assessees in web-based peer assessment: impact on writing performance, feedback quality, meta-cognitive awareness and self-efficacy

Abstract Research on peer assessment in higher education has been conducted for decades. However, ways to improve the quality of peer feedback and optimise student’ benefits through peer assessment remain a puzzle. The present study aimed to examine the impacts of synchronous discussion between assessors and assessees on writing performance, qualitative feedback quality, meta-cognitive awareness and self-efficacy in web-based peer assessment. A total of 64 undergraduate students participated in the study and were randomly assigned into either the experimental or control group. Participants in the experimental group conducted synchronous discussion after the first round of peer assessment, while students in the control group did not conduct any synchronous discussion. The results revealed that synchronous discussion between the assessors and assessees significantly improved the students’ writing performance, especially content writing skills, affective and meta-cognitive feedback quality, meta-cognitive awareness and self-efficacy. Practical implications, limitations and future directions are discussed based on these findings.

[1]  Gregory Schraw,et al.  Assessing metacognitive awareness , 1994 .

[2]  Hui-Chun Chu,et al.  Potential Negative Effects of Mobile Learning on Students' Learning Achievement and Cognitive Load - A Format Assessment Perspective , 2014, J. Educ. Technol. Soc..

[3]  Rochelle F. Rubin,et al.  Student performance on and attitudes toward peer assessments on Advanced Pharmacy Practice Experience assignments , 2012 .

[4]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[5]  Ruth Cobos Pérez,et al.  Promoting metacognitive skills through peer scaffolding in a CSCL environment , 2010, Int. J. Comput. Support. Collab. Learn..

[6]  Jyh-Chong Liang,et al.  Examining the role of feedback messages in undergraduate students' writing performance during an online peer assessment activity , 2015, Internet High. Educ..

[7]  Jyh-Chong Liang,et al.  The development of science activities via on-line peer assessment: the role of scientific epistemological views , 2009 .

[8]  Vincent Aleven,et al.  Evaluating the Effectiveness of a Tutorial Dialogue System for Self-Explanation , 2004, Intelligent Tutoring Systems.

[9]  D. Conover.  Local adaptation in marine fishes : Evidence and implications for stock enhancement , 1998 .

[10]  Luning Liu,et al.  A multi-peer assessment platform for programming language learning: considering group non-consensus and personal radicalness , 2016, Interact. Learn. Environ..

[11]  Ming Ming Diao,et al.  ‘I’m not here to learn how to mark someone else’s stuff’: an investigation of an online peer-to-peer review workshop tool , 2015 .

[12]  Gerard Arbat,et al.  Peer and self-assessment applied to oral presentations from a multidisciplinary perspective , 2016 .

[13]  F. Coleman,et al.  Critically assessing stock enhancement : An introduction to the mote symposium , 1998 .

[14]  Yun Xiao,et al.  The impact of two types of peer assessment on students' performance and satisfaction within a Wiki environment , 2008, Internet High. Educ..

[15]  Xiongyi Liu,et al.  Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment , 2014 .

[16]  Xiongyi Liu,et al.  Small group discussion as a key component in online assessment training for enhanced student learning in web-based peer assessment , 2018 .

[17]  D. Sadler,et al.  Formative Assessment: revisiting the territory , 1998 .

[18]  Michael Mogessie Ashenafi.  Peer-assessment in higher education – twenty-first century practices, challenges and the way forward , 2017 .

[19]  Gwo-Jen Hwang,et al.  An interactive peer-assessment criteria development approach to improving students' art design performance using handheld devices , 2015, Comput. Educ..

[20]  N. Chen,et al.  Improving learning achievements, motivations and problem-solving skills through a peer assessment-based game development approach , 2014 .

[21]  Kuo-An Hwang,et al.  A synchronous distance discussion procedure with reinforcement mechanism: Designed for elementary school students to achieve the attending and responding stages of the affective domain teaching goals within a class period , 2008, Comput. Educ..

[22]  K. Topping.  Peer Assessment Between Students in Colleges and Universities , 1998 .

[23]  Ronghuai Huang,et al.  The impact of a two-round, mobile peer assessment on learning achievements, critical thinking skills, and meta-cognitive awareness , 2016, Int. J. Mob. Learn. Organisation.

[24]  Daniel Reinholz,et al.  The assessment cycle: a model for learning through peer assessment , 2016 .

[25]  Ching-Huei Chen,et al.  EFL writing revision with blind expert and peer review using a CMC open forum , 2015 .

[26]  Gwo-Jen Hwang,et al.  Effects of different online peer-feedback approaches on students' performance skills, motivation and self-efficacy in a dance course , 2016, Comput. Educ..

[27]  Charles Holcombe.  A History of East Asia: From the Origins of Civilization to the Twenty-First Century , 2010 .

[28]  Fu-Yun Yu,et al.  Different identity revelation modes in an online peer-assessment learning environment: Effects on perceptions toward assessors, classroom climate and learning activities , 2011, Comput. Educ..