A study of students' heuristics and strategy patterns in web-based reciprocal peer assessment for science learning

Abstract This study examined the strategies of undergraduate student teachers participating in web-based reciprocal peer-assessment and how they were associated with learning gains in an inquiry-oriented, science learning environment. Twenty-seven participants from a university in Cyprus reciprocally assessed the digital learning products they prepared as they engaged in a web-based study unit on marine ecosystems and in particular prey–predator relationships. Data were collected through screen-video capture, peer feedback protocols, pre- and post-instructional tests and interviews, as well as the students' learning products. Data were exposed to qualitative analysis and then also treated quantitatively through the use of non-parametric tests. Our analysis led to the identification of a range of student profiles characterizing different peer-assessment patterns. In the peer-assessor role, students were distinguished into autonomous and informed assessors; whereas in the case of the assessee role they were discriminated into engaged but unlucky, disinterested and engaged assessees. Students' learning gains were associated with their actions as peer-assessees and their attitudes towards peer feedback. The findings have implications for teaching practice as well as policy for teaching and learning in web-based learning environments.

[1]  Margus Pedaste,et al.  Investigating Ecosystems as a Blended Learning Experience , 2013, Science.

[2]  Xiongyi Liu,et al.  Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment , 2014 .

[3]  Jyh-Chong Liang,et al.  Examining the role of feedback messages in undergraduate students' writing performance during an online peer assessment activity , 2015, Internet High. Educ..

[4]  K. Topping,et al.  Formative Peer Assessment of Academic Writing Between Postgraduate Students , 2000 .

[5]  Phil Davies,et al.  Computerized Peer Assessment , 2000 .

[6]  M. Winterbottom,et al.  Plants and photosynthesis: peer assessment to help students learn , 2008 .

[7]  Chin-Chung Tsai,et al.  On-line peer assessment and the role of the peer feedback: A study of high school computer course , 2007, Comput. Educ..

[8]  Zacharias C. Zacharia,et al.  Peer versus expert feedback: An investigation of the quality of peer feedback among secondary school students , 2014, Comput. Educ..

[9]  N. Chen,et al.  Improving learning achievements, motivations and problem-solving skills through a peer assessment-based game development approach , 2014 .

[10]  Barbara Wasson,et al.  Learning by creating and exchanging objects: The SCY experience , 2010, Br. J. Educ. Technol..

[11]  S. Hanrahan,et al.  Assessing Self- and Peer-assessment: The students' views , 2001 .

[12]  Derek R. Lane,et al.  Peer assessment and evaluation in team‐based learning , 2008 .

[13]  Ian Jones,et al.  Peer assessment without assessment criteria , 2014 .

[14]  Joanna Bull,et al.  Assessing student learning in higher education , 1997 .

[15]  Lan Li,et al.  Assessor or assessee: How student learning improves by giving and receiving peer feedback , 2010, Br. J. Educ. Technol..

[16]  Dominique Sluijsmans,et al.  Student involvement in assessment. The training of peer assessment skills. , 2002 .

[17]  F. Prins,et al.  Formative peer assessment in a CSCL environment: a case study , 2005 .

[18]  Eric Zhi-Feng Liu,et al.  Web-based peer assessment: feedback for students with various thinking-styles , 2001, J. Comput. Assist. Learn..

[19]  Saskia Brand-Gruwel,et al.  Peer Assessment Training in Teacher Education: Effects on performance and perceptions , 2002 .

[20]  Frank Fischer,et al.  Commentary: Peer assessment as collaborative learning: A cognitive perspective , 2010 .

[21]  K. Topping Peer Assessment Between Students in Colleges and Universities , 1998 .

[22]  P. Orsmond,et al.  The Importance of Marking Criteria in the Use of Peer Assessment , 1996 .

[23]  N. Falchikov Involving Students in Assessment , 2004 .

[24]  Zacharias C. Zacharia,et al.  Investigating Secondary School Students' Unmediated Peer Assessment Skills. , 2011 .

[25]  Alain Jaillet,et al.  Can Online Peer Assessment be Trusted? , 2009, J. Educ. Technol. Soc..

[26]  Barbara Wasson,et al.  Using scenarios to design complex technology-enhanced learning environments , 2012 .

[27]  Nian-Shing Chen,et al.  Effects of high level prompts and peer assessment on online learners' reflection levels , 2009, Comput. Educ..

[28]  Paul Black,et al.  Feedback in Questioning and Marking: The Science Teacher's Role in Formative Assessment , 2001 .

[29]  Heng-Yu Ku,et al.  An investigation of the effects of reciprocal peer tutoring , 2009, Comput. Hum. Behav..

[30]  Z. Zacharia,et al.  Peer assessment among secondary school students: Introducing a peer feedback tool in the context of a computer supported inquiry learning environment in science , 2012 .

[31]  D. Sluijsmans,et al.  The use of self-, peer and co-assessment in higher education: A review , 1999 .

[32]  Yun Xiao,et al.  The impact of two types of peer assessment on students' performance and satisfaction within a Wiki environment , 2008, Internet High. Educ..

[33]  Chi-Cheng Chang,et al.  Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school's students taking computer course , 2011, Comput. Educ..

[34]  Bronwen Cowie,et al.  The Characteristics of Formative Assessment in Science Education. , 2001 .

[35]  Patrick Onghena,et al.  Improving the effectiveness of peer feedback for learning , 2009 .

[36]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[37]  Ahmed El-Mowafy,et al.  Using peer assessment of fieldwork to enhance students’ practical training , 2014 .

[38]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[39]  K. Topping Self and Peer Assessment in School and University: Reliability, Validity and Utility , 2003 .

[40]  Barbara Wasson,et al.  Leveraging new media skills in a peer feedback tool , 2012 .

[41]  Shyan-Ming Yuan,et al.  Developing science activities through a networked peer assessment system , 2002, Comput. Educ..

[42]  Chin-Chung Tsai,et al.  Internet-Based Peer Assessment in High School Settings , 2009 .