Does the use of summative peer assessment in collaborative group work inhibit good judgement?

The accuracy and consistency of peer marking, particularly when students have the power to reward (or penalise) during formative and summative assessment regimes, is largely unknown. The objective of this study is to evaluate students’ ability and behaviour in marking their peers’ teamwork performance in a collaborative group assessment context both when the mark is counted and not counted towards their final grade. Formative and summative assessment data were obtained from 98 participants in anonymous self and peer assessment of team members’ contributions to a group assessment in business courses. The findings indicate that students are capable of accurately and consistently judging their peers’ performance to a large extent, especially in the formative evaluation of the process component of group work. However, the findings suggest significant peer grading bias when peer marks contribute to final grades. Overall, findings suggest that students are reluctant to honestly assess their peers when they realise that their actions can penalise non-contributing students. This raises questions about the appropriateness of using peer marks for summative assessment purposes. To overcome the problems identified, this paper proposes a number of measures to guide educators in effectively embedding summative peer assessment in a group assessment context.

[1]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[2]  E. Molloy,et al.  The role of peer-assisted learning in building evaluative judgement: opportunities in clinical medical education , 2015, Advances in Health Sciences Education.

[3]  K. Topping Peer Assessment , 2009 .

[4]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[5]  Anne Gardner,et al.  Investigating the capacity of self and peer assessment activities to engage students and promote learning , 2010 .

[6]  D. Sadler Beyond feedback: developing student capability in complex appraisal , 2010 .

[7]  Heidi Andrade,et al.  Student responses to criteria‐referenced self‐assessment , 2007 .

[8]  C. Rust The Impact of Assessment on Student Learning , 2002 .

[9]  M. Price,et al.  Let’s stop the pretence of consistent marking: exploring the multiple limitations of assessment criteria , 2016 .

[10]  C. Reich Peer assessment. , 1985, Canadian Medical Association journal.

[11]  Assessment for learning in higher education , 2014 .

[12]  Stéphane Brutus,et al.  Can Business Students Learn to Evaluate Better? Evidence From Repeated Exposure to a Peer-Evaluation System , 2013 .

[13]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[14]  Renée Speyer,et al.  Reliability and validity of student peer assessment in medical education: A systematic review , 2011, Medical teacher.

[15]  David Boud,et al.  Does student engagement in self-assessment calibrate their judgement over time? , 2013 .

[16]  Martin Davies Groupwork as a form of assessment: common problems and recommended solutions , 2009 .

[17]  Winnie Cheng,et al.  Making a Difference: Using peers to assess individual students' contributions to a group project , 2000 .

[18]  Christian D. Schunn,et al.  Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives , 2006 .

[19]  Lino Montoro Moreno,et al.  Student perceptions of peer assessment: an interdisciplinary study , 2014 .

[20]  D. Boud,et al.  Quantitative studies of student self-assessment in higher education: a critical analysis of findings , 1989 .

[21]  E. Lindsay,et al.  Graduate outlook 2014: employers' perspectives on graduate recruitment in Australia , 2015 .

[22]  D. Sexton,et al.  Evaluation of marking of peer marking in oral presentation , 2016, Perspectives on medical education.

[23]  Avril Thomson,et al.  Rethinking feedback practices in higher education: a peer review perspective , 2014 .

[24]  External peer review of assessment: an effective approach to verifying standards? , 2015 .

[25]  Chin-Chung Tsai,et al.  University Students’ Perceptions of and Attitudes Toward (Online) Peer Assessment , 2006 .

[26]  D. Boud,et al.  Peer Learning and Assessment , 1999 .

[27]  Sung-Seok Ko,et al.  Peer assessment in group projects accounting for assessor reliability by an iterative method , 2014 .

[28]  David Carless,et al.  Making productive use of exemplars: Peer discussion and teacher guidance for positive transfer of strategies , 2016 .

[29]  Catherine Montgomery,et al.  Assessment for Learning in Higher Education , 2012 .

[30]  M. Ohland,et al.  Assessing Teamwork Skills for Assurance of Learning Using CATME Team Tools , 2014 .

[31]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[32]  L. Festinger,et al.  Pressures Toward Uniformity of Performance in Groups , 1957 .

[33]  B. Sridharan,et al.  Students’ perceptions of peer assessment effectiveness: an explorative study , 2018 .

[34]  Frederick J. Gravetter,et al.  Essentials of Statistics for the Behavioral Sciences , 1991 .

[35]  Yao-Ting Sung,et al.  How many heads are better than one? The reliability and validity of teenagers' self- and peer assessments. , 2010, Journal of adolescence.

[36]  Chris Rust,et al.  Know what I mean? Enhancing student understanding of assessment standards and criteria , 2004 .

[37]  Philip Vickerman,et al.  Student perspectives on formative peer assessment: an attempt to deepen learning? , 2009 .

[38]  Martin R. Fellenz Toward Fairness in Assessing Student Groupwork: A Protocol for Peer Evaluation of Individual Contributions , 2006 .

[39]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[40]  Mark Lejk,et al.  The Effect of the Inclusion of Selfassessment with Peer Assessment of Contributions to a Group Project: A quantitative study of secret and agreed assessments , 2001 .

[41]  David Boud,et al.  THE ROLE OF SELF‐ASSESSMENT IN STUDENT GRADING , 1989 .