Badges for Peer Assessment of Teamwork in Organized Education

Team projects and group work have proven to be useful and rewarding educational activities that help students develop important abilities and skills. On the other hand, they have also proven to be difficult to grade in a balanced way which would be perceived as fair by the students. Numerical ratings such as those delivered by the Fink method provide ways to determine the shares of contributions of each individual team member. But such bare numerical evaluation needs also some secondary justification that helps team members to understand why their rating is high or low. Methods to collect such additional feedback often rely on surveys; however, extensive surveys may be perceived as tedious by the students, especially as they need to be filled out for each other team member participating in the team. This may have negative effect on the quality of feedback collected in form of surveys. We present a novel approach to peer assessment of a team-based project exploiting badges that represent individual contributions to the task and teamwork related traits. We show that this approach has positive influence on engagement in peer assessment compared to free-text open questions. We also study if the feedback obtained in this way is informative and to which extent it can serve as replacement for open free-text questions.

[1]  B. Hindle The ‘project’: putting student‐controlled, small‐group work and transferable skills at the core of a geography course , 1993 .

[2]  Guides to Reducing Social Loafing in Group Projects: Faculty Development , 2016 .

[3]  Donna L. Roberts,et al.  Faculty and Student Issues with Group Work: What is Problematic with College Group Assignments and Why? , 2016 .

[4]  Kim A. Stewart,et al.  Lessons from the Best and Worst Student Team Experiences: How a Teacher can make the Difference , 1999 .

[5]  L. Dee Fink,et al.  Team-Based Learning: A Transformative Use of Small Groups in College Teaching , 2002 .

[6]  Juho Hamari,et al.  Transforming homo economicus into homo ludens: A field experiment on gamification in a utilitarian peer-to-peer trading service , 2013, Electron. Commer. Res. Appl..

[7]  A. Cook,et al.  Using peer review to distribute group work marks equitably between medical students , 2017, BMC Medical Education.

[8]  Michel Leonard,et al.  Gamification-based assessment of group work , 2013, 2013 International Conference on Interactive Collaborative Learning (ICL).

[9]  Carol Bormann Young,et al.  Viewpoint: A Conceptual Framework for Designing Group Projects , 2000 .

[10]  P. Daunis-i-Estadella,et al.  Using peer assessment to evaluate teamwork from a multidisciplinary perspective , 2018 .

[11]  Martin Homola,et al.  Team workflow and peer review in a virtual learning environment , 2017, 2017 16th International Conference on Information Technology Based Higher Education and Training (ITHET).

[12]  Kimberly Wu,et al.  Pharmacy Students’ Perceptions of and Attitudes Towards Peer Assessment Within a Drug Literature Evaluation Course , 2012, American Journal of Pharmaceutical Education.

[13]  Charles M. Brooks,et al.  Free Riding in Group Projects and the Effects of Timing, Frequency, and Specificity of Criteria in Peer Assessments , 2003 .

[14]  Kim Flintoff,et al.  Digital badges in education , 2013, Education and Information Technologies.

[15]  I hate/don’t hate/still hate group projects! A tripartite ethical framework for enhancing student collaboration , 2017 .

[16]  Martin Homola,et al.  A Badge for Reducing Open Answers in Peer Assessment , 2018, ICWL.

[17]  Mark Lejk,et al.  Peer Assessment of Contributions to a Group Project: A comparison of holistic and category-based approaches , 2001 .

[18]  David Kember,et al.  Peer Assessment of an Individual ‘s Contribution to a Group Project , 1993 .

[19]  Haijun Kang,et al.  Challenges facing group work online , 2016 .

[20]  T. Gatfield Examining Student Satisfaction with Group Projects and Peer Assessment , 1999 .

[21]  David Boud,et al.  Does the use of summative peer assessment in collaborative group work inhibit good judgement? , 2018, Higher Education.

[22]  J. A. Mello Improving Individual Member Accountability in Small Work Group Settings , 1993 .

[23]  Andrew Litchfield,et al.  Peer assessment in large group projects: forming professional attitudes in IT students , 2012 .

[24]  Susan J. Deeley Summative co-assessment: A deep learning approach to enhancing employability skills and attributes , 2014 .

[25]  Robert Ekblaw Effective Use of Group Projects in Online Learning , 2016 .

[26]  Mark Lejk,et al.  Peer Assessment of Contributions to a Group Project: Student attitudes to holistic and category-based approaches , 2002 .

[27]  Peter L. Kench,et al.  Peer assessment of individual contributions to a group project: Student perceptions , 2009 .

[28]  Matthew W. Ohland,et al.  Effects of Behavioral Anchors on Peer Evaluation Reliability , 2005 .

[29]  Martin Homola,et al.  Peer Reviews in a Web Design Course: Now Students like Them Too , 2016, SETE@ICWL.

[30]  S. Simoens,et al.  Peer assessment: A valuable tool to differentiate between student contributions to group work? , 2006 .

[32]  J. George Extrinsic and Intrinsic Origins of Perceived Social Loafing in Organizations , 1992 .

[33]  Razvan Rughinis,et al.  Digital Badges: Signposts and Claims of Achievement , 2013, HCI.

[34]  Rowan H. Brookes,et al.  Student perceptions of teamwork within assessment tasks in undergraduate science degrees , 2018 .

[35]  Ig Ibert Bittencourt,et al.  A gamified peer assessment model for on-line learning environments in a competitive context , 2016, Computers in Human Behavior.

[36]  Paul Orsmond *,et al.  Implementation of a formative assessment model incorporating peer and self‐assessment , 2004 .

[37]  Larissa K. Barber,et al.  Promoting Perceived Benefits of Group Projects , 2015 .

[38]  Elvira Popescu,et al.  Peer assessment augmented with digital badges: A first experience report , 2017, 2017 16th International Conference on Information Technology Based Higher Education and Training (ITHET).

[39]  Adrienne Stolfi,et al.  The Impact of Team-Based Learning on Medical Students' Academic Performance , 2010, Academic medicine : journal of the Association of American Medical Colleges.