Online self and peer assessment in large, multi-campus, multi-cohort contexts

The increasing use of team assignments within higher education is well documented. The driving forces behind this include desires to facilitate reflective and collaborative learning, to develop generic teamwork skills for graduate employment and to reduce the grading workloads of faculty staff. Students however consistently report dissatisfaction when the assessment of team assignments produces a common grade for all team members. Self-andpeer-assessment (SAPA) is presented as a fair, valid and reliable method of producing information about ongoing team processes. This information can provide ongoing feedback to team members and rich formative data to instructors attempting to assess the team process and students’ teamwork skills. This data can also enable individualised summative assessment in dysfunctional teams or situations of uneven team member contributions. Whilst manual SAPA protocols can work effectively for smaller classes, computer-assisted SAPA offers a solution to the problems of large classes. This paper reports on the early stages of an online SAPA tool, originally developed for small classes of architecture students, adapted for use by very large business communication classes comprising up to 1000 students in a semester. This large unit is delivered on four Australian campuses as well as off-campus and in off-shore mode, by up to fourteen instructors at any one time. The paper documents how three researchers from very different backgrounds worked to create their own research team, implement a pilot study, and adapt the online tool, whilst adhering to comparability of assessment constraints and maintaining integrity of research design.

[1]  Nancy Falchikov,et al.  PRODUCT COMPARISONS AND PROCESS BENEFITS OF COLLABORATIVE PEER GROUP AND SELF ASSESSMENTS , 1986 .

[2]  W. Cheng,et al.  Having second thoughts: Student perceptions before and after a peer assessment exercise , 1997 .

[3]  Chris Sykes,et al.  Iterative learning: Self and peer assessment of group work , 2006 .

[4]  Richard Tucker,et al.  Teaching and Learning in Collaborative Group Design Projects , 2006 .

[5]  Saskia Brand-Gruwel,et al.  Peer Assessment Training in Teacher Education: Effects on performance and perceptions , 2002 .

[6]  Eric Zhi-Feng Liu,et al.  Web-based peer assessment: feedback for students with various thinking-styles , 2001, J. Comput. Assist. Learn..

[7]  J. McGourty,et al.  Incorporating student peer review and feedback into the assessment process , 1998, FIE '98. 28th Annual Frontiers in Education Conference. Moving from 'Teacher-Centered' to 'Learner-Centered' Education. Conference Proceedings (Cat. No.98CH36214).

[8]  Mark Lejk,et al.  Peer Assessment of Contributions to a Group Project: Student attitudes to holistic and category-based approaches , 2002 .

[9]  D. Boud,et al.  Student Self-Assessment in Higher Education: A Meta-Analysis , 1989 .

[10]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[11]  Yaqub Rafiq,et al.  Peer Assessment of Group Projects in Civil Engineering , 1996 .

[12]  A. Sivan.  The Implementation of Peer Assessment: An action research approach , 2000 .

[13]  Mike Joy,et al.  Web-based peer assessment in learning computer programming , 2003, Proceedings 3rd IEEE International Conference on Advanced Technologies.

[14]  Stephen J. Sharp.  Deriving individual student marks from a tutor’s assessment of group work , 2006 .

[15]  Ann Walker,et al.  British Psychology Students' Perceptions of Group-Work and Peer Assessment , 2001 .

[16]  Richard Tucker.  The impact of assessment modes on collaborative group design projects , 2007 .

[17]  Larry K. Michaelsen,et al.  Team Learning: A Comprehensive Approach for Harnessing the Power of Small Groups in Higher Education , 1992 .

[18]  Timothy J. Ellis,et al.  Peer Evaluations of Collaborative Learning Experiences Conveyed Through an Asynchronous Learning Network , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[19]  Jo McKenzie,et al.  SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects , 2002, Br. J. Educ. Technol..

[20]  K. Topping.  Peer Assessment Between Students in Colleges and Universities , 1998 .

[21]  W. Burnett,et al.  Peer Assessment by Fifth Year Students of Surgery. , 1980 .

[22]  Hugh Somervell,et al.  Issues in Assessment, Enterprise and Higher Education: the case for self‐peer and collaborative assessment , 1993 .

[23]  R. W. Brown.  Autorating: getting individual marks from team marks and enhancing teamwork , 1995, Proceedings Frontiers in Education 1995 25th Annual Conference. Engineering Education for the 21st Century.

[24]  Marcia Devlin,et al.  Assessing learning in Australian universities , 2002 .

[25]  Aliisa Mylonas,et al.  Developing Procedures for Implementing Peer Assessment in Large Classes Using an Action Research Process , 2002 .

[26]  G. Dunnington,et al.  Peer and self assessment during problem-based tutorials. , 1999, American journal of surgery.

[27]  Jan Fermelis,et al.  Making teamwork work , 2006 .

[28]  Andrew Litchfield,et al.  Supporting peer assessment of individual contributions in groupwork , 2007 .

[29]  Dominique Sluijsmans,et al.  Creating a Learning Environment by Using Self-, Peer- and Co-Assessment , 1998 .

[30]  Phil Davies,et al.  Computerized Peer Assessment , 2000 .