On business processes of computer-supported collaborative learning: a case of peer assessment system development

Nowadays peer assessment is recognized as a crucial part of a wide range of active learning routines. Nevertheless, practitioners and educators speak of the complexity and high resource consumption for the implementation of this type of assessment. Undoubtedly, convenient software that supports peer assessment processes may substantially raise productivity of its participants. A review of educational literature and free software shows there are several bottlenecks in the business processes of peer assessment and key user roles. First, most of the programs examined are web-based and expand a set of tools for teachers and learners by extra interfaces. Moreover, this logically creates a new branch in the learning business process. Second, there is probably no peer assessment system which allows users to attach something other than the text to be reviewed. There is a gap in the market of free peer assessment software. This paper offers a peer assessment system specification that attempts to eliminate these disadvantages in order to improve user experience and thus increase the use of information technologies in peer assessment. The specification is based on a thorough description of the peer assessment process involving complex artifacts and double-blinded peer review. Software called PASCA (peer assessment system for complex artifacts) is introduced to illustrate the specification achieved. PASCA uses habitual e-mail services and does not affect other business processes. It supports standard features like blinding and randomization, and it provides a set of original features. They contain evaluation of arbitrary artifacts, creation of complex peer review forms with their validation and scoring, and easy analysis of data from peer assessment sessions.

[1]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[2]  Jouni Ikonen,et al.  MyPeerReview: an online peer-reviewing system for programming courses , 2010, Koli Calling.

[3]  Phil Davies,et al.  Peer assessment: judging the quality of students’ work by comments rather than marks , 2006 .

[4]  Shirley Clarke Active Learning Through Formative Assessment , 2008 .

[5]  Duncan David Nulty,et al.  Peer and self‐assessment in the first year of university , 2011 .

[6]  Eric Zhi-Feng Liu,et al.  Web-based peer assessment: feedback for students with various thinking-styles , 2001, J. Comput. Assist. Learn..

[7]  Justin Cheng,et al.  Peer and self assessment in massive online classes , 2013, ACM Trans. Comput. Hum. Interact..

[8]  Jo McKenzie,et al.  SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects , 2002, Br. J. Educ. Technol..

[9]  Dominique Sluijsmans,et al.  Effective peer assessment processes , 2010 .

[10]  John C. Klensin,et al.  Simple Mail Transfer Protocol , 2001, RFC.

[11]  Magdeleine D. N. Lew,et al.  Accuracy of students' self‐assessment and their beliefs about its utility , 2010 .

[12]  D. Sluijsmans,et al.  The use of self-, peer and co-assessment in higher education: A review , 1999 .

[13]  H. Tillema Student Involvement in Assessment of their Learning , 2014 .

[14]  R. Anson,et al.  A Peer Assessment System to Improve Student Team Experiences , 2014 .

[15]  Christopher D. Hundhausen,et al.  The design of an online environment to support pedagogical code reviews , 2010, SIGCSE.

[16]  Ville Tirronen,et al.  Teaching programming by emphasizing self-direction: How did students react to the active role required of them? , 2013, TOCE.

[17]  Fiona Spence,et al.  Peer assessment using aropä , 2007 .

[18]  K. Topping Peer Assessment Between Students in Colleges and Universities , 1998 .

[19]  Hao Jiang,et al.  Distributed collaborative homework activities in a problem-based usability engineering course , 2014, Education and Information Technologies.

[20]  Nicola Wilkinson,et al.  A case study of the development of WebPA: An online peer-moderated marking tool , 2009, Br. J. Educ. Technol..

[21]  Frank Fischer,et al.  Commentary: Peer assessment as collaborative learning: A cognitive perspective , 2010 .