An Easy-to-read Visual Approach to Deal with Peer Reviews and Self-assessments in Virtual Learning Environments

In teaching-learning process, the grade computation is an important part of the critical-thinking process. When faced to assessments of many students, teachers are confronted to a mass of smart data. Lately, the strategies of peer evaluations, in which the students express a critic on different understanding of the taught contents, have been substantially developed in the literature. This paper presents an easy-to-read visual approach integrated with a learning platform to analyze correlations and distances between the grades given by a teacher and the grades produced by students through self-assessments and peer reviews. We observed that the both aforementioned metrics can rank differently the students; hence we propose to aggregate them by producing a single rank. Thus, our framework supports the lecturer either by selecting possible candidates for future class monitors or by focusing on students who need to be more involved in the teaching-learning process. Finally, for the highest ranks, our framework offers a regression model to predict the teachers' grades values only based on the students feedbacks.

[1]  Ying Liu,et al.  Toward Motivating Participants to Assess Peers’ Work More Fairly , 2015 .

[2]  David Boud,et al.  Enhancing learning through self assessment , 1995 .

[3]  Joe Ferrell Use of Computer Speech Technologies To Enhance Learning , 1999 .

[5]  Roger C. Schank,et al.  Virtual Learning: A Revolutionary Approach to Building a Highly Skilled Workforce , 1997 .

[6]  L. Stefani Peer, self and tutor assessment: Relative reliabilities , 1994 .

[7]  D. Boud,et al.  Student Self-Assessment in Higher Education: A Meta-Analysis , 1989 .

[8]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[9]  Whakapakari Ako Assessment Matters: Self-Assessment & Peer Assessment , 2014 .

[10]  Mike Joy,et al.  Effective peer assessment for learning computer programming , 2004, ITiCSE '04.

[11]  Bartholomäus Wissmath,et al.  Efficient learning using a virtual learning environment in a university class , 2011, Comput. Educ..

[12]  Sergio Luján-Mora,et al.  Big Data, the Next Step in the Evolution of Educational Data Analysis , 2018, ICITS.

[13]  Beth Simon,et al.  Quality of student contributed questions using PeerWise , 2009, ACE '09.

[14]  D. Carless,et al.  Developing sustainable feedback practices , 2011 .

[15]  Andrew Luxton-Reilly,et al.  A systematic review of tools that support peer assessment , 2009, Comput. Sci. Educ..

[16]  Mike Joy,et al.  Computer support of effective peer assessment in an undergraduate programming class , 2007, J. Comput. Assist. Learn..

[17]  J. H. McMillan,et al.  Student Self-Assessment: The Key to Stronger Student Motivation and Higher Achievement. , 2008 .

[18]  M. Tousignant,et al.  Accuracy of Student Self-Assessment Ability Compared to Their Own Performance in a Problem-Based Learning Medical Program: A Correlation Study , 2002, Advances in health sciences education : theory and practice.

[19]  David E. Pritchard,et al.  Studying Learning in the Worldwide Classroom Research into edX's First MOOC. , 2013 .

[20]  R. Robinson Calibrated Peer Review™ , 2009 .

[22]  Chin-Chung Tsai,et al.  On-line peer assessment and the role of the peer feedback: A study of high school computer course , 2007, Comput. Educ..

[23]  Christian D. Schunn,et al.  Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system , 2007, Comput. Educ..

[24]  Françoise Profit,et al.  L’évaluation des élèves , 2003 .

[25]  John Shepherd,et al.  Engineering the “ Peers ” system : the development of a computer-assisted approach to peer assessment , 2007 .

[26]  Avril Thomson,et al.  Rethinking feedback practices in higher education: a peer review perspective , 2014 .

[27]  Steve Joordens,et al.  Peering into large lectures: examining peer and expert mark agreement using peerScholar, an online peer assessment tool , 2008, J. Comput. Assist. Learn..

[28]  Toshiharu Sugawara,et al.  Fair assessment of group work by mutual evaluation based on trust network , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[29]  Phil Davies,et al.  Computerized Peer Assessment , 2000 .