Integrating Enhanced Peer Assessment Features in Moodle Learning Management System

Peer assessment has increasingly proven its benefits for the learning process and several educational platforms have been proposed to support it. Rather than developing yet another standalone tool, in this paper we aim to integrate an existing Bayesian Network-based peer evaluation approach in a widely used learning management system, Moodle. This allows to capitalize both on the successful peer assessment model and on the broad range of educational functionalities provided by the learning management system. More specifically, we start from Moodle Workshop plugin, which supports the management of peer assessment sessions, and extend it with several features: i) support for student modeling based on Bayesian Network approach; ii) various metrics regarding the reliability of the computed models; iii) enhanced visualizations and comparisons of learner models and session results. The paper describes the solution proposed for extending the plugin in terms of mechanisms, pedagogical rationale, implementation and functionalities.

[1]  Jim E. Greer,et al.  Interacting with Inspectable Bayesian Student Models , 2004, Int. J. Artif. Intell. Educ..

[2]  Jo McKenzie,et al.  SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects , 2002, Br. J. Educ. Technol..

[3]  Maria De Marsico,et al.  Supporting Mediated Peer-Evaluation to Grade Answers to Open-Ended Questions , 2017 .

[4]  Luca de Alfaro,et al.  CrowdGrader: a tool for crowdsourcing the evaluation of homework assignments , 2014, SIGCSE.

[5]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[6]  Joe Gibbs Politz,et al.  CaptainTeach: multi-stage, in-flow peer review for programming assignments , 2014, ITiCSE '14.

[7]  Yang Song,et al.  Data Sharing in Peer-Assessment Systems for Education. , 2017 .

[8]  Elvira Popescu,et al.  A Service-Oriented Architecture for Student Modeling in Peer Assessment Environments , 2018, SETE@ICWL.

[9]  Kevin Leyton-Brown,et al.  Mechanical TA: Partially Automated High-Stakes Peer Grading , 2015, SIGCSE.

[10]  Michael S. Bernstein,et al.  Scaling short-answer grading by combining peer assessment with algorithmic scoring , 2014, L@S.

[11]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[12]  Konstantina Chrysafiadi,et al.  Student modeling approaches: A literature review for the last decade , 2013, Expert Syst. Appl..

[13]  Loren Olson,et al.  CritViz: Web-Based Software Supporting Peer Critique in Large Creative Classrooms , 2013 .