A Gamified Approach to Automated Assessment of Programming Assignments

Tools delivering assessment, and feedback, for students’ programming assignments are important in computer science education. Approaches range from the static analysis of program correctness, to testing-based evaluation, through the application in frameworks of competitive programming. In this paper we describe a testing-based approach, provided in a gamified web-based environment. Students provide their solutions to assignments; such solutions are tested and graded, and their quality contributes to the contents of the student’s profile, where experience points, medals on assignments, assignment categories badges, and overall status allow students to monitor their achievements and have engagement and motivation increasing. Being at this time not possible a formal experimentation of the system, we provide an analysis of its actual capability of tracing students behavior and progresses.

[1]  José Paulo Leal,et al.  Mooshak: a Web‐based multi‐site programming contest system , 2003, Softw. Pract. Exp..

[2]  Peter Brusilovsky,et al.  Individualized exercises for self-assessment of programming knowledge: An evaluation of QuizPACK , 2005, JERC.

[3]  Stephen H. Edwards,et al.  Web-CAT: automatically grading programming assignments , 2008, SIGCSE 2008.

[4]  Frederick W. B. Li,et al.  BlueFix: Using Crowd-Sourced Feedback to Support Programming Students in Error Diagnosis and Repair , 2012, ICWL.

[5]  Rebecca T. Mercuri,et al.  Identifying and correcting Java programming errors for introductory computer science students , 2003, SIGCSE.

[6]  Jéan H. Greyling,et al.  Marking student programs using graph similarity , 2010, Comput. Educ..

[7]  Ellen Francine Barbosa,et al.  ProgTest: An environment for the submission and evaluation of programming assignments based on testing activities , 2011, 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T).

[8]  Stephen H. Edwards,et al.  Improving student performance by evaluating how well students test their own programs , 2003, JERC.

[9]  Vreda Pieterse,et al.  Automated Assessment of Programming Assignments , 2013, CSERC.

[10]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[11]  Xiaohong Su,et al.  Ability-training-oriented automated assessment in introductory programming course , 2011, Comput. Educ..

[12]  Jack Hollingsworth,et al.  Automatic graders for programming classes , 1960, Commun. ACM.

[13]  Nathan Griffiths,et al.  The boss online submission and assessment system , 2005, JERC.

[14]  Connie Malamed,et al.  Book Review: 'The Gamification of Learning and Instruction: Game-Based Methods and Strategies For Training And Education' by Karl Kapp , 2012, ELERN.

[15]  Viggo Kann,et al.  Five years with kattis — Using an automated assessment system in teaching , 2011, 2011 Frontiers in Education Conference (FIE).

[16]  Karl M. Kapp,et al.  A Gamified Approach on Learning Logic Gates to Improve Student’s Engagement , 2012, IOP Conference Series: Materials Science and Engineering.

[17]  Valentina Dagiene Sustaining Informatics Education by Contests , 2010, ISSEP.

[18]  Sébastien Combéfis,et al.  Programming Trainings and Informatics Teaching Through Online Contests , 2014 .