2TSW: Automated Assessment of Computer Programming Assignments, in a Gamified Web Based System

Automated assessment and feedback of computer programming tasks can be a significant asset in computer science education. Web based systems providing such capabilities are designed to apply techniques ranging from static analysis of program correctness, to testing-based evaluation, and often can have application in frameworks supporting competitive programming. Here we report on the 2TSW system, which uses the testing-based approach in a gamified web-based environment. In 2TSWa learner can access a list of assignments, submit solutions and have such solutions tested and graded. The quality of the solutions contributes to the contents of the student's profile, showing experience points, medals gained for assignments, assignment categories badges, and an appropriate overall status badge. The personal profile allows the student to monitor her/his proceedings. The gamified structure of the system, together with the provision of real-time automated assessment, offers the opportunity for an increasing level of students' personal engagement and motivation. We describe the system, and provide the reader with the results of a field experimentation, conducted in a first-year computer programming course, bachelor in Computer Engineering. The data analysis of a questionnaire allows to conclude that the system was very welcome, and that the students appreciated the general gamified experience and the usefulness of the system. The data also allow to conclude that the students' engagement was high and that the learners appear to be open to the possibility of using again 2TSW and any other web-based system supporting assessment of complex tasks, also on subject matters different than Computer Programming.

[1]  Stephen H. Edwards,et al.  Web-CAT: automatically grading programming assignments , 2008, ITiCSE.

[2]  Rebecca T. Mercuri,et al.  Identifying and correcting Java programming errors for introductory computer science students , 2003, SIGCSE.

[3]  Ellen Francine Barbosa,et al.  ProgTest: An environment for the submission and evaluation of programming assignments based on testing activities , 2011, 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T).

[4]  Stephen H. Edwards,et al.  Improving student performance by evaluating how well students test their own programs , 2003, JERC.

[5]  Jéan H. Greyling,et al.  Marking student programs using graph similarity , 2010, Comput. Educ..

[6]  John W. Rice,et al.  The Gamification of Learning and Instruction: Game-Based Methods and Strategies for Training and Education , 2012, Int. J. Gaming Comput. Mediat. Simulations.

[7]  Vreda Pieterse,et al.  Automated Assessment of Programming Assignments , 2013, CSERC.

[8]  Surendra Gupta Automatic Assessment of Programming assignment , 2012, ICIT 2012.

[9]  Jack Hollingsworth,et al.  Automatic graders for programming classes , 1960, Commun. ACM.

[10]  Frederick W. B. Li,et al.  BlueFix: Using Crowd-Sourced Feedback to Support Programming Students in Error Diagnosis and Repair , 2012, ICWL.

[11]  Sébastien Combéfis,et al.  Programming Trainings and Informatics Teaching Through Online Contests , 2014 .

[12]  Ginés García-Mateos,et al.  Make Learning Fun with Programming Contests , 2009, Trans. Edutainment.

[13]  Valentina Dagiene Sustaining Informatics Education by Contests , 2010, ISSEP.

[14]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[15]  Nathan Griffiths,et al.  The boss online submission and assessment system , 2005, JERC.

[16]  Kirsti Ala-Mutka,et al.  A Survey of Automated Assessment Approaches for Programming Assignments , 2005, Comput. Sci. Educ..

[17]  Viggo Kann,et al.  Five years with kattis — Using an automated assessment system in teaching , 2011, 2011 Frontiers in Education Conference (FIE).

[18]  Peter Brusilovsky,et al.  Individualized exercises for self-assessment of programming knowledge: An evaluation of QuizPACK , 2005, JERC.

[19]  Xiaohong Su,et al.  Ability-training-oriented automated assessment in introductory programming course , 2011, Comput. Educ..

[20]  José Paulo Leal,et al.  Mooshak: a Web‐based multi‐site programming contest system , 2003, Softw. Pract. Exp..