Automated testing of case studies in programming courses

The majority of Learning management systems (LMS) provide the functionality only for evaluation of built-in tests activities without any support for evaluation of case studies, which are frequently used in programming courses. These have to be checked manually by an instructor, what is time consuming especially in case if courses are attended with a high number of students. In this paper we propose an automated submission process decomposed in several phases. We provide a detailed description of particular phases with selected tools as jPlag and PMD. The aim of our work is to combine existing tools into one coherent system connected with LMS (Moodle) and IDEs and not to go a way of implementing a new standalone validation and assignment system. We present also some partial results and experiences using jPlag and PMD tools on our courses — Programming, Object oriented programming and Technologies Java.

[1]  Kirsti Ala-Mutka,et al.  A study of the difficulties of novice programmers , 2005, ITiCSE '05.

[2]  Stephen H. Edwards,et al.  Using software testing to move students from trial-and-error to reflection-in-action , 2004, SIGCSE '04.

[3]  David Hovemeyer,et al.  Experiences with marmoset: designing and using an advanced submission and testing system for programming courses , 2006, ITICSE '06.

[4]  Ellen Francine Barbosa,et al.  ProgTest: An environment for the submission and evaluation of programming assignments based on testing activities , 2011, 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T).

[5]  Shahida Sulaiman,et al.  Automatic programming assessment and test data generation a review on its approaches , 2010, 2010 International Symposium on Information Technology.

[6]  Zuohua Ding,et al.  Unit Testing: Static Analysis and Dynamic Analysis , 2009, 2009 Fourth International Conference on Computer Sciences and Convergence Information Technology.

[7]  Lutz Prechelt,et al.  JPlag: Finding plagiarisms among a set of programs , 2000 .

[8]  Kamlesh Dutta,et al.  A comparative study of moodle with other e-learning systems , 2011, 2011 3rd International Conference on Electronics Computer Technology.