Evaluating the Synergies of Integrating E-Assessment and Software Testing

Teaching and learning rely on assessments. They help to measure performance and to keep track of learning success. Manual assessments are very time-consuming for teaching personnel. Therefore, e-learning and in particular e-assessment systems are introduced by higher education institutions to reduce recurrent work. Currently, available systems offer assessment with simple examinations only and do not support tasks that require higher-order cognitive skills (Heywood 2000) to be solved.

[1]  Nikolaj Bjørner,et al.  Z3: An Efficient SMT Solver , 2008, TACAS.

[2]  Herbert Kuchen,et al.  Muggl: The Muenster generator of glass-box test cases , 2011 .

[3]  Herbert Kuchen,et al.  Systematic generation of glass-box test cases for functional logic programs , 2007, PPDP '07.

[4]  Andreas Zeller,et al.  Web-basierte Programmierpraktika mit Praktomat , 2002, Softwaretechnik-Trends.

[5]  Karsten Weicker,et al.  Didaktische Anmerkungen zur Unterstützung der Programmierlehre durch E-Learning , 2005, DeLFI.

[6]  Frank Yellin,et al.  The Java Virtual Machine Specification , 1996 .

[7]  Susanne Johanna Gruttmann,et al.  Formatives E-Assessment in der Hochschullehre - computerunterstützte Lernfortschrittskontrollen im Informatikstudium , 2009 .

[8]  Herbert Kuchen,et al.  E-assessment of Mathematical Proofs: Chances and Challenges for Students and Tutors , 2008, 2008 International Conference on Computer Science and Software Engineering.

[9]  Michael T. Goodrich,et al.  PILOT: an interactive tool for learning and grading , 2000, SIGCSE '00.

[10]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[11]  Paul Roe,et al.  Static Analysis of Students' Java Programs , 2004, ACE.

[12]  Petri Ihantola.  Creating and Visualizing Test Data from Programming Exercises , 2007, Informatics Educ..

[13]  Herbert Kuchen,et al.  Automated Test Case Generation Based on Coverage Analysis , 2009, 2009 Third IEEE International Symposium on Theoretical Aspects of Software Engineering.

[14]  Stephen H. Edwards.  Rethinking computer science education from a test-first perspective , 2003, OOPSLA '03.

[15]  Mauro Pezzè,et al.  Software testing and analysis - process, principles and techniques , 2007 .

[16]  Dave Astels,et al.  Test Driven Development: A Practical Guide , 2003 .

[17]  C. A. R. Hoare,et al.  An axiomatic basis for computer programming , 1969, CACM.

[18]  Tim A. Majchrzak.  Improving the Technical Aspects of Software Testing in Enterprises , 2010, ArXiv.

[19]  Michael H. Goldwasser.  A gimmick to integrate software testing throughout the curriculum , 2002, SIGCSE '02.

[20]  William Pugh,et al.  Helping students appreciate test-driven development (TDD) , 2006, OOPSLA '06.

[21]  Kent L. Beck,et al.  Test-driven Development - by example , 2002, The Addison-Wesley signature series.

[22]  Herbert Kuchen,et al.  Constraint Solving for Generating Glass-Box Test Cases , 2004 .

[23]  Nikolai Tillmann,et al.  Pex-White Box Test Generation for .NET , 2008, TAP.

[24]  Paul Krause.  Software Test Automation: Effective Use of Test Execution Tools, Mark Fewster and Dorothy Graham, Addison-Wesley, 1999 (Book Review) , 2000, Softw. Test. Verification Reliab..

[25]  Amber Settle,et al.  Testing first: emphasizing testing in early programming courses , 2005, ITiCSE '05.

[26]  David Jackson,et al.  Grading student programs using ASSYST , 1997, SIGCSE '97.

[27]  Herbert Kuchen,et al.  Computer-Supported Assessment of Software Verification Proofs - Towards High-Quality E-Assessments in Computer Science Education , 2010 .

[28]  Vic Jenkins,et al.  Getting Started with e-Assessment , 2010 .

[29]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[30]  Herbert Kuchen,et al.  Data-flow testing of declarative programs , 2008, ICFP 2008.

[31]  Lauri Malmi,et al.  Fully automatic assessment of programming exercises , 2001 .

[32]  Petri Ihantola,et al.  Mutation analysis vs. code coverage in automated assessment of students' testing skills , 2010, SPLASH/OOPSLA Companion.

[33]  Ricardo Baeza-Yates,et al.  Computer Science 2 , 1994 .

[34]  John Heywood,et al.  Assessment in Higher Education: Student Learning, Teaching, Programmes and Institutions , 1977 .

[35]  J. Doyle,et al.  IBIS: an Interactive Bytecode Inspection System, using symbolic execution and constraint logic programming , 2003, PPPJ.

[36]  Dorothy Graham,et al.  Software test automation: effective use of test execution tools , 1999 .

[37]  Roland Wismüller,et al.  Online-Übungssystem für die Programmierausbildung zur Einführung in die Informatik , 2008, DeLFI.

[38]  Sebastian G. Elbaum,et al.  Bug Hunt: Making Early Software Testing Lessons Engaging and Affordable , 2007, 29th International Conference on Software Engineering (ICSE'07).