TesCaV: An Approach for Learning Model-Based Testing and Coverage in Practice

Academy and industry permanently remark the importance of software-testing techniques to improve software quality and to reduce development and maintenance costs. A testing method to be considered for this purpose is Model-Based Testing (MBT), which generates test cases from a model that represents the structure and the behavior of the system to be developed. The generated test suite is easier to maintain and adapt to changes in requirements or evolution of the developed system. However, teaching and learning MBT techniques are not easy tasks; students need to know the different testing techniques to assure that the requirements are fulfilled as well as to identify any failure in the software system modeled. In this work, we present TesCaV, an MBT teaching tool for university students, which is based on a model-driven technology for the automatic software generation from UML diagrams. TesCaV allows validating the test cases defined by students and graphically determines the level of testing coverage over the system modeled. Preliminary results show TesCaV as a promising approach for MBT teaching/learning processes.

[1]  Christelle Scharff,et al.  Teaching software quality assurance by encouraging student contributions to an open source web-based system for the assessment of programming assignments , 2008, SIGCSE 2008.

[2]  Peter J. Clarke,et al.  Gamification-Based Cyber-Enabled Learning Environment of Software Testing , 2016 .

[3]  Ashish Sureka,et al.  A Case Study on the Application of Case-Based Learning in Software Testing , 2018, ISEC.

[4]  Arto Vihavainen,et al.  Learning agile software engineering practices using coding dojo , 2013, SIGITE Conference.

[5]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2012, Springer Berlin Heidelberg.

[6]  Heitor Augustus Xavier Costa,et al.  TestEG — A computational game for teaching of software testing , 2016, 2016 35th International Conference of the Chilean Computer Science Society (SCCC).

[7]  Wolfgang Schnotz,et al.  The Cambridge Handbook of Multimedia Learning: An Integrated Model of Text and Picture Comprehension , 2005 .

[8]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[9]  Christian Wolff,et al.  An experimental card game for software testing: Development, design and evaluation of a physical card game to deepen the knowledge of students in academic software testing education , 2016, 2016 IEEE Global Engineering Education Conference (EDUCON).

[10]  Ina Schieferdecker,et al.  Model-Driven Testing: Using the UML Testing Profile , 2007 .

[11]  A. Hede An integrated model of multimedia effects on learning. , 2002 .

[12]  Monique Snoeck,et al.  Enterprise Information Systems Engineering , 2014, The Enterprise Engineering Series.

[13]  Rebecca Smith,et al.  An Automated System for Interactively Learning Software Testing , 2017, ITiCSE.

[14]  W. Eric Wong,et al.  Improving the State of Undergraduate Software Testing Education , 2012 .

[15]  Kraig Finstad,et al.  The Usability Metric for User Experience , 2010, Interact. Comput..

[16]  Tariq M. King,et al.  Using WReSTT in SE courses: an empirical study , 2012, SIGCSE '12.

[17]  Sebastian G. Elbaum,et al.  Bug Hunt: Making Early Software Testing Lessons Engaging and Affordable , 2007, 29th International Conference on Software Engineering (ICSE'07).

[18]  Beatriz Marín,et al.  Learning Conceptual Modeling Design Through the Classutopia Serious Game , 2018, Int. J. Softw. Eng. Knowl. Eng..

[19]  Monique Snoeck,et al.  CaMeLOT: An educational framework for conceptual data modelling , 2019, Inf. Softw. Technol..

[20]  Stephen H. Edwards,et al.  Responses to adaptive feedback for software testing , 2014, ITiCSE '14.

[21]  E. L. Jones An experiential approach to incorporating software testing into the computer science curriculum , 2001, 31st Annual Frontiers in Education Conference. Impact on Engineering and Science Education. Conference Proceedings (Cat. No.01CH37193).

[22]  Alexandra Martínez,et al.  Use of JiTT in a Graduate Software Testing Course: An Experience Report , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[23]  Beatriz Marín,et al.  Testing of model-driven development applications , 2017, Software Quality Journal.

[24]  Tariq M. King,et al.  Integrating Testing into Software Engineering Courses Supported by a Collaborative Learning Environment , 2014, TOCE.

[25]  Gordon Fraser,et al.  Teaching Software Testing with a Mutation Testing Game , 2016, PPIG.

[26]  Arie van Deursen,et al.  Pragmatic Software Testing Education , 2019, SIGCSE.

[27]  Stephen H. Edwards,et al.  A formative study of influences on student testing behaviors , 2014, SIGCSE.

[28]  Mladen A. Vouk,et al.  Teaching software testing: Experiences, lessons learned and the path forward , 2011, CSEE&T.

[29]  Gordon Fraser,et al.  Code Defenders: A Mutation Testing Game , 2016, 2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[30]  Stephen H. Edwards,et al.  Experiences using test-driven development with an automated grader , 2007 .

[31]  Oscar Pastor,et al.  Verifying goal-oriented specifications used in model-driven development processes , 2017, Inf. Syst..

[32]  Ellen Francine Barbosa,et al.  Educational games: A contribution to software testing education , 2017, 2017 IEEE Frontiers in Education Conference (FIE).

[33]  Oscar Pastor,et al.  Model-driven architecture in practice - a software production environment based on conceptual modeling , 2007 .

[34]  Mark Guzdial,et al.  Introducing testing practices into objects and design course , 2003, Proceedings 16th Conference on Software Engineering Education and Training, 2003. (CSEE&T 2003)..

[35]  Bran Selic,et al.  The Pragmatics of Model-Driven Development , 2003, IEEE Softw..

[36]  Beatriz Marín,et al.  Visualization of MBT testing coverage , 2019, 2019 13th International Conference on Research Challenges in Information Science (RCIS).

[37]  Rossana M. de Castro Andrade,et al.  GreaTest: a card game to motivate the software testing learning , 2018, SBES.