Is It Worth Using Gamification on Software Testing Education?: An Experience Report

Context: Testing is essential to improve the quality of software products. Despite that, it is not a subject that students are motivated to learn. Gamification is a promising way to address issues in software testing education; it is used to insert game elements in educational contexts aiming to increase students' motivation and performance. Objective: Reporting on results of an experimental study designed to assess the impact of gamification on software testing education. Method: We carried out the experimental sessions with undergraduate students from three Brazilian institutions. They have been taught basic testing concepts and functional testing. Moreover, the experimental group used a gamified platform that included 10 game elements to increase students' motivation and performance, attract their attention, and instigate their participation, collaboration, and competitiveness. Results: The experimental group was more motivated than the control group. Regarding performance, the experimental group had an equivalent performance compared to the control group in the pre- and post- tests. However, we observed a trend for the control group to reach a higher performance, as the results from the quiz activities showed significant difference. Conclusion: Although several studies concluded that gamification has the potential to lead to positive outcomes, we reached both positive and negative results. So that, we present our findings and answer whether, in our point of view, it is worth using gamification on software testing education.

[1]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[2]  Renée A. McCauley,et al.  Facilitating Programming Success in Data Science Courses through Gamified Scaffolding and Learn2Mine , 2015, ITiCSE.

[3]  Jana Schumann,et al.  Confounding parameters on program comprehension: a literature survey , 2015, Empirical Software Engineering.

[4]  Fabrício de Sousa Pinto,et al.  Gamification applied for Software Engineering teaching-learning process , 2017, SBES'17.

[5]  Jonathan Bell,et al.  Secret ninja testing with HALO software engineering , 2011, SSE '11.

[6]  K. Werbach,et al.  For the Win: How Game Thinking Can Revolutionize Your Business , 2012 .

[7]  G. Myers,et al.  The Art of Software Testing: Myers/Art , 2012 .

[8]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2000, The Kluwer International Series in Software Engineering.

[9]  Gordon Fraser,et al.  Code Defenders: A Mutation Testing Game , 2016, 2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[10]  Ellen Francine Barbosa,et al.  CS curricula of the most relevant universities in Brazil and abroad: Perspective of software testing education , 2015, 2015 International Symposium on Computers in Education (SIIE).

[11]  Patrícia Augustin Jaques,et al.  Infographics or Graphics+Text: Which Material is Best for Robust Learning? , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[12]  Joanna Smith,et al.  Using peer review to teach software testing , 2012, ICER '12.

[13]  Félix García,et al.  A framework for gamification in software engineering , 2017, J. Syst. Softw..

[14]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[15]  Gordon Fraser,et al.  Teaching Mutation Testing using Gamification , 2016 .

[16]  Fabiane Barreto Vavassori Benitti As a teacher, I want to know what to teach in requirements engineering so that professionals can be better prepared , 2017, SBES'17.

[17]  Peter J. Clarke,et al.  Gamification-Based Cyber-Enabled Learning Environment of Software Testing , 2016 .

[18]  Lais Z. Pedro Uso de gamificação em ambientes virtuais de aprendizagem para reduzir o problema da externalização de comportamentos indesejáveis , 2016 .

[19]  Edward L. Deci,et al.  Levels of Analysis, Regnant Causes of Behavior and Well-Being: The Role of Psychological Needs , 2011 .

[20]  Gordon Fraser,et al.  Teaching Software Testing Concepts Using a Mutation Testing Game , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET).

[21]  Giordano Tamburrelli,et al.  Understanding gamification mechanisms for software development , 2013, ESEC/FSE 2013.

[22]  Pedro Henrique Dias Valle Jogos educacionais: uma contribuição para o ensino de teste de software , 2016 .

[23]  Gail E. Kaiser,et al.  Increasing Student Engagement in Software Engineering with Gamification , 2012 .

[24]  Ellen Francine Barbosa,et al.  Aspectos de Desenvolvimento e Evolução de um Ambiente de Apoio ao Ensino de Programação e Teste de Software , 2012 .

[25]  Andrea Mocci,et al.  How to gamify software engineering , 2017, 2017 IEEE 24th International Conference on Software Analysis, Evolution and Reengineering (SANER).

[26]  Jean Felipe P. Cheiran,et al.  Problem-Based Learning to Align Theory and Practice in Software Testing Teaching , 2017, SBES'17.

[27]  Fabiano Cutigi Ferrari,et al.  Gamification in Software Testing: A Characterization Study , 2018, SAST '18.

[28]  Simone do Rocio Senger de Souza,et al.  Abordagem flipped classroom em comparação com o modelo tradicional de ensino: uma investigação empírica no âmbito de teste de software , 2017 .

[29]  Diane Kelly,et al.  More testing should be taught , 2001, CACM.