A Survey on Software Testing Education in Brazil

Software testing is one of the most important quality assurance activities. However, it is considered a challenge while teaching in undergraduate programs. One of the implied challenges is how to include this topic in computing undergraduate programs and in which level of detail. The industry has recognized the importance of this deeper and more solid formation. Nevertheless, in most cases, teaching software testing is distributed in disciplines and with different levels of detail. Each teaching method of software testing has its own advantages and disadvantages. Understanding this scenario is important for the proposition of improvements and innovations in the way of teaching software testing. This paper presents the results of a survey conducted throughout various Brazilian computing courses in different universities to identify which and how topics on software testing are taught. The objective is to identify the way in which the content is given, the support mechanisms used in the teaching practices, the challenges imposed and the instruments used to evaluate the students' learning. The survey was conducted in November of 2017 with Higher Education Institutions (HEI) lecturers distributed in different regions of Brazil, which have undergraduate programs in computer science. From the results, suggestions are presented and discussed in order to promote the dissemination of knowledge in this area of software engineering.

[1]  D. Cook,et al.  Current concepts in validity and reliability for psychometric instruments: theory and application. , 2006, The American journal of medicine.

[2]  A Straw,et al.  Guide to the Software Engineering Body of Knowledge , 1998 .

[3]  Elisa Yumi Nakagawa,et al.  Towards the Establishment of an Ontology of Software Testing , 2006, SEKE.

[4]  Janice Singer,et al.  Guide to Advanced Empirical Software Engineering , 2007 .

[5]  W. Eric Wong,et al.  Improving the State of Undergraduate Software Testing Education , 2012 .

[6]  Tariq M. King,et al.  Impact of Using Tools in an Undergraduate Software Testing Course Supported by WReSTT , 2017, ACM Trans. Comput. Educ..

[7]  Mark Kasunic,et al.  Designing an Effective Survey , 2005 .

[8]  Shari Lawrence Pfleeger,et al.  Personal Opinion Surveys , 2008, Guide to Advanced Empirical Software Engineering.

[9]  Gordon Fraser,et al.  Code Defenders: Crowdsourcing Effective Tests and Subtle Mutants with a Mutation Testing Game , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE).

[10]  Fabiano Cutigi Ferrari,et al.  The impact of Software Testing education on code reliability: An empirical assessment , 2017, J. Syst. Softw..

[11]  Seiji Isotani,et al.  Teaching novice programmers using ProgTest , 2015, Int. J. Knowl. Learn..

[12]  V. Basili Software modeling and measurement: the Goal/Question/Metric paradigm , 1992 .

[13]  Tariq M. King,et al.  Collaborative web-based learning of testing tools in SE courses , 2011, SIGCSE '11.

[14]  Ellen Francine Barbosa,et al.  CS curricula of the most relevant universities in Brazil and abroad: Perspective of software testing education , 2015, 2015 International Symposium on Computers in Education (SIIE).

[15]  Joanna Smith,et al.  Using peer review to teach software testing , 2012, ICER '12.

[16]  Christian Wolff,et al.  An experimental card game for software testing: Development, design and evaluation of a physical card game to deepen the knowledge of students in academic software testing education , 2016, 2016 IEEE Global Engineering Education Conference (EDUCON).

[17]  T. T. D. Silva,et al.  Panorama do Ensino de Engenharia de Software em Cursos de Graduação Focado em Teste de Software: Uma Proposta de Aprendizagem Baseada em Jogos , 2011 .

[18]  Gordon Fraser,et al.  Teaching Software Testing Concepts Using a Mutation Testing Game , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET).

[19]  Ellen Francine Barbosa,et al.  Um Mapeamento Sistemático sobre Ensino de Teste de Software , 2015 .

[20]  Tariq M. King,et al.  Integrating Testing into Software Engineering Courses Supported by a Collaborative Learning Environment , 2014, TOCE.

[21]  Simone do Rocio Senger de Souza,et al.  Abordagem flipped classroom em comparação com o modelo tradicional de ensino: uma investigação empírica no âmbito de teste de software , 2017 .

[22]  T.C. Lethbridge,et al.  Guide to the Software Engineering Body of Knowledge (SWEBOK) and the Software Engineering Education Knowledge (SEEK) - a preliminary mapping , 2001, 10th International Workshop on Software Technology and Engineering Practice.

[23]  Arilo Claudio Dias-Neto,et al.  Tester Experience: Concept, Issues and Definition , 2017, 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC).

[24]  Ellen Francine Barbosa,et al.  : an integrated modeling approach for developing educational modules , 2011, Journal of the Brazilian Computer Society.

[25]  Mark S. Litwin,et al.  How to Measure Survey Reliability and Validity , 1995 .

[26]  Fabiane Barreto Vavassori Benitti A Methodology to Define Learning Objects Granularity: A Case Study in Software Testing , 2018, Informatics Educ..