Towards a Conversational Agent to Support the Software Testing Education

The training of professionals in the field of software testing is increasing its relevance in the past few years and, therefore, efforts in appropriate methodologies for the learning-teaching process in this context have been proposed and appreciated. The emergence of pedagogical models, such as flipped classroom and team-based learning, which demand from the students a previous study of the theory before the lecture, creates a concern: how to support the before class learning? Because of the hybrid nature of these pedagogical models, which means they mix elements from traditional and distance education, it is possible that the support mechanisms used in distance learning platforms, such as conversational agents, can be applied for this matter. At the same time in which the academic work tries carefully to provide a proper software testing formation, there are also many contributions being established regarding the training and non-formal learning. Improvement and personal training courses about criteria, tools, and software testing good practices are being created by teaching institutes and offered in Massive Open Online Courses platforms (MOOCs). However, in this type of course, in the absence of a teacher, the student might be in a situation where there is nobody available to answer their questions about the topic. In this paper, we propose the use of conversational agents in solving the problems and challenges which encompass the learning through MOOCs and hybrid models. A conversational agent, called TOB-SST is proposed to support software testing education. A viability study was conducted to understand the quality of the given answers by TOB-SST and the possibility of it serving as a learning support tool. The results indicate that it is promising to employ a conversational agent to guide student study.

[1]  Carlos Delgado Kloos,et al.  Supporting a MOOC through a Conversational Agent. Design of a First Prototype , 2018, 2018 International Symposium on Computers in Education (SIIE).

[2]  Gordon Fraser,et al.  Gamifying a Software Testing Course with Code Defenders , 2019, SIGCSE.

[3]  Antonia Bertolino,et al.  Software Testing Research: Achievements, Challenges, Dreams , 2007, Future of Software Engineering (FOSE '07).

[4]  Tomoo Inoue,et al.  Using a Conversational Agent to Facilitate Non-native Speaker's Active Participation in Conversation , 2019, CHI Extended Abstracts.

[5]  Susan Bull,et al.  Conversational Agents in E-Learning , 2008, SGAI Conf..

[6]  Roseclea Duarte Medina,et al.  Three-Dimensional Virtual Environment and NPC: A Perspective about Intelligent Agents Ubiquitous , 2016 .

[7]  Christian Wolff,et al.  An experimental card game for software testing: Development, design and evaluation of a physical card game to deepen the knowledge of students in academic software testing education , 2016, 2016 IEEE Global Engineering Education Conference (EDUCON).

[8]  Santiago Matalonga,et al.  Toward the characterization of software testing practices in South America: looking at Brazil and Uruguay , 2017, Software Quality Journal.

[9]  Rosa Maria Vicari,et al.  Using Chatbots for Network Management Training through Problem-based Oriented Education , 2007, Seventh IEEE International Conference on Advanced Learning Technologies (ICALT 2007).

[10]  Leo Natan Paschoal,et al.  Planejamento e Aplicação de Flipped Classroom para o Ensino de Teste de Software , 2018 .

[11]  Elisa Yumi Nakagawa,et al.  Towards the Establishment of an Ontology of Software Testing , 2006, SEKE.

[12]  Jeffrey C. Carver,et al.  An empirical methodology for introducing software processes , 2001, ESEC/FSE-9.

[13]  Forrest Shull,et al.  Developing techniques for using software documents: a series of empirical studies , 1998 .

[14]  Luciana Benotti,et al.  A Tool for Introducing Computer Science with Automatic Formative Assessment , 2018, IEEE Transactions on Learning Technologies.

[15]  Ellen Francine Barbosa,et al.  CS curricula of the most relevant universities in Brazil and abroad: Perspective of software testing education , 2015, 2015 International Symposium on Computers in Education (SIIE).

[16]  Eric Atwell,et al.  Usefulness, localizability, humanness, and language-benefit: additional evaluation criteria for natural language dialogue systems , 2016, Int. J. Speech Technol..

[17]  Martín Llamas Nistal,et al.  Using a Chatterbot as a FAQ Assistant in a Course about Computers Architecture , 2018, 2018 IEEE Frontiers in Education Conference (FIE).

[18]  Pablo Orduña,et al.  New Approach for Conversational Agent Definition by Non-Programmers: A Visual Domain-Specific Language , 2019, IEEE Access.

[19]  George D. Magoulas,et al.  Massive open online courses in software engineering education , 2017, 2017 IEEE Frontiers in Education Conference (FIE).

[20]  G. Myers,et al.  The Art of Software Testing: Myers/Art , 2012 .

[21]  Richard S. Wallace,et al.  The Anatomy of A.L.I.C.E. , 2009 .

[22]  Simone do Rocio Senger de Souza,et al.  Abordagem flipped classroom em comparação com o modelo tradicional de ensino: uma investigação empírica no âmbito de teste de software , 2017 .

[23]  Jorge Marques Prates,et al.  A survey on graduates’ curriculum-based knowledge gaps in software testing , 2018, 2018 IEEE Frontiers in Education Conference (FIE).

[24]  Andrea Arcuri,et al.  Recent Trends in Software Testing Education: A Systematic Literature Review , 2018, NIK.

[25]  Lorenzo Vigentini,et al.  MOOC-O-Bot: Using Cognitive Technologies to Extend Knowledge Support in MOOCs , 2018, 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE).

[26]  Patrícia Tedesco,et al.  Agentes Inteligentes Conversacionais: Conceitos Básicos e Desenvolvimento , 2016 .

[27]  Saturnino Luz,et al.  Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools , 2015, Interact. Comput..

[28]  Leo Natan Paschoal,et al.  A Chatterbot Sensitive to Student's Context to Help on Software Engineering Education , 2018, 2018 XLIV Latin American Computer Conference (CLEI).

[29]  Cristiano André da Costa,et al.  Survey of conversational agents in health , 2019, Expert Syst. Appl..

[30]  Simone do Rocio Senger de Souza,et al.  A Survey on Software Testing Education in Brazil , 2018, SBQS.

[31]  Gary Roberts,et al.  Parsing the Turing Test: Philosophical and Methodological Issues in the Quest for the Thinking Computer , 2008 .

[32]  Ellen Francine Barbosa,et al.  Um Mapeamento Sistemático sobre Ensino de Teste de Software , 2015 .

[33]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[34]  John Woods,et al.  Survey on Chatbot Design Techniques in Speech Conversation Systems , 2015 .

[35]  Fabiano Cutigi Ferrari,et al.  The impact of Software Testing education on code reliability: An empirical assessment , 2017, J. Syst. Softw..