Exploratory test agents for stateful software systems

The adequate testing of stateful software systems is a hard and costly activity. Failures that result from complex stateful interactions can be of high impact, and it can be hard to replicate failures resulting from erroneous stateful interactions. Addressing this problem in an automatic way would save cost and time and increase the quality of software systems in the industry. In this paper, we propose an approach that uses agents to explore software systems with the intention to find faults and gain knowledge.

[1]  Alexei A. Efros,et al.  Large-Scale Study of Curiosity-Driven Learning , 2018, ICLR.

[2]  Porfirio Tramontana,et al.  MobiGUITAR: Automated Model-Based Testing of Mobile Apps , 2015, IEEE Software.

[3]  Bernhard K. Aichernig,et al.  Model Learning and Model-Based Testing , 2018, Machine Learning for Dynamic Software Analysis.

[4]  ArcuriAndrea.  RESTful API Automated Test Case Generation with EvoMaster , 2019 .

[5]  Junfeng Yang,et al.  AppFlow: using machine learning to synthesize robust, reusable UI tests , 2018, ESEC/SIGSOFT FSE.

[6]  Emil Alegroth,et al.  Thesis for The Degree of Doctor of Philosophy Visual GUI Testing : Automating High-Level Software Testing in Industrial Practice , 2015 .

[7]  Yue Jia,et al.  Sapienz: multi-objective automated testing for Android applications , 2016, ISSTA.

[8]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[9]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[10]  Richard Torkar,et al.  Using Exploration Focused Techniques to Augment Search-Based Software Testing: An Experimental Evaluation , 2016, 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST).

[11]  Yang Liu,et al.  Guided, stochastic model-based GUI testing of Android apps , 2017, ESEC/SIGSOFT FSE.

[12]  Andrea Arcuri,et al.  RESTful API Automated Test Case Generation with EvoMaster , 2019, ACM Trans. Softw. Eng. Methodol..

[13]  Andrea Arcuri,et al.  An experience report on applying software testing academic results in industry: we need usable automated test generation , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[14]  Jian Lu,et al.  AimDroid: Activity-Insulated Multi-level Automated Testing for Android Applications , 2017, 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[15]  Konstantinos Sagonas,et al.  A PropEr integration of types and function specifications with property-based testing , 2011, Erlang Workshop.

[16]  Koen Claessen,et al.  QuickCheck: a lightweight tool for random testing of Haskell programs , 2000, ICFP.

[17]  Leonardo Mariani,et al.  Augusto: Exploiting Popular Functionalities for the Generation of Semantic GUI Tests with Oracles , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[18]  Eduard Paul Enoiu,et al.  Test Agents: The Next Generation of Test Cases , 2019, 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW).