Effectively Testing of Timed Composite Systems using Test Case Prioritization

A composite system consists of several components which can be developed separately and deployed in distributed environments. Executing test cases on such kind of systems requires more effort due to their size and their distributed environments. A critical issue is to prioritize efficient test cases to be firstly executed. We present in this paper a framework to generate test cases and to select the efficient ones to test the composite systems with taking into account time properties. Particularly, the framework generates a set of test cases based on a model of the system, which cover a given test objective. The test cases are then prioritized in an execution order to detect quickly faults, thus reducing the efforts of test execution and increasing the effectiveness of the testing process. The framework is complemented with an open-source toolchain for automating test case generation. It has been experimentally evaluated on the European Train Control System case study. The initial results show that the approach can save 40% of test execution effort

[1]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[2]  René Just,et al.  Using Non-redundant Mutation Operators and Test Suite Prioritization to Achieve Efficient and Scalable Mutation Analysis , 2012, 2012 IEEE 23rd International Symposium on Software Reliability Engineering.

[3]  Omar Rafiq,et al.  Controllability and observability in distributed testing , 1999, Inf. Softw. Technol..

[4]  Ana R. Cavalli,et al.  A Framework for Distributed Testing of Timed Composite Systems , 2014, 2014 21st Asia-Pacific Software Engineering Conference.

[5]  Krishnendu Chatterjee,et al.  The Complexity of Coverage , 2008, APLAS.

[6]  Rajvir Singh,et al.  Test Case Generation for Object-Oriented Systems: A Review , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[7]  W. Eric Wong,et al.  Effect of test set minimization on fault detection effectiveness , 1998 .

[8]  E. Evangelisti Controllability and Observability , 2011 .

[9]  Robert M. Hierons,et al.  Implementation relations and test generation for systems with distributed interfaces , 2011, Distributed Computing.

[10]  Gregg Rothermel,et al.  Test case prioritization: an empirical study , 1999, Proceedings IEEE International Conference on Software Maintenance - 1999 (ICSM'99). 'Software Maintenance for Business Change' (Cat. No.99CB36360).

[11]  Robert M. Hierons,et al.  An Implementation Relation and Test Framework for Timed Distributed Systems , 2013, ICTSS.

[12]  Joseph Sifakis,et al.  The IF Toolset , 2004, SFM.

[13]  Sudipto Ghosh Fault injection testing for distributed object systems , 2001, Proceedings 39th International Conference and Exhibition on Technology of Object-Oriented Languages and Systems. TOOLS 39.

[14]  Yvan Labiche,et al.  Multi-objective Construction of an Entire Adequate Test Suite for an EFSM , 2014, 2014 IEEE 25th International Symposium on Software Reliability Engineering.

[15]  Michael D. Ernst,et al.  Are mutants a valid substitute for real faults in software testing? , 2014, SIGSOFT FSE.

[16]  Nina Yevtushenko,et al.  Test suite minimization for testing in context , 1998, Softw. Test. Verification Reliab..