Selective Test Generation Method for Evolving Critical Systems

We present in this paper the implementation of a model-based testing technique for evolving systems. These latters are described in UML using class/object diagrams and state charts, augmented with OCL constraints. Based on two versions of a given model, an automated process deduces the impact of model evolutions on the existing tests. Our methodology then classifies tests into different test suites to test evolution, regression, stagnation and deletion on the concrete system. We introduce the notion of tests and test suites life cycles that help defining the purpose of each test at a given step of the system evolution, and thus, their classification in different test suites. The approach is illustrated on a realistic case study, and the improvements w.r.t. other regression testing techniques are discussed.

[1]  Mary Jean Harrold,et al.  Recomputing Coverage Information to Assist Regression Testing , 2009, IEEE Transactions on Software Engineering.

[2]  Taehyung Wang,et al.  Model-based testing and maintenance , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[3]  Bogdan Korel,et al.  Model based regression test reduction using dependence analysis , 2002, International Conference on Software Maintenance, 2002. Proceedings..

[4]  Aamer Nadeem,et al.  A Survey of UML Based Regression Testing , 2008, Intelligent Information Processing.

[5]  Wolfgang Grieskamp,et al.  Multi-paradigmatic Model-Based Testing , 2006, FATES/RV.

[6]  Marco Bozzano,et al.  Design and Safety Assessment of Critical Systems , 2010 .

[7]  Gregg Rothermel,et al.  Analyzing Regression Test Selection Techniques , 1996, IEEE Trans. Software Eng..

[8]  Mary Jean Harrold,et al.  Regression test selection on system requirements , 2008, ISEC '08.

[9]  Elaine J. Weyuker,et al.  Data flow analysis techniques for test data selection , 2015, ICSE '82.

[10]  Mark utting.  Model-Based Testing – Next Generation Functional Software Testing , 2010 .

[11]  Lionel C. Briand,et al.  Automating impact analysis and regression test selection based on UML designs , 2002, International Conference on Software Maintenance, 2002. Proceedings..

[12]  Xiang Li,et al.  Regression Testing Process Improvement for Specification Evolution of Real-World Protocol Software , 2010, 2010 10th International Conference on Quality Software.

[13]  Gregg Rothermel,et al.  An empirical study of regression test selection techniques , 1998, Proceedings of the 20th International Conference on Software Engineering.

[14]  Alexandre Petrenko,et al.  Testing of Software and Communicating Systems , 2007, Lecture Notes in Computer Science.

[15]  Yanping Chen,et al.  Model-based regression test suite generation using dependence analysis , 2007, A-MOST '07.

[16]  Antti Huima,et al.  Implementing Conformiq Qtronic , 2007, TestCom/FATES.

[17]  Hyeon Soo Kim,et al.  Testing of concurrent programs after specification changes , 1999, Proceedings IEEE International Conference on Software Maintenance - 1999 (ICSM'99). 'Software Maintenance for Business Change' (Cat. No.99CB36360).

[18]  Boris Beizer,et al.  Black Box Testing: Techniques for Functional Testing of Software and Systems , 1996, IEEE Software.

[19]  Fabrice Bouquet,et al.  A subset of precise UML for model-based testing , 2007, A-MOST '07.

[20]  Mary Jean Harrold,et al.  Re-computing Coverage Information to Assist Regression Testing , 2007, 2007 IEEE International Conference on Software Maintenance.

[21]  Mark Harman,et al.  Test prioritization using system models , 2005, 21st IEEE International Conference on Software Maintenance (ICSM'05).

[22]  Orest Pilskalns,et al.  Regression Testing UML Designs , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[23]  Debra J. Richardson,et al.  MbSRT2: Model-Based Selective Regression Testing with Traceability , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.