Automated EFSM-based test case generation with scatter search

Extended Finite State Machine (EFSM) is widely-used to represent system specifications. Automated test data generation based on EFSM models is still a challenging task due to the complexity of transition paths. In this paper, we introduce a new approach to generate test cases automatically for given transition paths of an EFSM model. An executable EFSM model is used to provide run-time feedback information as fitness function. And then scatter search algorithm is used to search for test data that can trigger given transition paths. Based on the executable model, the expected outputs associated with test data are also collected for construction of test oracles automatically. Finally, test data (inputs) and test oracles (expected outputs) are combined to be test cases. The experimental results show that our approach can effectively generate test cases to exercise the feasible transition paths.

[1]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[2]  Enrique Alba,et al.  AbYSS: Adapting Scatter Search to Multiobjective Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[3]  Krishnaiyan Thulasiraman,et al.  Context independent unique state identification sequences for testing communication protocols modelled as extended finite state machines , 2003, Comput. Commun..

[4]  Robert M. Hierons,et al.  An integrated search-based approach for automatic testing from extended finite state machine (EFSM) models , 2011, Inf. Softw. Technol..

[5]  Baowen Xu,et al.  Improve the Effectiveness of Test Case Generation on EFSM via Automatic Path Feasibility Analysis , 2011, 2011 IEEE 13th International Symposium on High-Assurance Systems Engineering.

[6]  Eliane Martins,et al.  Generating Feasible Test Paths from an Executable Model Using a Multi-objective Approach , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[7]  Ferhat Khendek,et al.  Test Selection Based on Finite State Models , 1991, IEEE Trans. Software Eng..

[8]  Robert M. Hierons,et al.  Generating Feasible Transition Paths for Testing from an Extended Finite State Machine (EFSM) , 2009, ICST.

[9]  James D. McCaffrey,et al.  An Empirical Study of Pairwise Test Set Generation Using a Genetic Algorithm , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[10]  Javier Tuya,et al.  Automated test data generation using a scatter search approach , 2009, Inf. Softw. Technol..

[11]  Bogdan Korel,et al.  Slicing of state-based models , 2003, International Conference on Software Maintenance, 2003. ICSM 2003. Proceedings..

[12]  Mark Harman,et al.  Empirical Study on the Efficiency of Search Based Test Generation for EFSM Models , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[13]  Fred W. Glover,et al.  A Template for Scatter Search and Path Relinking , 1997, Artificial Evolution.

[14]  Bo Yang,et al.  A test sequence selection method for protocol testing , 1991, IEEE Trans. Commun..

[15]  Jing-Yang Jou,et al.  Stimulus generation for interface protocol verification using the nondeterministic extended finite state machine model , 2005, Tenth IEEE International High-Level Design Validation and Test Workshop, 2005..

[16]  Atif M. Memon,et al.  Using GUI Run-Time State as Feedback to Generate Test Cases , 2007, 29th International Conference on Software Engineering (ICSE'07).

[17]  Stephen Swift,et al.  A Search-Based Approach for Automatic Test Generation from Extended Finite State Machine (EFSM) , 2009, 2009 Testing: Academic and Industrial Conference - Practice and Research Techniques.

[18]  Robert M. Hierons,et al.  Generating Feasible Transition Paths for Testing from an Extended Finite State Machine (EFSM) , 2009, 2009 International Conference on Software Testing Verification and Validation.

[19]  Raquel Blanco,et al.  A First Approach to Test Case Generation for BPEL Compositions of Web Services Using Scatter Search , 2009, 2009 International Conference on Software Testing, Verification, and Validation Workshops.

[20]  Michael A. Hennell,et al.  The causes and effects of infeasible paths in computer programs , 1985, ICSE '85.

[21]  Ana R. Cavalli,et al.  New approaches for passive testing using an Extended Finite State Machine specification , 2003, Inf. Softw. Technol..

[22]  José Antonio Lozano,et al.  Scatter Search in software testing, comparison and collaboration with Estimation of Distribution Algorithms , 2006, Eur. J. Oper. Res..

[23]  Florentin Ipate,et al.  Automatic State-Based Test Generation Using Genetic Algorithms , 2007, Ninth International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC 2007).

[24]  Chung-Ming Huang,et al.  Executable EFSM—based data flow and control flow protocol test sequence generation using reachability analysis , 1999 .

[25]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[26]  Vicente Campos,et al.  Scatter Search vs. Genetic Algorithms , 2005 .