SPLBA: An interaction strategy for testing software product lines using the Bat-inspired algorithm

Software product lines (SPLs) represent an engineering method for creating a portfolio of similar software systems for a shared set of software product assets. Owing to the significant growth of SPLs, there is a need for systematic approach for ensuring the quality of the resulting product derivatives. Combinatorial t-way testing (where t indicates the interaction strength) has been known to be effective especially when the number of product's features and constraints in the SPLs of interest are huge. In line with the recent emergence of Search based Software Engineering (SBSE), this article presents a novel strategy for SPLs tests reduction using Bat-inspired algorithm (BA), called SPLBA. Our experience with SPLBA has been promising as the strategy performed well against existing strategies in the literature.

[1]  Jiangfan Shi,et al.  Exploiting Constraint Solving History to Construct Interaction Test Suites , 2007, Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007).

[2]  Klaus Pohl,et al.  Software Product Line Engineering - Foundations, Principles, and Techniques , 2005 .

[3]  Jeff Yu Lei,et al.  Combinatorial Testing of ACTS: A Case Study , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[4]  Jacques Klein,et al.  Bypassing the Combinatorial Explosion: Using Similarity to Generate and Prioritize T-Wise Test Configurations for Software Product Lines , 2014, IEEE Transactions on Software Engineering.

[5]  Myra B. Cohen,et al.  Interaction testing of highly-configurable systems in the presence of constraints , 2007, ISSTA '07.

[6]  Kyo Chul Kang,et al.  Feature-Oriented Domain Analysis (FODA) Feasibility Study , 1990 .

[7]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[8]  J. Czerwonka.  Pairwise Testing in the Real World : Practical Extensions to Test-Case Scenarios , 2011 .

[9]  Øystein Haugen,et al.  Properties of realistic feature models make combinatorial testing of product lines feasible , 2011, MODELS'11.

[10]  Kamal Zuhairi Zamli,et al.  A variable strength interaction test suites generation strategy using Particle Swarm Optimization , 2011, J. Syst. Softw..

[11]  Jeff Yu Lei,et al.  ACTS: A Combinatorial Test Generation Tool , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation.

[12]  Malte Lochau,et al.  MoSo-PoLiTe: tool support for pairwise and model-based software product line testing , 2011, VaMoS '11.

[13]  Jacques Klein,et al.  Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[14]  Nitesh M. Sureja,et al.  New Inspirations in Nature: A Survey , 2012 .

[15]  Øystein Haugen,et al.  An algorithm for generating t-wise covering arrays from large feature models , 2012, SPLC '12.

[16]  James D. McCaffrey,et al.  Generation of Pairwise Test Sets Using a Genetic Algorithm , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[17]  Xiao-Zhi Gao,et al.  A Novel Hybrid Bat Algorithm with Differential Evolution Strategy for Constrained Optimization , 2015 .

[18]  Feng Duan,et al.  Combinatorial Test Generation for Software Product Lines Using Minimum Invalid Tuples , 2014, 2014 IEEE 15th International Symposium on High-Assurance Systems Engineering.

[19]  Z. ZamliKamal,et al.  T-Way Testing Strategies: A Critical Survey and Analysis , 2013 .

[20]  Myra B. Cohen,et al.  Constructing test suites for interaction testing , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[21]  Donald D. Cowan,et al.  S.P.L.O.T.: software product lines online tools , 2009, OOPSLA Companion.

[22]  Alexander Egyed,et al.  Using feature model knowledge to speed up the generation of covering arrays , 2013, VaMoS.

[23]  Myra B. Cohen,et al.  Designing Test Suites for Software Interactions Testing , 2004 .

[24]  Basem Y. Alkazemi,et al.  Generating T-Way Test Suite in The Presence Of Constraints , 2014 .

[25]  James D. McCaffrey,et al.  An Empirical Study of Pairwise Test Set Generation Using a Genetic Algorithm , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[26]  John D. McGregor,et al.  Strategies for testing products in software product lines , 2012, ACM SIGSOFT Softw. Eng. Notes.

[27]  Ina Schaefer,et al.  Implementing type-safe software product lines using parametric traits , 2015, Sci. Comput. Program..

[28]  Tatsuhiro Tsuchiya,et al.  Using artificial life techniques to generate test cases for combinatorial testing , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[29]  D. Richard Kuhn,et al.  Software fault interactions and implications for software testing , 2004, IEEE Transactions on Software Engineering.

[30]  Koffka Khan,et al.  A Comparison of BA, GA, PSO, BP and LM for Training Feed forward Neural Networks in e-Learning Context , 2012 .

[31]  Li Cheng,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010 .