Systematic Review on Software Product Line Testing

This article presents a systematic review of the literature about Testing in Software Product Lines. The objective is to analyze the existing approaches to testing in software product lines, discussing the significant issues related to this area of knowledge and providing an up-to-date state of the art, which can serve as a basis for innovative research activities. The paper includes an analysis on how SPL research can contribute to dynamize the research in software testing.

[1]  Mario Piattini,et al.  Software process improvement in small and medium software enterprises: a systematic review , 2008, Software Quality Journal.

[2]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[3]  Markus Roggenbach,et al.  Speci?cation-Based Testing for Software Product Lines , 2008, 2008 Sixth IEEE International Conference on Software Engineering and Formal Methods.

[4]  Daniel Hoffman,et al.  Software product lines: a case study , 2000 .

[5]  Clémentine Nebut,et al.  A Requirement-Based Approach to Test Product Families , 2003, PFE.

[6]  Klaus Pohl,et al.  Software Product Line Engineering , 2005 .

[7]  Samuel A. Ajila,et al.  Experimental use of code delta, code churn, and rate of change to understand software product line evolution , 2007, J. Syst. Softw..

[8]  Beatriz Pérez Lamancha,et al.  Automated model-based testing using the UML testing profile and QVT , 2009, MoDeVVa '09.

[9]  Klaus Pohl,et al.  Software Product Line Engineering - Foundations, Principles, and Techniques , 2005 .

[10]  Myra B. Cohen,et al.  Coverage and adequacy in software product line testing , 2006, ROSATEA '06.

[11]  Myra B. Cohen,et al.  Improving the Testing and Testability of Software Product Lines , 2010, SPLC.

[12]  Stephen H. Edwards,et al.  Formal Foundations of Reuse and Domain Engineering, 11th International Conference on Software Reuse, ICSR 2009, Falls Church, VA, USA, September 27-30, 2009. Proceedings , 2009, ICSR.

[13]  Tommi Mikkonen,et al.  Production-Testing of Embedded Systems with Aspects , 2005, Haifa Verification Conference.

[14]  Macario Polo,et al.  Testing Product Generation in Software Product Lines Using Pairwise for Features Coverage , 2010, ICTSS.

[15]  Macario Polo,et al.  Model-driven testing in software product lines , 2009, 2009 IEEE International Conference on Software Maintenance.

[16]  Mario Piattini,et al.  Software Product Line Testing - A Systematic Review , 2009, ICSOFT.

[17]  John K. Debenham.  Knowledge Engineering , 1998, Encyclopedia of Social Network Analysis and Mining.

[18]  David McComas,et al.  Architecture-Based Unit Testing of the Flight Software Product Line , 2010, SPLC.

[19]  Juha Taina,et al.  Product family testing: a survey , 2004, SOEN.

[20]  Jacques Klein,et al.  Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[21]  Macario Polo,et al.  Automatic Generation of Test Cases in Software Product Lines , 2009, ICEIS.

[22]  Birgit Geppert,et al.  Enabling Verifiable Conformance for Product Lines , 2008, 2008 12th International Software Product Line Conference.

[23]  Kyo Chul Kang,et al.  ASADAL: a tool system for co-development of software and test environment based on product line engineering , 2006, ICSE '06.

[24]  Klaus Pohl,et al.  Software Product-Family Engineering , 2002, Lecture Notes in Computer Science.

[25]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[26]  Antonia Bertolino,et al.  PLUTO: A Test Methodology for Product Families , 2003, PFE.

[27]  Stefan Baerisch.  Model-driven test-case construction , 2007, ESEC-FSE '07.

[28]  Tim Trew.  Enabling the Smooth Integration of Core Assets: Defining and Packaging Architectural Rules for a Family of Embedded Products , 2005, SPLC.

[29]  Dirk Muthig,et al.  Making testing product lines more efficient by improving the testability of product line architectures , 2006, ROSATEA '06.

[30]  Frank van der Linden,et al.  Software Product Families in Europe: The Esaps & Café Projects , 2002, IEEE Softw..

[31]  John D. McGregor,et al.  Initiating software product lines , 2002, IEEE Software.

[32]  Sebastian Oster,et al.  Automated Incremental Pairwise Testing of Software Product Lines , 2010, SPLC.

[33]  Myungchul Kim,et al.  Towards a Formal Framework for Product Line Test Development , 2007, 7th IEEE International Conference on Computer and Information Technology (CIT 2007).

[34]  Mario Piattini,et al.  An Automated Model-driven Testing Framework - For Model-Driven Development and Software Product Lines , 2010, ENASE.

[35]  Jaejoon Lee,et al.  Software Product Lines: Going Beyond - 14th International Conference, SPLC 2010, Jeju Island, South Korea, September 13-17, 2010. Proceedings , 2010, SPLC.

[36]  Perdita Stevens,et al.  Modelling Recursive Calls with UML State Diagrams , 2003, FASE.

[37]  K. V. Hanford,et al.  Automatic Generation of Test Cases , 1970, IBM Syst. J..

[38]  Frank Maurer,et al.  Linking Feature Models to Code Artifacts Using Executable Acceptance Tests , 2010, SPLC.

[39]  J. Knodel,et al.  Comparing Costs and Benefits of Different Test Strategies for a Software Product Line: A Study from Testo AG , 2007 .

[40]  Klaus Pohl,et al.  Software product line testing , 2006, CACM.

[41]  Klaus Pohl,et al.  Model-Based System Testing of Software Product Families , 2005, CAiSE.

[42]  Klaus Pohl,et al.  Avoiding Redundant Testing in Application Engineering , 2010, SPLC.

[43]  Jan Bosch,et al.  Software Reuse: Methods, Techniques, and Tools , 2004, Lecture Notes in Computer Science.

[44]  Hassan Gomaa,et al.  Reusable Model-Based Testing , 2009, ICSR.

[45]  Paul G. Sorenson,et al.  Testing Software Assets of Framework-Based Product Families During Application Engineering Stage , 2008, J. Softw..

[46]  Klaus Pohl,et al.  Integration Testing in Software Product Line Engineering: A Model-Based Technique , 2007, FASE.

[47]  Danilo Caivano,et al.  Model-Driven Test Code Generation , 2011, ENASE.

[48]  Paula Gomes Mian,et al.  Systematic Review in Software Engineering , 2005 .

[49]  Danilo Caivano,et al.  Model-driven Testing - Transformations from Test Models to Test Code , 2011, ENASE.

[50]  Sergio Segura,et al.  Automated Test Data Generation on the Analyses of Feature Models: A Metamorphic Testing Approach , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[51]  Avelino Francisco Zorzo,et al.  PLeTs-Test Automation using Software Product Lines and Model Based Testing , 2010, SEKE.

[52]  Alfred Kobsa,et al.  Facilitating Controlled Tests of Website Design Changes Using Aspect-Oriented Software Development and Software Product Lines , 2009, Trans. Large Scale Data Knowl. Centered Syst..

[53]  Sarfraz Khurshid,et al.  Incremental Test Generation for Software Product Lines , 2010, IEEE Transactions on Software Engineering.

[54]  Clémentine Nebut,et al.  Automated requirements-based generation of test cases for product families , 2003, 18th IEEE International Conference on Automated Software Engineering, 2003. Proceedings..

[55]  Christian Denger,et al.  Testing and inspecting reusable product line components: first empirical results , 2006, ISESE '06.

[56]  Antonia Bertolino,et al.  Software Testing Research: Achievements, Challenges, Dreams , 2007, Future of Software Engineering (FOSE '07).

[57]  John D. McGregor,et al.  Testing a Software Product Line , 2001, PSSE.