Model-Based System Testing of Software Product Families

In software product family engineering reusable artifacts are produced during domain engineering and applications are built from these artifacts during application engineering. Modeling variability of current and future applications is the key for enabling reuse. The proactive reuse leads to a reduction in development costs and a shorter time to market. Up to now, these benefits have been realized for the constructive development phases, but not for testing. This paper presents the ScenTED technique (Scenario based TEst case Derivation), which aims at reducing effort in product family testing. ScenTED is a model-based, reuse-oriented technique for test case derivation in the system test of software product families. Reuse of test cases is ensured by preserving variability during test case derivation. Thus, concepts known from model-based testing in single system engineering, e.g., coverage metrics, must be adapted. Experiences with our technique gained from an industrial case study are discussed and prototypical tool support is illustrated.

[1]  Andreas Reuys,et al.  Derivation of Domain Test Scenarios from Activity Diagrams1 , 2003 .

[2]  A. Jefferson Offutt,et al.  Generating Tests from UML Specifications , 1999, UML.

[3]  Bogdan Franczyk,et al.  EXTENDING THE UML TO MODEL SYSTEM FAMILIES , 2000 .

[4]  Klaus Pohl,et al.  Communicating the variability of a software-product family to customers , 2003, Software and Systems Modeling.

[5]  Paul Clements,et al.  Software product lines - practices and patterns , 2001, SEI series in software engineering.

[6]  Ibrahim K. El-Far.  Enjoying the Perks of Model-Based Testing , 2001 .

[7]  Antonia Bertolino,et al.  PLUTO: A Test Methodology for Product Families , 2003, PFE.

[8]  Bernhard Rumpe,et al.  «UML»’99 — The Unified Modeling Language , 2003, Lecture Notes in Computer Science.

[9]  Boris Beizer,et al.  Black-box testing , 1995 .

[10]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[11]  Frank van der Linden,et al.  Software Product Families in Europe: The Esaps & Café Projects , 2002, IEEE Softw..

[12]  John D. McGregor,et al.  Initiating software product lines , 2002, IEEE Software.

[13]  Klaus Pohl,et al.  Testing Variabilities in Use Case Models , 2003, PFE.

[14]  Robert V. Binder,et al.  Testing Object-Oriented Systems: Models, Patterns, and Tools , 1999 .

[15]  Clémentine Nebut,et al.  A Requirement-Based Approach to Test Product Families , 2003, PFE.

[16]  John D. McGregor,et al.  Testing a Software Product Line , 2001, PSSE.

[17]  Premkumar T. Devanbu,et al.  Analytical and empirical evaluation of software reuse metrics , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[18]  Birgit Geppert,et al.  Enabling Verifiable Conformance for Product Lines , 2008, 2008 12th International Software Product Line Conference.