An experimental study to evaluate a SPL architecture regression testing approach

In Software Product Line Engineering, where products are derived from a common platform, the reference architecture should be considered the main asset. In order to maintain its correctness and reliability after modifications, a regression testing approach based on architecture specification and code was developed. In this paper, we evaluate it in two different scenarios, the corrective scenario, in which it was performed after a corrective change in the code, and in the progressive scenario, executed after a evolution or enhancement, when some specification changes. The results showed that the progressive scenario was less costly than the corrective. Our evaluation also highlights the importance of a code-based technique to select a set of efficient and effective test cases.

[1]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[2]  Silvio Romero de Lemos Meira,et al.  A Regression Testing Approach for Software Product Lines Architectures , 2010, 2010 Fourth Brazilian Symposium on Software Components, Architectures and Reuse.

[3]  John D. McGregor,et al.  A systematic mapping study of software product lines testing , 2011, Inf. Softw. Technol..

[4]  Alessandro Orso,et al.  Scaling regression testing to large software systems , 2004, SIGSOFT '04/FSE-12.

[5]  Mary Shaw,et al.  The golden age of software architecture , 2006, IEEE Software.

[6]  Henry Muccini,et al.  Software architecture-based regression testing , 2006, J. Syst. Softw..

[7]  Henry Muccini,et al.  Systematic Testing of Software Architectures in the C2 Style , 2004, FASE.

[8]  Mary Jean Harrold,et al.  Testing: a roadmap , 2000, ICSE '00.

[9]  Alessandro Orso,et al.  JDiff: A differencing technique and tool for object-oriented programs , 2006, Automated Software Engineering.

[10]  Gregg Rothermel,et al.  Prioritizing test cases for regression testing , 2000, ISSTA '00.

[11]  Li Qiong,et al.  The W-Model for Testing Software Product Lines , 2008, 2008 International Symposium on Computer Science and Computational Technology.

[12]  John D. McGregor Toward a Fault Model for Software Product Lines , 2008, SPLC.

[13]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[14]  Antonia Bertolino,et al.  Software Testing Research: Achievements, Challenges, Dreams , 2007, Future of Software Engineering (FOSE '07).

[15]  John D. McGregor,et al.  Testing a Software Product Line , 2001, PSSE.