Measures for Quality Evaluation of Feature Models

In Software Product Lines (SPL), quality evaluation is a critical factor, because an error in a SPL can spread to various end products. However, it is often proved impractical to ensure the quality of all products of a given SPL both for economic reasons and the effort needed due to their large number. In this context, a strategy that can be used is to make quality assessments on the initial phases of the SPL development. This approach avoids having errors that could be propagated to the next SPL phases. So, taking into account the feature model, which is one of the most important artifacts in a SPL since its quality directly affects the quality of the SPL end products, to assure the quality of the feature model is one of the current strategies to assess the quality of a SPL. In this sense, one way to evaluate the feature model is to use measures, which could be associated with the feature model quality characteristics and their quality attributes. This paper presents a measures catalog, which can be used to support the quality evaluation of the feature model. In order to identify these measures, a systematic mapping is conducted and to validate the measures catalog, we perform a peer review with experts in software quality and SPL. Besides that, to evaluate the use of the proposed catalog, we apply the measures in three feature models in the domain of mobile applications. The results show that the proposed measures catalog can be effectively deployed to support the quality evaluation of the feature models.

[1]  Yucong Duan,et al.  Releasing the Power of Variability: Towards Constraint Driven Quality Assurance , 2013, 2013 Second IIAI International Conference on Advanced Applied Informatics.

[2]  Frank J. van der Linden.  Software Product-Family Engineering , 2003, Lecture Notes in Computer Science.

[3]  Eila Niemelä,et al.  Quality-driven architecture design and quality analysis method: A revolutionary initiation approach to a product line architecture , 2002 .

[4]  Lianping Chen,et al.  Variability management in software product lines: a systematic review , 2009, SPLC.

[5]  Goiuria Sagardui Mendieta,et al.  Quality aware software product line engineering , 2010, Journal of the Brazilian Computer Society.

[6]  Silvia Mara Abrahão,et al.  Gathering current knowledge about quality evaluation in software product lines , 2009, SPLC.

[7]  Juha Savolainen,et al.  Identifying improvement potential in evolving product line infrastructures: 3 case studies , 2012, SPLC '12.

[8]  Martin L. Griss,et al.  Integrating feature modeling with the RSEB , 1998, Proceedings. Fifth International Conference on Software Reuse (Cat. No.98TB100203).

[9]  Douglas C. Schmidt,et al.  Evolving feature model configurations in software product lines , 2014, J. Syst. Softw..

[10]  Iulian Ober,et al.  SDL 2011: Integrating System and Software Modeling , 2011, Lecture Notes in Computer Science.

[11]  Leonor Barroca,et al.  Systematic Evaluation of Software Product Line Architectures , 2013, J. Univers. Comput. Sci..

[12]  Dragan Gasevic,et al.  Assessing the maintainability of software product line feature models using structural metrics , 2011, Software Quality Journal.

[13]  Forrest Shull,et al.  Using the ISO/IEC 9126 product quality model to classify defects: A controlled experiment , 2012, EASE.

[14]  Roel Wieringa,et al.  Requirements engineering paper classification and evaluation criteria: a proposal and a discussion , 2005, Requirements Engineering.

[15]  Sergio Segura,et al.  Automated analysis of feature models 20 years later: A literature review , 2010, Inf. Syst..

[16]  Yuqing Lin,et al.  Quality Attributes Assessment for Feature-Based Product Configuration in Software Product Line , 2010, 2010 Asia Pacific Software Engineering Conference.

[17]  Steffen Thiel.  On the Definition of a Framework for an Architecting Process Supporting Product Family Development , 2001, PFE.

[18]  Silvia Mara Abrahão,et al.  A Multimodel for Integrating Quality Assessment in Model-Driven Engineering , 2012, 2012 Eighth International Conference on the Quality of Information and Communications Technology.

[19]  Birger Møller-Pedersen,et al.  Standardizing Variability - Challenges and Solutions , 2011, SDL Forum.

[20]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[21]  Klaus Schmid.  Top Productivity through Software Reuse , 2011, Lecture Notes in Computer Science.

[22]  Klaus Pohl,et al.  Software Product Line Engineering - Foundations, Principles, and Techniques , 2005 .

[23]  D. Janaki Ram,et al.  ReQuEst: Requirements-driven quality estimator , 2005, SOEN.

[24]  Lianping Chen,et al.  A systematic review of evaluation of variability management approaches in software product lines , 2011, Inf. Softw. Technol..

[25]  Silvia Mara Abrahão,et al.  A systematic review of quality attributes and measures for software product lines , 2011, Software Quality Journal.

[26]  Kyo Chul Kang,et al.  Feature-Oriented Domain Analysis (FODA) Feasibility Study , 1990 .

[27]  Goiuria Sagardui Mendieta,et al.  Model based analysis process for embedded software product lines , 2011, ICSSP '11.

[28]  Krzysztof Czarnecki,et al.  Staged Configuration Using Feature Models , 2004, SPLC.

[29]  Kyo Chul Kang,et al.  Validating Consistency between a Feature Model and Its Implementation , 2013, ICSR.

[30]  Jaejoon Lee,et al.  Software Product Lines: Going Beyond - 14th International Conference, SPLC 2010, Jeju Island, South Korea, September 13-17, 2010. Proceedings , 2010, SPLC.

[31]  Dragan Gasevic,et al.  Decision support for the software product line domain engineering lifecycle , 2011, Automated Software Engineering.

[32]  Lidia Fuentes,et al.  Software Product Line Evolution with Cardinality-Based Feature Models , 2011, ICSR.

[33]  Vojislav B. Misic,et al.  A holistic architecture assessment method for software product lines , 2007, Inf. Softw. Technol..

[34]  Jan Bosch.  Software Variability Management , 2004, SPLC.

[35]  Cláudia Maria Lima Werner,et al.  MobiLine: A Nested Software Product Line for the domain of mobile and context-aware applications , 2013, Sci. Comput. Program..

[36]  Klaus Pohl,et al.  Software Product Line Engineering , 2005 .

[37]  Kyo Chul Kang,et al.  Usage Context as Key Driver for Feature Selection , 2010, SPLC.

[38]  Sergio Segura,et al.  FAMA: Tooling a Framework for the Automated Analysis of Feature Models , 2007, VaMoS.

[39]  Douglas C. Schmidt,et al.  Automated diagnosis of feature model configurations , 2010, J. Syst. Softw..

[40]  Hong Mei,et al.  High Confidence Software Reuse in Large Systems, 10th International Conference on Software Reuse, ICSR 2008, Beijing, China, May 25-29, 2008, Proceedings , 2008, ICSR.

[41]  Paul Clements,et al.  Software product lines - practices and patterns , 2001, SEI series in software engineering.

[42]  Goiuria Sagardui,et al.  Evaluation of Quality Attribute Variability in Software Product Families , 2008, 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ecbs 2008).

[43]  Goiuria Sagardui,et al.  Quality Assessment in Software Product Lines , 2008, ICSR 2008.

[44]  Vytautas Štuikys,et al.  MEASURING COMPLEXITY OF DOMAIN MODELS REPRESENTED BY FEATURE DIAGRAMS , 2015 .

[45]  Yuqing Lin,et al.  Quality attribute modeling and quality aware product configuration in software product lines , 2013, Software Quality Journal.

[46]  Donald D. Cowan,et al.  S.P.L.O.T.: software product lines online tools , 2009, OOPSLA Companion.

[47]  Jaejoon Lee,et al.  FORM: A feature-;oriented reuse method with domain-;specific reference architectures , 1998, Ann. Softw. Eng..

[48]  John F Av Aro,et al.  Safe and Secure Software Reuse , 2013, Lecture Notes in Computer Science.

[49]  Sungwon Kang,et al.  Extending ATAM to assess product line architecture , 2008, 2008 8th IEEE International Conference on Computer and Information Technology.

[50]  G. Sagardui,et al.  Variability Driven Quality Evaluation in Software Product Lines , 2008, 2008 12th International Software Product Line Conference.