Model-based Product Quality Evaluation with Multi-Criteria Decision Analysis

The ability to develop or evolve software or software-based systems/services with defined and guaranteed quality in a predictable way is becoming increasingly im- portant. Essential - though not exclusive - prerequisites for this are the ability to model the relevant quality properties appropriately and the capability to perform reliable quality evaluations. Existing approaches for integrated quality modeling and evaluation are typically either narrowly focused or too generic and have pro- prietary ways for modeling and evaluating quality. This article sketches an ap- proach for modeling and evaluating quality properties in a uniform way, without losing the ability to build sufficiently detailed customized models for specific quali- ty properties. The focus of this article is on the description of a multi-criteria ag- gregation mechanism that can be used for the evaluation. In addition, the underly- ing quality meta-model, an example application scenario, related work, initial ap- plication results, and an outlook on future research are presented.

[1]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[2]  Stefan Wagner,et al.  Quality models in practice: A preliminary analysis , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[3]  Guisheng Yin,et al.  Fuzzy Integrated Evaluation for Measuring Quality of Feature Space-Based Component Model , 2008, 2008 International Conference on Internet Computing in Science and Engineering.

[4]  Adam Trendowicz,et al.  Measurement-based Software Quality Evaluation , 2009 .

[5]  Mohammad Kazem Akbari,et al.  Customizing ISO 9126 quality model for evaluation of B2B applications , 2009, Inf. Softw. Technol..

[6]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[7]  Ioannis Stamelos,et al.  A new method to evaluate software artifacts against predefined profiles , 2002, SEKE '02.

[8]  Claes Wohlin,et al.  An Investigation of a Method for Identifying a Software Architecture Candidate with Respect to Quality Attributes , 2005, Empirical Software Engineering.

[9]  Salman Nazari Shirkouhi,et al.  Evaluating simulation software using fuzzy analytical hierarchy process , 2009, SpringSim '09.

[10]  Brian Henderson-Sellers,et al.  Metamodelling for software engineering , 2008 .

[11]  Alexis Tsoukiàs,et al.  Multi-Criteria Methodology Contribution to the Software Quality Evaluation , 2001, Software Quality Journal.

[12]  Alessio Ishizaka,et al.  Multi-criteria decision analysis , 2013 .

[13]  Marcus Ciolkowski,et al.  Towards a Comprehensive Approach for Assessing Open Source Projects , 2008, IWSM/Metrikon/Mensura.

[14]  Jürgen Münch,et al.  CQML Scheme: A Classification Scheme for Comprehensive Quality Model Landscapes , 2009, 2009 35th Euromicro Conference on Software Engineering and Advanced Applications.

[15]  Alain Abran,et al.  Software Process and Product Measurement, International Conference, IWSM-Mensura 2007, Palma de Mallorca, Spain, November 5-8, 2007. Revised Papers , 2008, IWSM/Mensura.

[16]  L. Phillips,et al.  Multi-criteria analysis: a manual , 2009 .