Software quality trade-offs: A systematic map

Background: Software quality is complex with over investment, under investment and the interplay between aspects often being overlooked as many researchers aim to advance individual aspects of software quality. Aim: This paper aims to provide a consolidated overview the literature that addresses trade-offs between aspects of software product quality. Method: A systematic literature map is employed to provide an overview of software quality trade-off literature in general. Specific analysis is also done of empirical literature addressing the topic. Results: The results show a wide range of solution proposals being considered. However, there is insufficient empirical evidence to adequately evaluate and compare these proposals. Further a very large vocabulary has been found to describe software quality. Conclusion: Greater empirical research is required to sufficiently evaluate and compare the wide range of solution proposals. This will allow researchers to focus on the proposals showing greater signs of success and better support industrial practitioners.

[1]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[2]  Paul Davidsson,et al.  Quantifying the Impact of Learning Algorithm Parameter Tuning , 2006, AAAI.

[3]  Francisca Losavio,et al.  Feature analysis for architectural evaluation methods , 2006, J. Syst. Softw..

[4]  Nabendu Chaki,et al.  Data diverse fault tolerant architecture for component based systems , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[5]  Martin Höst,et al.  Managing Quality Requirements: A Systematic Review , 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications.

[6]  Aybüke Aurum,et al.  When Product Managers Gamble with Requirements: Attitudes to Value and Risk , 2009, REFSQ.

[7]  Faizal Mahananto,et al.  Evaluation on organic web based software architecture of healthcare information system , 2010, The 40th International Conference on Computers & Indutrial Engineering.

[8]  Claes Wohlin,et al.  Balancing software product investments , 2009, ESEM 2009.

[9]  Marcelo R. Campo,et al.  Using Planning Techniques to Assist Quality-Driven Architectural Design Exploration , 2007, QoSA.

[10]  Claes Wohlin,et al.  Context in industrial software engineering research , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[11]  Andres J. Ramirez,et al.  Automatically generating adaptive logic to balance non-functional tradeoffs during reconfiguration , 2010, ICAC '10.

[12]  Zhao Xiumei,et al.  An Efficiency and Fairness Based Packet Marking Algorithm , 2009, 2009 10th ACIS International Conference on Software Engineering, Artificial Intelligences, Networking and Parallel/Distributed Computing.

[13]  Roel Wieringa,et al.  Requirements engineering paper classification and evaluation criteria: a proposal and a discussion , 2005, Requirements Engineering.

[14]  Danny Weyns,et al.  Applying the ATAM to an Architecture for Decentralized Control of a Transportation System , 2006, QoSA.

[15]  Yolande E. Chan.  Why Haven't We Mastered Alignment? The Importance of the Informal Organization Structure , 2002, MIS Q. Executive.

[16]  Shing-Chi Cheung,et al.  Performance Aware Service Pool in Dependable Service Oriented Architecture , 2006, Journal of Computer Science and Technology.

[17]  Rattikorn Hewett,et al.  Automated Negotiations in Web Service Procurement , 2008, 2008 Third International Conference on Internet and Web Applications and Services.

[18]  Henry Hoffmann,et al.  Quality of service profiling , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[19]  Fereidoon Shams Aliee,et al.  A new AHP-based approach towards Enterprise Architecture quality attribute analysis , 2009, 2009 Third International Conference on Research Challenges in Information Science.

[20]  R. Shewfelt.  What is quality , 1999 .

[21]  Ying Chen,et al.  An Improved Heuristic for QoS-Aware Service Composition Framework , 2008, 2008 10th IEEE International Conference on High Performance Computing and Communications.

[22]  Nancy R. Mead,et al.  Security quality requirements engineering (SQUARE) methodology , 2005, SESS@ICSE.

[23]  Rob J. Kusters,et al.  Quality specification and metrication, results from a case-study in a mission-critical software domain , 2010, Software Quality Journal.

[24]  Pedro Antunes,et al.  Negotiation-Collaboration in Formal Technical Reviews , 2009, CRIWG.

[25]  Tugba Efendigil,et al.  A theorical model design for ERP software selection process under the constraints of cost and quality: A fuzzy approach , 2010, J. Intell. Fuzzy Syst..

[26]  Martin Höst,et al.  A Quality Performance Model for Cost-Benefit Analysis of Non-functional Requirements Applied to the Mobile Handset Domain , 2007, REFSQ.

[27]  Martin Höst,et al.  The importance of quality requirements in software platform development-a survey , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[28]  Qian Zhang,et al.  Tool Support to Model-based Quality Analysis of Software Architecture , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[29]  Tony Gorschek,et al.  A method for evaluating rigor and industrial relevance of technology evaluations , 2011, Empirical Software Engineering.

[30]  Blaize Horner Reich,et al.  IT alignment: an annotated bibliography , 2007, J. Inf. Technol..

[31]  Luigi Carro,et al.  Software Quality Metrics and their Impact on Embedded Software , 2008, 2008 5th International Workshop on Model-based Methodologies for Pervasive and Embedded Software.

[32]  Cheng-Ru Wu,et al.  Integrating fuzzy theory and hierarchy concepts to evaluate software quality , 2008, Software Quality Journal.

[33]  Xuanzhe Liu,et al.  SOAR: towards dependable Service-Oriented Architecture via reflective middleware , 2007, Int. J. Simul. Process. Model..

[34]  Mika Mäntylä,et al.  Lightweight Elicitation and Analysis of Software Product Quality Goals: A Multiple Industrial Case Study , 2009, 2009 Third International Workshop on Software Product Management.

[35]  Soumya Simanta,et al.  Experiences in engineering active replication into a traditional three-tiered client-server system , 2008, SERENE '08.

[36]  Steffen Becker,et al.  Automatically improve software architecture models for performance, reliability, and cost using evolutionary algorithms , 2010, WOSP/SIPEW '10.

[37]  Barry W. Boehm,et al.  An Initial Theory of Value-Based Software Engineering , 2006, Value-Based Software Engineering.

[38]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[39]  Leonardo Ensslin,et al.  A Study Case about a Software Project Management Success Metrics , 2009, 2009 33rd Annual IEEE Software Engineering Workshop.

[40]  David B. Knoester,et al.  Plato: a genetic algorithm approach to run-time reconfiguration in autonomic computing systems , 2011, Cluster Computing.

[41]  Mehwish Riaz,et al.  Experiences Conducting Systematic Reviews from Novices' Perspective , 2010, EASE.

[42]  Claes Wohlin,et al.  Software Product Quality: Ensuring a Common Goal , 2009, ICSP.

[43]  Georg Herzwurm,et al.  QFD for customer-focused requirements engineering , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[44]  Pedro Antunes,et al.  Software Requirements Negotiation Using the Software Quality Function Deployment , 2005, CRIWG.

[45]  Claes Wohlin,et al.  A Quality-Driven Decision-Support Method for Identifying Software Architecture Candidates , 2003, Int. J. Softw. Eng. Knowl. Eng..

[46]  Björn Regnell,et al.  Supporting Roadmapping of Quality Requirements , 2008, IEEE Software.

[47]  Björn Regnell,et al.  Introducing Support for Release Planning of Quality Requirements — An Industrial Evaluation of the QUPER Model , 2008, 2008 Second International Workshop on Software Product Management.

[48]  Shari Lawrence Pfleeger,et al.  Software Quality: The Elusive Target , 1996, IEEE Softw..

[49]  M. Sibisi,et al.  A process framework for customising software quality models , 2007, AFRICON 2007.

[50]  Julio Cesar Sampaio do Prado Leite,et al.  On Non-Functional Requirements in Software Engineering , 2009, Conceptual Modeling: Foundations and Applications.

[51]  Claes Wohlin,et al.  An Investigation of a Method for Identifying a Software Architecture Candidate with Respect to Quality Attributes , 2005, Empirical Software Engineering.

[52]  Jihong Pang,et al.  A Fuzzy Synthetic Evaluation Method for Software Quality , 2010, 2010 2nd International Conference on E-business and Information System Security.

[53]  Christian Del Rosso,et al.  Software performance tuning of software product family architectures: Two case studies in the real-time embedded systems domain , 2008, J. Syst. Softw..

[54]  Wouter Joosen,et al.  Measuring the interplay of security principles in software architectures , 2009, ESEM 2009.

[55]  Tony Gorschek,et al.  Quality Requirements in Practice: An Interview Study in Requirements Engineering for Embedded Systems , 2009, REFSQ.

[56]  Aziz Deraman,et al.  Measuring unmeasurable attributes of software quality using Pragmatic Quality Factor , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[57]  Vittorio Cortellessa,et al.  An Architectural Framework for Analyzing Tradeoffs between Software Security and Performance , 2010, ISARCS.

[58]  Mahmut T. Kandemir,et al.  Reliability-centric hardware/software co-design , 2005, Sixth international symposium on quality electronic design (isqed'05).

[59]  Iain Bate.  Systematic approaches to understanding and evaluating design trade-offs , 2008, J. Syst. Softw..