Systematic construction of quality models for cots-based systems

In this thesis we present the COSTUME method aimed at the construction of COTS-based system quality models, The method describes a set of activities which allow the construction of system level quality models, by composing individual quality modes of its constitutive system actors. The method is supported by a set of knowledge repositories, which are intended to abstract and store several of the deliverables obtained in the process and allow for their future reuse. The method proposes four main activities to drive quality models construction with a well defined rationale which increases the efficiency of the process whilst improving the reliability of the deliverables. Resulting quality models include quality features that have been proposed in the literature and also refine some of them. Quality models are constituted by a set of high-level quality characteristics (the ones proposed in the ISO/IEC 9126-1 quality standard), and hierarchies of subcharacteristics and quality attributes (basic and derived), for which COTS systems can be evaluated using the appropriated metrics. Relationships among quality features (other than hierarchical ones), are also included in the quality models to improve their applicability. The first activity of COSTUME is intended to define a model of the system and its environment; to do so, agent modeling techniques are used, namely Yu's [Yu95] i* modeling approach. In the second activity, five steps are used to explore and detail the insides of the system. An i* SR system model is constructed and the goals and sub-goals included in the model are grouped into system actors. System actors define atomic COTS domains for which COTS components can be identified. System actors are not expected to be mapped in one-to-one base to COTS components; the main purpose for their identification, in our case, is that they define the domains for which individual quality models are to be constructed. Activity 3 of the COSTU

[1]  Michael Uschold,et al.  The Enterprise Ontology , 1998, The Knowledge Engineering Review.

[2]  J. P. Carvallo,et al.  Reaching an agreement on COTS quality through the use of quality models , 2004, ICSE 2004.

[3]  Scott Hamilton,et al.  NASA's mission reliable , 2004, Computer.

[4]  Luigi Buglione,et al.  AN INTEGRATED GRAPHICAL ASSESSMENT FOR MANAGING SOFTWARE PRODUCT QUALITY , 2002 .

[5]  Mario R. Barbacci,et al.  Steps in an Architecture Tradeoff Analysis Method: Quality Attribute Models and Analysis , 1998 .

[6]  Jyrki Kontio,et al.  A case study in applying a systematic method for COTS selection , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[7]  Craig Larman,et al.  Applying UML and Patterns: An Introduction to Object-Oriented Analysis and Design and the Unified Process , 2001 .

[8]  Neil A. M. Maiden,et al.  Modelling Component Dependencies to Inform Their Selection , 2003, ICCBSS.

[9]  Carme Quer,et al.  DesCOTS: a software system for selecting COTS components , 2004, Proceedings. 30th Euromicro Conference, 2004..

[10]  Barbara A. Kitchenham,et al.  The SQUID approach to defining a quality model , 1997, Software Quality Journal.

[11]  Santiago Comella-Dorda,et al.  A Process for COTS Software Product Evaluation , 2002, ICCBSS.

[12]  Alain Abran,et al.  A quality factor for software , 1999 .

[13]  Carme Quer,et al.  COSTUME: Um Método para la Combinación de Modelos de Calidad , 2003, WER.

[14]  John Mylopoulos,et al.  Information systems as social structures , 2001, FOIS.

[15]  Roel Wieringa,et al.  Requirements Engineering: Frameworks for Understanding , 1996 .

[16]  V. Basili Software modeling and measurement: the Goal/Question/Metric paradigm , 1992 .

[17]  R. Geoff Dromey,et al.  A Model for Software Product Quality , 1995, IEEE Trans. Software Eng..

[18]  Carme Quer,et al.  Building and using quality models for complex software domains , 2003 .

[19]  Alessandro Bianchi,et al.  Quality models reuse: experimentation on field , 2002, Proceedings 26th Annual International Computer Software and Applications.

[20]  Eric S. K. Yu,et al.  Towards modelling and reasoning support for early-phase requirements engineering , 1997, Proceedings of ISRE '97: 3rd IEEE International Symposium on Requirements Engineering.

[21]  Xavier Franch,et al.  Using Quality Models in Software Package Selection , 2003, IEEE Softw..

[22]  Shari Lawrence Pfleeger,et al.  Software Quality: The Elusive Target , 1996, IEEE Softw..

[23]  Lars Lundberg,et al.  QUALITY ATTRIBUTES IN SOFTWARE ARCHITECTURE DESIGN , 1999 .

[24]  Hermann Kaindl,et al.  Reusing single system requirements from application family requirements , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[25]  Victor R. Basili,et al.  Software development: a paradigm for the future , 1989, [1989] Proceedings of the Thirteenth Annual International Computer Software & Applications Conference.

[26]  Carl G. Davis,et al.  A Hierarchical Model for Object-Oriented Design Quality Assessment , 2002, IEEE Trans. Software Eng..

[27]  Fausto Giunchiglia,et al.  Tropos: An Agent-Oriented Software Development Methodology , 2004, Autonomous Agents and Multi-Agent Systems.

[28]  Nicholas R. Jennings,et al.  The Gaia Methodology for Agent-Oriented Analysis and Design , 2000, Autonomous Agents and Multi-Agent Systems.

[29]  Carme Quer,et al.  COSTUME: a method for building quality models for composite COTS-based software systems , 2004, Fourth International Conference onQuality Software, 2004. QSIC 2004. Proceedings..

[30]  Carme Quer,et al.  QM: a tool for building software quality models , 2004, Proceedings. 12th IEEE International Requirements Engineering Conference, 2004..

[31]  J. P. Carvallo On the use of quality models for COTS evaluation , 2004, ICSE 2004.

[32]  Alain Abran,et al.  Initial Modeling of the Measurement Concepts in the ISO Vocabulary of Terms in Metrology , 2002 .

[33]  Neil A. M. Maiden,et al.  Driving Component Selection through Actor-Oriented Models and Use Cases , 2004, ICCBSS.

[34]  Mark Klein,et al.  Attribute-Based Architectural Styles , 1999 .

[35]  Xavier Franch,et al.  A quality-model-based approach for describing and evaluating software packages , 2002, Proceedings IEEE Joint International Conference on Requirements Engineering.

[36]  Souheil Khaddaj,et al.  An essential views model for Software Quality Assurance , 1999 .

[37]  Marco Torchiano,et al.  Characterization of a Taxonomy for Business Applications and the Relationships Among Them , 2004, ICCBSS.

[38]  Donald Firesmith,et al.  Using Quality Models to Engineer Quality Requirements , 2003, J. Object Technol..

[39]  Arnaldo Dias Belchior,et al.  Quality Characteristics for Software Components: Hierarchy and Quality Guides , 2003, Component-Based Software Quality.

[40]  Carme Quer,et al.  Defining a Quality Model for Mail Servers , 2003, ICCBSS.

[41]  H. D. Rombach,et al.  The Goal Question Metric Approach , 1994 .

[42]  Marco Torchiano,et al.  Building sound COTS products taxonomies , 2004 .

[43]  Antonio Vallecillo,et al.  A Survey on the Quality Information Provided by Software Component Vendors , 2003 .

[44]  Paul Clements,et al.  ATAM: Method for Architecture Evaluation , 2000 .

[45]  Barbara A. Kitchenham,et al.  A Method for Software Quality Planning, Control, and Evaluation , 1999, IEEE Softw..

[46]  Carme Quer,et al.  A Comparative Analysis of i*-Based Agent-Oriented Modeling Languages , 2005, SEKE.

[47]  Eric Yu Strategic modelling for enterprise integration , 1999 .

[48]  Carme Quer,et al.  A Framework for Selecting Workflow Tools in the Context of Composite Information Systems , 2004, DEXA.

[49]  Rajkumar Buyya,et al.  High Performance Cluster Computing: Architectures and Systems , 1999 .

[50]  Stephen Fickas,et al.  Goal-Directed Requirements Acquisition , 1993, Sci. Comput. Program..

[51]  Ernest Wallmuller Software Quality , 1994 .

[52]  Paolo Donzelli,et al.  A unified model of dependability: capturing dependability in context , 2004, IEEE Software.

[53]  Mark S. Fox,et al.  The TOVE Project Towards a Common-Sense Model of the Enterprise , 1992, IEA/AIE.

[54]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[55]  Norman E. Fenton Software Quality: Theory and Management, by Alan C. Gillies, Chapman and Hall, 1992 (Book Review) , 1992, Softw. Test. Verification Reliab..

[56]  Christopher Alexander,et al.  The Timeless Way of Building , 1979 .

[57]  H. D. Rombach,et al.  THE EXPERIENCE FACTORY , 1999 .

[58]  L. Segil Intelligent Business Alliances: How to Profit Using Today's Most Important Strategic Tool , 1996 .

[59]  Adam Trendowicz,et al.  Quality Modeling for Software Product Lines , 2003 .

[60]  Marco Torchiano,et al.  COTS products characterization , 2002, SEKE '02.

[61]  Rob Pooley,et al.  The Capability Maturity Model for Software , 2004 .

[62]  G. Horgan,et al.  Factors in Software Quality for Advanced Computer Architectures , 2001 .

[63]  Carme Quer,et al.  Using Quality Models for Assessing COTS Selection , 2002, WER.

[64]  David E. Avison,et al.  Action research , 1999, CACM.

[65]  P. Botella ISO / IEC 9126 in practice : what do we need to know ? , 2004 .

[66]  Marco Torchiano,et al.  Definition and Classification of COTS: A Proposal , 2002, ICCBSS.

[67]  Amador Durán Toro Un entorno metodológico de ingeniería de requisitos para sistemas de información , 2000 .

[68]  Linda H. Rosenberg,et al.  A Software Quality Model and Metrics for Identifying Project Risks and Assessing Software Quality , 1996 .

[69]  M. Y. Yoshino,et al.  Strategic Alliances: An Entrepreneurial Approach to Globalization , 1995 .

[70]  Javier Franch Gutiérrez,et al.  Towards the definition of a quality model for mail servers , 2002 .

[71]  Hyoseob Kim,et al.  SCARLET: Light-Weight Component Selection in BANKSEC , 2003 .

[72]  Carme Quer,et al.  A Quality Model for Requirements Management Tools , 2005 .

[73]  Scott A. DeLoach,et al.  Analysis and Design using MaSE and agentTool , 2001 .

[74]  R. G. Dromey,et al.  Cornering the Chimera , 1996, IEEE Softw..

[75]  Francisca Losavio,et al.  Quality Models to Design Software Architecture , 2002, J. Object Technol..

[76]  Khaled El Emam,et al.  Spice: The Theory and Practice of Software Process Improvement and Capability Determination , 1997 .

[77]  Edward B. Allen,et al.  PREDICTING FAULT-PRONE SOFTWARE MODULES IN EMBEDDED SYSTEMS WITH CLASSIFICATION TREES , 2002 .

[78]  Henry Mintzberg,et al.  Structure in Fives: Designing Effective Organizations , 1983 .

[79]  Fausto Giunchiglia,et al.  The tropos software development methodology: processes, models and diagrams , 2002, AAMAS '02.

[80]  Alexander Egyed,et al.  Identifying requirements conflicts and cooperation: how quality attributes and automated traceability can help , 2004, IEEE Software.

[81]  Amar Ramdane-Cherif,et al.  Quality Characteristics for Software Architecture , 2003, J. Object Technol..

[82]  Jordi Conesa,et al.  Building Conceptual Schemas by Refining General Ontologies , 2003, DEXA.

[83]  Javier Franch Gutiérrez,et al.  Análisis comparativo de lenguajes de modelado orientados a objetivos basados en i , 2004 .

[84]  Ronan Fitzpatrick,et al.  Usable Software and Its Attributes: A Synthesis of Software Quality, European Community Law and Human-Computer Interaction , 1998, BCS HCI.

[85]  Robert B. Grady,et al.  Software Metrics: Establishing a Company-Wide Program , 1987 .

[86]  Barry Boehm,et al.  Aids for Identifying Conflicts Among Quality Requirements , 1996 .

[87]  Alistair Cockburn,et al.  Writing Effective Use Cases , 2000 .

[88]  Tom Gilb,et al.  Principles of software engineering management , 1988 .

[89]  Richard A. Watts Measuring software quality , 1987 .

[90]  Jeffrey M. Voas Software's Secret Sauce: The "-ilities" , 2004, IEEE Softw..

[91]  Jeff Tian Quality-evaluation models and measurements , 2004, IEEE Software.