An ontology-based approach for integrating tools supporting the software measurement process

Abstract Context: Software measurement is a fundamental practice to support process improvement and project management, since it provides useful data for decision making at both organizational and project levels. Due to the nature of software measurement activities, the use of computational supporting tools is essential. Software measurement can be performed in the context of various software processes and these processes generally have different supporting tools. Thus, it is common to use several tools to allow collecting data regarding the processes. Tools are usually developed at different time, by different teams and without concern for integration. As a result, organizations have to deal with integration issues to enable communication between tools and to properly support the measurement process. A key factor for integration is that tools share a common understanding regarding the meaning of the exchanged terms and services. In other words, it is important to deal with integration not only at the syntactic level, but also at the semantic level. Among the instruments used to address semantics, ontologies have been acknowledged as an important means to address semantic integration. Objective: This paper presents the Ontology-Based Approach for Measurement Systems Integration (OBA-MSI), an approach that uses ontologies as a basis to integrate tools aiming at supporting the software measurement process. Method: OBA-MSI was developed following the Design Science Research paradigm. To evaluate OBA-MSI, we carried out a case study in which we used the approach to integrate tools for a real software development organization. After that, we applied a survey to get feedback from users of the integrated solution. Results: The users stated that the integrated solution obtained from applying OBA-MSI properly supported the software measurement process and added value to the organization, providing more benefits than using the tools in isolation. Conclusions: The use of OBA-MSI to aid tools integration helps deal with semantic conflicts and contributes to obtain a proper support to the software measurement process.

[1]  Heiner Stuckenschmidt,et al.  Ontology-Based Integration of Information - A Survey of Existing Approaches , 2001, OIS@IJCAI.

[2]  A. Dias-Neto,et al.  0006/2011 - Threats to Validity in Search-based Software Engineering Empirical Studies , 2011 .

[3]  Ricardo de Almeida Falbo,et al.  Foundational Ontologies for Semantic Integration in EAI: A Systematic Literature Review , 2013, I3E.

[4]  Adilson Marques da Cunha,et al.  Software Product Measurement and Analysis in a Continuous Integration Environment , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[5]  William A. Florac,et al.  Measuring the Software Process: Statistical Process Control for Software Process Improvement , 1999 .

[6]  Monalessa Perini Barcellos,et al.  Integration of Software Measurement Supporting Tools: A Mapping Study , 2015, ICSE 2015.

[7]  William A. Florac,et al.  Goal-Driven Software Measurement. A Guidebook. , 1996 .

[8]  Bora Caglayan,et al.  Dione: an integrated measurement and defect prediction solution , 2012, SIGSOFT FSE.

[9]  Ricardo de Almeida Falbo,et al.  Models for Representing Task Ontologies , 2008, WONTO.

[10]  Saïd Izza,et al.  Integration of industrial information systems: from syntactic to semantic integration approaches , 2009, Enterp. Inf. Syst..

[11]  Egon Berghout,et al.  The Goal/Question/Metric method: a practical guide for quality improvement of software development , 1999 .

[12]  Ricardo de Almeida Falbo,et al.  An Ontology-Based Approach for Semantic Integration , 2010, 2010 14th IEEE International Enterprise Distributed Object Computing Conference.

[13]  Reiner R. Dumke,et al.  The 3C approach for Agile Quality Assurance , 2012, 2012 3rd International Workshop on Emerging Trends in Software Metrics (WETSoM).

[14]  Lech Madeyski,et al.  Software Measurement and Defect Prediction with Depress Extensible Framework , 2014 .

[15]  Ana Regina Cavalcanti da Rocha,et al.  A strategy for preparing software organizations for statistical process control , 2013, Journal of the Brazilian Computer Society.

[16]  Yanbo Han,et al.  A Unified Data and Service Integration Approach for Dynamic Business Collaboration , 2012, 2012 IEEE First International Conference on Services Economics.

[17]  Norman E. Fenton,et al.  Software metrics: roadmap , 2000, ICSE '00.

[18]  I. Kh. Shmain,et al.  On ontology , 2007, Automatic Documentation and Mathematical Linguistics.

[19]  Martin Bichler,et al.  Design science in information systems research , 2006, Wirtschaftsinf..

[20]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[21]  Marinos Themistocleous,et al.  Evaluating the integration of supply chain information systems: A case study , 2004, Eur. J. Oper. Res..

[22]  Giancarlo Guizzardi,et al.  Grounding Software Domain Ontologies in the Unified Foundational Ontology (UFO): The case of the ODE Software Process Ontology , 2008, CIbSE.

[23]  Maliheh Heydarpour Shahrezaei,et al.  Ontology Based Information Integration: A Survey , 2019, ArXiv.

[24]  Giancarlo Guizzardi,et al.  Using a Foundational Ontology for Reengineering a Software Process Ontology , 2011, J. Inf. Data Manag..

[25]  Roel Wieringa,et al.  Requirements engineering paper classification and evaluation criteria: a proposal and a discussion , 2005, Requirements Engineering.

[26]  H. D. Rombach,et al.  The Goal Question Metric Approach , 1994 .

[27]  Luigi Lavazza Providing Automated Support for the GQM Measurement Process , 2000, IEEE Softw..

[28]  Monalessa Perini Barcellos,et al.  Using a Foundational Ontology for Reengineering a Software Enterprise Ontology , 2009, ER Workshops.

[29]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[30]  Monalessa Perini Barcellos,et al.  Tools Integration for Supporting Software Measurement: A Systematic Literature Review , 2015 .

[31]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[32]  Monalessa Perini Barcellos,et al.  A software measurement task ontology , 2013, SAC '13.

[33]  William A. Florac,et al.  Practical Software Measurement: Measuring for Process Management and Improvement, , 1997 .

[34]  Ricardo de Almeida Falbo,et al.  A Panorama of the Semantic EAI Initiatives and the Adoption of Ontologies by these Initiatives , 2013, IWEI.

[35]  Jeff Tian,et al.  Tool support for software measurement, analysis and improvement , 1997, J. Syst. Softw..

[36]  Eric Mayer,et al.  Practical Software Measurement Objective Information For Decision Makers , 2016 .

[37]  Giancarlo Guizzardi,et al.  On Ontology, ontologies, Conceptualizations, Modeling Languages, and (Meta)Models , 2007, DB&IS.

[38]  Giancarlo Guizzardi,et al.  Ontological foundations for structural conceptual models , 2005 .

[39]  Baris Özkan,et al.  ASSIST: An Integrated Measurement Tool , 2013, 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement.

[40]  Harald C. Gall,et al.  SOFAS: A Lightweight Architecture for Software Analysis as a Service , 2011, 2011 Ninth Working IEEE/IFIP Conference on Software Architecture.

[41]  Jan Magott,et al.  QualitySpy: a framework for monitoring software development processes , 2012 .

[42]  François B. Vernadat,et al.  Interoperable enterprise systems: Principles, concepts, and methods , 2007, Annu. Rev. Control..

[43]  Wenjing Yan,et al.  A Web Services-enabled B2B integration approach for SMEs , 2008, INDIN 2008.

[44]  Stanislav Pokraev,et al.  Model-driven semantic integration of service-oriented applications , 2009 .

[45]  Christof Ebert,et al.  Software measurement - establish, extract, evaluate, execute , 2007 .

[46]  Seija Komi-Sirviö,et al.  Measurement automation: methodological background and practical solutions a multiple case study , 2001, Proceedings Seventh International Software Metrics Symposium.

[47]  Sunita Chulani,et al.  Metrics for managing customer view of software quality , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[48]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[49]  Antonio Vallecillo,et al.  An Ontology for Software Measurement , 2006, Ontologies for Software Engineering and Software Technology.