Using a functional size measurement procedure to evaluate the quality of models in MDD environments

Models are key artifacts in Model-Driven Development (MDD) methods. To produce high-quality software by using MDD methods, quality assurance of models is of paramount importance. To evaluate the quality of models, defect detection is considered a suitable approach and is usually applied using reading techniques. However, these reading techniques have limitations and constraints, and new techniques are required to improve the efficiency at finding as many defects as possible. This article presents a case study that has been carried out to evaluate the use of a Functional Size Measurement (FSM) procedure in the detection of defects in models of an MDD environment. To do this, we compare the defects and the defect types found by an inspection group with the defects and the defect types found by the FSM procedure. The results indicate that the FSM is useful since it finds all the defects related to a specific defect type, it finds different defect types than an inspection group, and it finds defects related to the correctness and the consistency of the models.

[1]  Biagio Mazzi,et al.  About the Web Site , 2013 .

[2]  A. Abran,et al.  The COSMIC Functional Size Measurement Method version 3.0, Measurement Manual , 2007 .

[3]  Torsten Fink,et al.  An MDA approach to Access Control Specifications Using MOF and UML Profiles , 2004, VODCA@FOSAD.

[4]  Colin Robson,et al.  Real World Research: A Resource for Social Scientists and Practitioner-Researchers , 1993 .

[5]  Marín Campusano,et al.  Functional Size Measurement and Model Verification for Software Model-Driven Developments: A COSMIC-based Approach , 2011 .

[6]  Brian Berenbach,et al.  The evaluation of large, complex UML analysis and design models , 2004, Proceedings. 26th International Conference on Software Engineering.

[7]  Parastoo Mohagheghi,et al.  Evaluating Quality in Model-Driven Engineering , 2007, International Workshop on Modeling in Software Engineering (MISE'07: ICSE Workshop 2007).

[8]  Hassan Gomaa,et al.  Designing concurrent, distributed, and real-time applications with UML , 2000, ICSE.

[9]  Reidar Conradi,et al.  Object-Oriented Reading Techniques for Inspection of UML Models - An Industrial Experiment , 2003, ECOOP.

[10]  Oscar Pastor,et al.  Using UML as a Domain-Specific Modeling Language: A Proposal for Automatic Generation of UML Profiles , 2009, CAiSE.

[11]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[12]  Jean Hartley,et al.  Case study research , 2004 .

[13]  Oscar Pastor,et al.  OASIS: An Object-Oriented Specification Language , 1992, CAiSE.

[14]  Oscar Pastor,et al.  Communication Analysis: A Requirements Engineering Method for Information Systems , 2009, CAiSE.

[15]  R. Yin Case Study Research: Design and Methods , 1984 .

[16]  Oscar Pastor,et al.  Model-driven architecture in practice - a software production environment based on conceptual modeling , 2007 .

[17]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[18]  Beatriz Marín,et al.  Measuring the Functional Size of Conceptual Models in an MDA Environment , 2008, CAiSE Forum.

[19]  Narasimha Bolloju,et al.  Analyzing the Quality of Domain Models Developed by Novice Systems Analysts , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[20]  Oscar Pastor,et al.  Linking UML and MDD through UML Profiles: a Practical Approach based on the UML Association , 2010, J. Univers. Comput. Sci..

[21]  Theda McGrew To , 1997, Neurology.

[22]  John Lane,et al.  IEEE Standard Computer Dictionary: Compilation of IEEE Standard Computer Glossaries , 1991 .

[23]  Arne Sølvberg,et al.  Understanding quality in conceptual modeling , 1994, IEEE Software.

[24]  Michel R. V. Chaudron,et al.  MetricViewEvolution: UML-based Views for Monitoring Model Evolution and Quality , 2007, 11th European Conference on Software Maintenance and Reengineering (CSMR'07).

[25]  Oscar Pastor,et al.  A Tool for Automatic Defect Detection in Models Used in Model-Driven Engineering , 2010, 2010 Seventh International Conference on the Quality of Information and Communications Technology.

[26]  Oscar Pastor,et al.  Towards an accurate functional size measurement procedure for conceptual models in an MDA environment , 2010, Data Knowl. Eng..

[27]  Douglas C. Schmidt,et al.  Guest Editor's Introduction: Model-Driven Engineering , 2006, Computer.

[28]  Bran Selic,et al.  The Pragmatics of Model-Driven Development , 2003, IEEE Softw..

[29]  Oscar Pastor,et al.  Requirements Engineering-Based Conceptual Modelling , 2002, Requirements Engineering.

[30]  Peri L. Tarr,et al.  Model-driven development : The good , the bad , and the ugly & , 2006 .

[31]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[32]  Michel R. V. Chaudron,et al.  An empirical assessment of completeness in UML designs , 2004, ICSE 2004.

[33]  Bran Selic,et al.  A Systematic Approach to Domain-Specific Language Design Using UML , 2007, 10th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC'07).

[34]  Chris Dollin,et al.  Object-oriented development: the fusion method , 1994 .

[35]  Robert B. France,et al.  Model-driven development using UML 2.0: promises and pitfalls , 2006, Computer.

[36]  Alain Abran,et al.  Functional Requirement Improvements through Size Measurement: A Case Study with Inexperienced Measurers , 2010, 2010 Eighth ACIS International Conference on Software Engineering Research, Management and Applications.

[37]  Izak Benbasat,et al.  The Case Research Strategy in Studies of Information Systems , 1987, MIS Q..

[38]  Brian Henderson-Sellers,et al.  A Unified Modelling Language without referential redundancy , 2005, Data Knowl. Eng..

[39]  Oscar Pastor,et al.  Linking Goal-Oriented Requirements and Model-Driven Development , 2010, Intentional Perspectives on Information Systems Engineering.

[40]  Mary Bradley,et al.  Working Knowledge: How Organizations Manage What They Know , 2000 .

[41]  Umesh Bellur,et al.  On OO Design Consistency in Iterative Development , 2006, Third International Conference on Information Technology: New Generations (ITNG'06).

[42]  Antonio Vallecillo,et al.  WebML modelling in UML , 2007, IET Softw..

[43]  Daniel L. Moody,et al.  Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions , 2005, Data Knowl. Eng..

[44]  Forrest Shull,et al.  Detecting defects in object-oriented designs: using reading techniques to increase software quality , 1999, OOPSLA '99.

[45]  Forrest Shull,et al.  Using the ISO/IEC 9126 product quality model to classify defects: A controlled experiment , 2012, EASE.

[46]  Oscar Pastor,et al.  Automating the Measurement of Functional Size of Conceptual Models in an MDA Environment , 2008, PROFES.

[47]  Colin Atkinson,et al.  An experimental comparison of reading techniques for defect detection in UML design documents , 2000, J. Syst. Softw..

[48]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[49]  Oscar Pastor,et al.  Applying a Functional Size Measurement Procedure for Defect Detection in MDD Environments , 2009, EuroSPI.

[50]  Kirsten Berkenkötter,et al.  Reliable UML Models and Profiles , 2008, SSV.

[51]  Giovanni Denaro,et al.  ACM Transactions on Software Engineering and Methodology : Volume 22, Nomor 4, 2013 , 2014 .

[52]  Colin Atkinson,et al.  Adapting the Fusion Process to Support the Unified Modeling Language , 1998 .

[53]  Benkt Wangler,et al.  Information Systems Engineering: What Is It? , 2005, CAiSE Workshops.

[54]  Thomas H. Davenport,et al.  Book review:Working knowledge: How organizations manage what they know. Thomas H. Davenport and Laurence Prusak. Harvard Business School Press, 1998. $29.95US. ISBN 0‐87584‐655‐6 , 1998 .

[55]  Oscar Pastor,et al.  Design of a Functional Size Measurement Procedure for a Model-Driven Software Development Method * , 2007 .

[56]  Alain Abran,et al.  Improving Quality of Functional Requirements by Measuring Their Functional Size , 2008, IWSM/Metrikon/Mensura.

[57]  Stuart Kent,et al.  Model Driven Engineering , 2002, IFM.

[58]  Alexander Egyed,et al.  Instant consistency checking for the UML , 2006, ICSE.