Evaluating the usefulness of a functional size measurement procedure to detect defects in MDD models

Models are key artifacts in Model-Driven Development (MDD) methods. To evaluate the quality of models, defect detection is considered to be a suitable approach, which is usually applied using reading techniques. However, new techniques are required in order to find as many defects as possible. This paper presents a case study to evaluate the usefulness of a Functional Size Measurement (FSM) procedure to detect defects in models of a MDD environment. The results indicate that the FSM is useful in finding all the defects that are related to a defect type as well as finding different defect types than an inspection team does.

[1]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[2]  Oscar Pastor,et al.  Model-driven architecture in practice - a software production environment based on conceptual modeling , 2007 .

[3]  Alain Abran,et al.  Improving Quality of Functional Requirements by Measuring Their Functional Size , 2008, IWSM/Metrikon/Mensura.

[4]  Reidar Conradi,et al.  Object-Oriented Reading Techniques for Inspection of UML Models - An Industrial Experiment , 2003, ECOOP.

[5]  Brian Berenbach,et al.  The evaluation of large, complex UML analysis and design models , 2004, Proceedings. 26th International Conference on Software Engineering.

[6]  Daniel L. Moody,et al.  Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions , 2005, Data Knowl. Eng..

[7]  Forrest Shull,et al.  Detecting defects in object-oriented designs: using reading techniques to increase software quality , 1999, OOPSLA '99.

[8]  Oscar Pastor,et al.  Applying a Functional Size Measurement Procedure for Defect Detection in MDD Environments , 2009, EuroSPI.

[9]  Colin Atkinson,et al.  An experimental comparison of reading techniques for defect detection in UML design documents , 2000, J. Syst. Softw..

[10]  Oscar Pastor,et al.  Towards an accurate functional size measurement procedure for conceptual models in an MDA environment , 2010, Data Knowl. Eng..

[11]  Bran Selic,et al.  The Pragmatics of Model-Driven Development , 2003, IEEE Softw..

[12]  Robert B. France,et al.  Model-driven development using UML 2.0: promises and pitfalls , 2006, Computer.

[13]  Alain Abran,et al.  Functional Requirement Improvements through Size Measurement: A Case Study with Inexperienced Measurers , 2010, 2010 Eighth ACIS International Conference on Software Engineering Research, Management and Applications.

[14]  Michel R. V. Chaudron,et al.  An empirical assessment of completeness in UML designs , 2004, ICSE 2004.