Using Metrics for Assessing the Quality of ASF+SDF Model Transformations

Model transformations are an essential part of Model Driven Engineering and are in many ways similar to traditional software artifacts. Therefore it is necessary to define and evaluate the quality of model transformations. We propose a set of six quality attributes to evaluate the quality of model transformations. We define 27 metrics for ASF+SDF model transformations to predict the quality attributes we propose. Metrics data has been collected from six heterogeneous model transformations automatically. The quality of the same transformations has been evaluated manually by several ASF+SDF experts. We assess whether the automatically collected metrics are appropriate predictors for the quality attributes by correlating the metrics data with the expert data. Based on the measurement results, we identify a set of predicting metrics for each of the quality attributes for model transformations.

[1]  Steffen Becker,et al.  Evaluating Maintainability with Code Metrics for Model-to-Model Transformations , 2010, QoSA.

[2]  Jean Bézivin,et al.  ATL: A model transformation tool , 2008, Sci. Comput. Program..

[3]  Arie van Deursen,et al.  Language Prototyping: An Algebraic Specification Approach , 1996, AMAST Series in Computing.

[4]  Douglas C. Schmidt,et al.  Model-Driven Engineering , 2006 .

[5]  Stuart Kent,et al.  Model Driven Engineering , 2002, IFM.

[6]  Perdita Stevens.  A Simple Game-Theoretic Approach to Checkonly QVT Relations , 2009, ICMT@TOOLS.

[7]  Cfj Christian Lange,et al.  Assessing and improving the quality of modeling : a series of empirical studies about the UML , 2007 .

[8]  van den Brand,et al.  Metrics for model transformations , 2010 .

[9]  Paul Klint,et al.  Compiling language definitions: the ASF+SDF compiler , 2000, TOPL.

[10]  Daniel M. Oppenheimer,et al.  Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power , 2009 .

[11]  Meilir Page-Jones,et al.  The practical guide to structured systems design , 1980 .

[12]  Joost Visser,et al.  Metrication of SDF Grammars , 2005 .

[13]  Jean-Michel Bruel,et al.  Satellite Events at the MoDELS 2005 Conference , 2006 .

[14]  Jochen Ludewig,et al.  Models in software engineering – an introduction , 2003, Software and Systems Modeling.

[15]  Norman E. Fenton,et al.  Software Metrics: A Rigorous Approach , 1991 .

[16]  Barry Boehm,et al.  Characteristics of software quality , 1978 .

[17]  Jordi Cabot,et al.  A metric for measuring the complexity of OCL expressions , 2006 .

[18]  Andy Field,et al.  Discovering statistics using SPSS, 2nd ed. , 2005 .

[19]  Victor R. Basili,et al.  A Validation of Object-Oriented Design Metrics as Quality Indicators , 1996, IEEE Trans. Software Eng..

[20]  Douglas C. Schmidt,et al.  Guest Editor's Introduction: Model-Driven Engineering , 2006, Computer.

[21]  R. Harrison.  Quantifying internal attributes of functional programs , 1993, Inf. Softw. Technol..

[22]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[23]  Arie van Deursen.  An Overview of ASF+SDF , 1996 .

[24]  van den Mgj Mark Brand,et al.  Quality assessment of ATL model transformations using metrics , 2011 .

[25]  Mark van den Brand,et al.  Transforming Process Algebra Models into UML State Machines: Bridging a Semantic Gap? , 2008, ICMT@TOOLS.

[26]  Mark van den Brand,et al.  Repleo: a syntax-safe template engine , 2007, GPCE '07.

[27]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[28]  Frédéric Jouault,et al.  Transforming Models with ATL , 2005, MoDELS.

[29]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[30]  Mark van den Brand,et al.  An exercise in iterative domain-specific language design , 2010, IWPSE-EVOL '10.

[31]  Parastoo Mohagheghi,et al.  Developing a Quality Framework for Model-Driven Engineering , 2007, MoDELS Workshops.

[32]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[33]  Miguel A. Fernández,et al.  MDE Adoption in Industry: Challenges and Success Criteria , 2009, MoDELS.

[34]  Mark van den Brand,et al.  Integrating Textual and Graphical Modelling Languages , 2010, Electron. Notes Theor. Comput. Sci..

[35]  Arie van Deursen,et al.  The ASF+SDF Meta-environment: A Component-Based Language Development Environment , 2001 .