Towards Benchmarking Evolution Support in Model-to-Text Transformation Systems

In model-driven development, an evolving metamodel as part of a changing software system requires the adaptation of interrelated artifacts, such as, model-to-text (M2T) transformation speci cations. In this paper, we propose a de nition for a standard problem to evaluate the evolution support in M2T transformation systems. The objective of the standard problem is to allow for benchmarking of multiple evolution-support techniques for M2T transformations. For this, we selected an existing, real-world software application acting as the basis for the standard-problem de nition, describe a metamodel-evolution scenario (migration), and de ne a measurement plan to benchmark di erent implementations (thus, making them comparable). The applicability of the standard problem de nition is exempli ed by benchmarking an approach of higher-order rewriting M2T generator templates.

[1]  Luís Ferreira Pires,et al.  Performance in Model Transformations: Experiments with ATL and QVT , 2011, ICMT@TOOLS.

[2]  Manuel Wimmer,et al.  A Benchmark for Model Matching Systems: The Heterogeneous Metamodel Case , 2013, Softwaretechnik-Trends.

[3]  Egon Berghout,et al.  The Goal/Question/Metric method: a practical guide for quality improvement of software development , 1999 .

[4]  Bernhard Hoisl,et al.  Natural-language scenario descriptions for testing core language models of domain-specific languages , 2014, 2014 2nd International Conference on Model-Driven Engineering and Software Development (MODELSWARD).

[5]  Jean Bézivin,et al.  On the Use of Higher-Order Model Transformations , 2009, ECMDA-FA.

[6]  M. Wimmer,et al.  On using Inplace Transformations for Model Co-evolution , 2010 .

[7]  Hannes Schwarz,et al.  Model-Driven Software Development , 2013 .

[8]  Juri Di Rocco,et al.  Dealing with the Coupled Evolution of Metamodels and Model-to-text Transformations , 2014, ME@MoDELS.

[9]  Bernhard Hoisl,et al.  Higher-order Rewriting of Model-to-Text Templates for Integrating Domain-specific Modeling Languages , 2013, MODELSWARD.

[10]  Davide Di Ruscio,et al.  Coupled Evolution in Model-Driven Engineering , 2012, IEEE Software.

[11]  Manuel Wimmer,et al.  A Benchmark for Conflict Detection Components of Model Versioning Systems , 2013, Softwaretechnik-Trends.

[12]  Bernhard Hoisl,et al.  TOWARDS A SYSTEMATIC INTEGRATION OF MOF/UML-BASED DOMAIN-SPECIFIC MODELING LANGUAGES , 2012 .

[13]  Marcel van Amstel.  The Right Tool for the Right Job: Assessing Model Transformation Quality , 2010, 2010 IEEE 34th Annual Computer Software and Applications Conference Workshops.

[14]  Philip H. Newcomb,et al.  Information Systems Transformation: Architecture-Driven Modernization Case Studies , 2010 .

[15]  Juan de Lara,et al.  Engineering model transformations with transML , 2011, Software & Systems Modeling.

[16]  Steffen Becker,et al.  Evaluating Maintainability with Code Metrics for Model-to-Model Transformations , 2010, QoSA.

[17]  van den Mgj Mark Brand,et al.  Quality assessment of ATL model transformations using metrics , 2011 .

[18]  Bernhard Schätz,et al.  Graph and model transformation tools for model migration , 2014, Software & Systems Modeling.

[19]  Gerti Kappel,et al.  Towards an expressivity benchmark for mappings based on a systematic classification of heterogeneities , 2010, MDI '10.

[20]  Laurie A. Williams,et al.  Validating software metrics: A spectrum of philosophies , 2012, TSEM.

[21]  Bernhard Hoisl.  Integration and Test of MOF/UML-based Domain-specific Modeling Languages , 2014 .

[22]  Jürgen Dingel,et al.  Model Transformations for Migrating Legacy Models: An Industrial Case Study , 2012, ECMFA.

[23]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[24]  Walter Cazzola,et al.  DSL evolution through composition , 2010, RAM-SE@ECOOP.

[25]  Tom Verhoeff,et al.  Assessing the quality of model-comparison tools: a method and a benchmark data set , 2011, IWMCP '11.

[26]  Bernhard Hoisl,et al.  Extracting reusable design decisions for UML-based domain-specific languages: A multi-method study , 2016, J. Syst. Softw..

[27]  Volker Gruhn,et al.  Model-Driven Software Development , 2005 .

[28]  Roberto Erick Lopez-Herrejon,et al.  A Standard Problem for Evaluating Product-Line Methodologies , 2001, GCSE.