International Conference on Model Driven Engineering Languages and Systems Empirical Studies of Model-driven Engineering (esmde'08) Program Committee on the Quantitative Assessment of Class Model Compositions: an Exploratory Study 1 Preparing Meta-analysis of Metamodel Understandability 11 Empirical

Model composition can be viewed in model-driven engineering as an operation where a set of activities should be performed to merge two input models into a single output model. The latter aggregates syntactical and semantic properties from the original models. However, given the growing heterogeneity of model composition strategies, it is particularly challenging for designers to objectively assess them given a particular problem at hand. The key problem is that there is a lack of canonical set of indicators to quantify harmful properties associated with the output models, such as composition conflicts and modularity anomalies. This paper presents an inquisitive study in order to capture an initial set of metrics for assessing and comparing model composition strategies in two case studies. We apply a number of metrics to quantify different conflict types and modularity properties arising at composite class models produced with override and merge-based strategies. We have observed that some of the quantitative indicators were effective to pinpoint when a model composition strategy is not properly chosen. In some cases, the output models exhibited non-obvious undesirable conflicts and anti-modularity factors.

[1]  Eric Dortmans,et al.  Empirical Investigations in Software Architecture Completeness , 2003 .

[2]  Dietmar Pfahl,et al.  Reporting guidelines for controlled experiments in software engineering , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[3]  H. Hornich Logik der Forschung , 1936 .

[4]  Bruce Powel Douglass Real-Time Design Patterns , 1999 .

[5]  Lionel C. Briand,et al.  A Controlled Experiment for Evaluating Quality Guidelines on the Maintainability of Object-Oriented Designs , 2001, IEEE Trans. Software Eng..

[6]  Igor Ivkovic,et al.  A framework for software architecture refactoring using model transformations and semantic annotations , 2006, Conference on Software Maintenance and Reengineering (CSMR'06).

[7]  D. Mook Classic Experiments in Psychology , 2004 .

[8]  Steffen Zschaler,et al.  Model-Driven Development for Non-functional Properties: Refinement Through Model Transformation , 2004, UML.

[9]  Marcela Genero Metrics For Software Conceptual Models , 2005 .

[10]  Henk Corporaal,et al.  Embedded System Design , 2006 .

[11]  Silvia Mara Abrahão,et al.  A model-driven measurement procedure for sizing web applications: design, automation and validation , 2007, MODELS'07.

[12]  Liming Zhu,et al.  Evaluating guidelines for reporting empirical software engineering studies , 2008, Empirical Software Engineering.

[13]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[14]  Barry W. Boehm,et al.  Quantitative evaluation of software quality , 1976, ICSE '76.

[15]  A. Milton Jenkins,et al.  MIS design variables and decision making performance: A simulation experiment , 1983 .

[16]  Thomas Baar,et al.  Refactoring OCL annotated UML class diagrams , 2005, MoDELS'05.

[17]  Alain Abran,et al.  A framework for the design and verification of software measurement methods , 2008, J. Syst. Softw..

[18]  Andrew Gemino,et al.  A framework for empirical evaluation of conceptual modeling techniques , 2004, Requirements Engineering.

[19]  James Martin,et al.  Rapid Application Development , 1991 .

[20]  Robert P. Bostrom,et al.  Comparing representations with relational and EER models , 1990, Commun. ACM.

[21]  James T. C. Teng,et al.  Effects of Graphical Versus Textual Representation of Database Structure on Query Performance , 1993 .

[22]  Venkataraman Ramesh,et al.  Understanding Conceptual Schemas: Exploring the Role of Application and IS Domain Knowledge , 2006, Inf. Syst. Res..

[23]  Patrick J. Hayes,et al.  Some problems and non-problems in representation theory , 1974 .

[24]  R. Zmud,et al.  Information technology implementation research: a technological diffusion approach , 1990 .

[25]  Patrick Y. K. Chau,et al.  An empirical investigation on factors affecting the acceptance of CASE by systems developers , 1996, Inf. Manag..

[26]  Sonja Wiley-Patton,et al.  Does the extended technology acceptance model apply to physicians , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[27]  Forrest Shull,et al.  Building Knowledge through Families of Experiments , 1999, IEEE Trans. Software Eng..

[28]  Susanne Patig,et al.  A Practical Guide to Testing the Understandability of Notations , 2008, APCCM.

[29]  Mark I. H. Hwang,et al.  The use of meta-analysis in MIS research: promises and problems , 1996, DATB.

[30]  R. Kirk Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[31]  Marcela Fabiana Genero Bocco,et al.  Assessing the capability of internal metrics as early indicators of maintenance effort through experimentation: Research Articles , 2005 .

[32]  Ivica Crnkovic,et al.  Building Reliable Component-Based Software Systems , 2002 .

[33]  Mario Piattini,et al.  A Survey of Metrics for UML Class Diagrams , 2005, J. Object Technol..

[34]  Mayuram S. Krishnan,et al.  Measurement Programs in Software Development: Determinants of Success , 2002, IEEE Trans. Software Eng..

[35]  Michel R. V. Chaudron,et al.  In practice: UML software architecture and design description , 2006, IEEE Software.

[36]  R. Rosenthal,et al.  Meta-analysis: recent developments in quantitative methods for literature reviews. , 2001, Annual review of psychology.

[37]  John R. Anderson Cognitive Psychology and Its Implications , 1980 .

[38]  Oscar Pastor,et al.  Automating the Measurement of Functional Size of Conceptual Models in an MDA Environment , 2008, PROFES.

[39]  Douglas B. Bock,et al.  Accuracy in Modeling with Extended Entity Relationship and Object Oriented Data Models , 1993 .

[40]  Oscar Pastor López,et al.  A requirements engineering approach for object-oriented conceptual modeling , 2003 .

[41]  Jon Martens,et al.  Data and Analysis Center for Software. , 1980 .

[42]  P. Robinson,et al.  Fundamentals of experimental psychology , 1981 .

[43]  Ivan Kurtev,et al.  Adaptability of model transformations , 2005 .

[44]  Heeseok Lee,et al.  A Comparative Study of Conceptual Data Modeling Techniques , 1998, J. Database Manag..

[45]  Janne Merilinna,et al.  A Tool for Quality-Driven Architecture Model Transformation: Master's thesis , 2005 .

[46]  Nelly Condori-Fernández,et al.  Towards a Theoretical Model for Evaluating the Acceptance of Model-driven Measurement Procedures , 2008, SEKE.

[47]  David A. Scanlan Structured flowcharts outperform pseudocode: an experimental comparison , 1989, IEEE Software.

[48]  Ron Weber,et al.  Should Optional Properties Be Used in Conceptual Modelling? A Theory and Three Empirical Tests , 2001, Inf. Syst. Res..

[49]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[50]  Daniel L. Moody,et al.  The method evaluation model: a theoretical model for validating information systems design methods , 2003, ECIS.

[51]  Robert B. Grady,et al.  Practical Software Metrics for Project Management and Process Improvement , 1992 .

[52]  Alain Abran,et al.  A proposed measurement role in the rational unified process and its implementation with ISO 19761: COSMIC-FFP , 2004 .

[53]  Neil A. Ernst,et al.  A Framework for Empirical Evaluation of Model Comprehensibility , 2007, International Workshop on Modeling in Software Engineering (MISE'07: ICSE Workshop 2007).

[54]  Victor R. Basili,et al.  Iterative and incremental developments. a brief history , 2003, Computer.

[55]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[56]  Nelly Condori-Fernández,et al.  An Empirical Study on the Likelihood of Adoption in Practice of a Size Measurement Procedure for Requirements Specification , 2006, 2006 Sixth International Conference on Quality Software (QSIC'06).

[57]  Lionel C. Briand,et al.  Exploring the relationships between design measures and software quality in object-oriented systems , 2000, J. Syst. Softw..

[58]  Prashant Palvia,et al.  The Impact of Conceptual Data Models on End-User Performance , 1992 .

[59]  Barbara Paech,et al.  Component-based product line engineering with UML , 2001, Addison Wesley object technology series.

[60]  Christian Bunse,et al.  Unifying Hardware and Software Components for Embedded System Development , 2004, Architecting Systems with Trustworthy Components.

[61]  Krzysztof Czarnecki,et al.  Feature-based survey of model transformation approaches , 2006, IBM Syst. J..

[62]  Brigitte Jaumard,et al.  A Framework for Quality-Driven Delivery in Distributed Multimedia Systems , 2006, Advanced Int'l Conference on Telecommunications and Int'l Conference on Internet and Web Applications and Services (AICT-ICIW'06).

[63]  Nam-Yong Lee,et al.  An Empirical Study of Software Reuse with Special Attention to Ada , 1997, IEEE Trans. Software Eng..

[64]  Mario Piattini,et al.  Quality-Driven Model Transformations: From Requirements to UML Class Diagrams , 2009 .

[65]  L. R. Rasmussen,et al.  In information retrieval: data structures and algorithms , 1992 .

[66]  Egon Berghout,et al.  The Goal/Question/Metric Method: , 2000 .

[67]  Henry H. Emurian,et al.  Acceptance issues in metrics program implementation , 2005, 11th IEEE International Software Metrics Symposium (METRICS'05).

[68]  Akhilesh Bajaj,et al.  The effect of the number of concepts on the readability of schemas: an empirical study with data models , 2004, Requirements Engineering.

[69]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach , 1982 .

[70]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[71]  Ben Shneiderman,et al.  Experimental investigations of the utility of detailed flowcharts in programming , 1977, CACM.

[72]  Oscar Pastor,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Functional Size Measurement Method for Object-oriented Conceptual Schemas: Design and Evaluation Issues a Functional Size Measurement Method for Object-oriented Conceptual Schemas: Design and Evaluation Issues , 2022 .

[73]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[74]  Hock Chuan Chan Naturalness of Graphical Queries Based on the Entity Relationship Model , 1995 .

[75]  R. Dromey,et al.  A Model for Software Product Quality , 1995, IEEE Trans. Software Eng..

[76]  Mario Piattini,et al.  Building UML class diagram maintainability prediction models based on early metrics , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[77]  Artur Boronat,et al.  Algebraic Specification of a Model Transformation Engine , 2006, FASE.

[78]  Christian Bunse,et al.  Applying a Model-based Approach for Embedded System Development , 2007, 33rd EUROMICRO Conference on Software Engineering and Advanced Applications (EUROMICRO 2007).

[79]  Mario Piattini,et al.  Empirical validation of class diagram metrics , 2002, Proceedings International Symposium on Empirical Software Engineering.

[80]  Natalia Juristo Juzgado,et al.  Basics of Software Engineering Experimentation , 2010, Springer US.

[81]  Mayuram S. Krishnan,et al.  The impact of institutional forces on software metrics programs , 2005, IEEE Transactions on Software Engineering.

[82]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[83]  Marco Torchiano,et al.  The Role of Experience and Ability in Comprehension Tasks Supported by UML Stereotypes , 2007, 29th International Conference on Software Engineering (ICSE'07).