Definitions and approaches to model quality in model-based software development - A review of literature

More attention is paid to the quality of models along with the growing importance of modelling in software development. We performed a systematic review of studies discussing model quality published since 2000 to identify what model quality means and how it can be improved. From forty studies covered in the review, six model quality goals were identified; i.e., correctness, completeness, consistency, comprehensibility, confinement and changeability. We further present six practices proposed for developing high-quality models together with examples of empirical evidence. The contributions of the article are identifying and classifying definitions of model quality and identifying gaps for future research.

[1]  Ivar Jacobson,et al.  The unified modeling language reference manual , 2010 .

[2]  Holger Eichelberger,et al.  Aesthetics of class diagrams , 2002, Proceedings First International Workshop on Visualizing Software for Understanding and Analysis.

[3]  Haruhiko Kaiya,et al.  Model Metrics and Metrics of Model Transformation , 2006 .

[4]  Richard Vdovjak,et al.  Bootstrapping Domain-Specific Model-Driven Software Development within Philips , 2006 .

[5]  Brian Berenbach,et al.  The evaluation of large, complex UML analysis and design models , 2004, Proceedings. 26th International Conference on Software Engineering.

[6]  Parastoo Mohagheghi,et al.  Evaluating Quality in Model-Driven Engineering , 2007, International Workshop on Modeling in Software Engineering (MISE'07: ICSE Workshop 2007).

[7]  R. Mitchell High-Quality Modeling in UML , 2001, TOOLS.

[8]  Reidar Conradi,et al.  Object-Oriented Reading Techniques for Inspection of UML Models - An Industrial Experiment , 2003, ECOOP.

[9]  Dov Dori,et al.  The Model Multiplicity Problem: Experimenting with Real-Time Specification Methods , 2000, IEEE Trans. Software Eng..

[10]  Michel R. V. Chaudron,et al.  Managing Model Quality in UML-Based Software Development , 2005, 13th IEEE International Workshop on Software Technology and Engineering Practice (STEP'05).

[11]  Parastoo Mohagheghi,et al.  A Metamodel for Specifying Quality Models in Model-Driven Engineering , 2008 .

[12]  Miroslaw Staron,et al.  Adopting model driven software development in industry: a case study at two companies , 2006, MoDELS'06.

[13]  Miroslaw Staron,et al.  An empirical study on using stereotypes to improve understanding of UML models , 2004, Proceedings. 12th IEEE International Workshop on Program Comprehension, 2004..

[14]  Laurent Safa The Practice of Deploying DSM Report from a Japanese Appliance Maker Trenches , 2006 .

[15]  Serge Demeyer,et al.  An experimental investigation of UML modeling conventions , 2006, MoDELS'06.

[16]  Keith Phalp,et al.  Improving the quality of use case descriptions: empirical assessment of writing guidelines , 2007, Software Quality Journal.

[17]  Parastoo Mohagheghi,et al.  Towards a Tool-Supported Quality Model for Model-Driven Engineering , 2008 .

[18]  Barbara Paech,et al.  Component-based product line engineering with UML , 2001, Addison Wesley object technology series.

[19]  Parastoo Mohagheghi,et al.  Where Is the Proof? - A Review of Experiences from Applying MDE in Industry , 2008, ECMDA-FA.

[20]  Timothy G. Trucano,et al.  Verification and validation. , 2005 .

[21]  John Krogstie,et al.  Information Systems Engineering: Conceptual Modeling in a quality perspective , 2003 .

[22]  J. P. Andrade Almeida,et al.  Towards an MDA-based development methodology for distributed applications , 2004 .

[23]  David Nelson,et al.  Automated semantic analysis of design models , 2007, MODELS'07.

[24]  Dov Dori,et al.  OPM vs. UML--Experimenting with Comprehension and Construction of Web Application Models , 2004, Empirical Software Engineering.

[25]  Martin Giese,et al.  From Informal to Formal Specifications in UML , 2004, UML.

[26]  Miroslaw Staron,et al.  Case Study on a Process of Industrial MDA Realization -- Determinants of Effectiveness , 2004, Nord. J. Comput..

[27]  Cfj Christian Lange,et al.  Assessing and improving the quality of modeling : a series of empirical studies about the UML , 2007 .

[28]  Keith Phalp,et al.  Replicating the CREWS Use Case Authoring Guidelines Experiment , 2000, Empirical Software Engineering.

[29]  David A. Carrington,et al.  UML Class Diagram Syntax: An Empirical Study of Comprehension , 2001, InVis.au.

[30]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007, IEEE Transactions on Software Engineering.

[31]  Parastoo Mohagheghi,et al.  Developing a Quality Framework for Model-Driven Engineering , 2007, MoDELS Workshops.

[32]  Monique Snoeck,et al.  Implementing Consistency Management Techniques for Conceptual Modeling , 2005 .

[33]  David A. Carrington,et al.  Graph Layout Aesthetics in UML Diagrams: User Preferences , 2002, J. Graph Algorithms Appl..

[34]  H. James Nelson,et al.  Ensuring the quality of conceptual representations , 2007, Software Quality Journal.

[35]  Bernhard Rumpe,et al.  Modeling Languages: Syntax, Semantics and All That Stuff, Part I: The Basic Stuff , 2000 .

[36]  Hans Wegener Balancing Simplicity and Expressiveness : Designing Domain-Specific Models for the Reinsurance Industry , 2004 .

[37]  Bhuvan Unhelkar Verification and Validation for Quality of UML 2.0 Models , 2005 .

[38]  Daniel M. Russell,et al.  Model-driven development within a legacy system: an industry experience report , 2005, 2005 Australian Software Engineering Conference.

[39]  Miroslaw Staron,et al.  Empirical assessment of using stereotypes to improve comprehension of UML models: A set of experiments , 2006, J. Syst. Softw..

[40]  Heather Goldsby,et al.  i2MAP: an incremental and iterative modeling and analysis process , 2007, MODELS'07.

[41]  Michel R. V. Chaudron,et al.  A Visualization Framework for Task-Oriented Modeling Using UML , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[42]  Betty H. C. Cheng,et al.  A general framework for formalizing UML with formal languages , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[43]  Scott W. Ambler,et al.  The Elements of UML(TM) 2.0 Style , 2005 .

[44]  Aniruddha S. Gokhale,et al.  Domain-Specific Modeling , 2008, Handbook of Dynamic System Modeling.

[45]  Arne Sølvberg,et al.  Understanding quality in conceptual modeling , 1994, IEEE Software.

[46]  Bruce Trask,et al.  Using model-driven engineering to complement software product line engineering in developing software defined radio components and applications , 2006, 10th International Software Product Line Conference (SPLC'06).

[47]  Brian Berenbach,et al.  Metrics for model driven requirements development , 2006, ICSE '06.

[48]  Serge Demeyer,et al.  A qualitative investigation of UML modeling conventions , 2006, MoDELS'06.

[49]  Harald C. Gall,et al.  Consistency of business process models and object life cycles , 2006, MoDELS'06.

[50]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[51]  Holger Eichelberger,et al.  Nice class diagrams admit good design? , 2003, SoftVis '03.

[52]  Juha-Pekka Tolvanen,et al.  Domain-Specific Modeling: Enabling Full Code Generation , 2008 .

[53]  Forrest Shull,et al.  Improving Evidence about Software Technologies: A Look at Model-Based Testing , 2008, IEEE Software.