Where Is the Proof? - A Review of Experiences from Applying MDE in Industry

Model-Driven Engineering (MDE) has been promoted as a solution to handle the complexity of software development by raising the abstraction level and automating labor-intensive and error-prone tasks. However, few efforts have been made at collecting evidence to evaluate its benefits and limitations, which is the subject of this review. We searched several publication channels in the period 2000 to June 2007 for empirical studies on applying MDE in industry, which produced 25 papers for the review. Our findings include industry motivations for investigating MDE and the different domains it has been applied to. In most cases the maturity of third-party tool environments is still perceived as unsatisfactory for large-scale industrial adoption. We found reports of improvements in software quality and of both productivity gains and losses, but these reports were mainly from small-scale studies. There are a few reports on advantages of applying MDE in larger projects, however, more empirical studies and detailed data are needed to strengthen the evidence. We conclude that there is too little evidence to allow generalization of the results at this stage.

[1]  Thomas Weigert.  Practical experiences in using model-driven engineering to develop trustworthy computing systems , 2006, IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06).

[2]  Steve Anonsen.  Experiences in Modeling for a Domain Specific Language , 2004, UML Satellite Activities.

[3]  Reidar Conradi,et al.  Quality, productivity and economic benefits of software reuse: a review of industrial studies , 2007, Empirical Software Engineering.

[4]  Frank Weil,et al.  Model-Driven engineering in a large industrial context — motorola case study , 2005, MoDELS'05.

[5]  Stefano Ceri,et al.  Model-driven design of service-enabled web applications , 2005, SIGMOD '05.

[6]  Thomas Fritz,et al.  Using Domain Driven Development for Monitoring Distributed Systems , 2005, ECMDA-FA.

[7]  Chris Raistrick.  Applying MDA and UML in the Development of a Healthcare System , 2004, UML Satellite Activities.

[8]  Hans Wegener,et al.  Agility in Model-Driven Software Development ? Implications for Organization , Process , and Architecture , 2002 .

[9]  Laurent Safa.  The Practice of Deploying DSM Report from a Japanese Appliance Maker Trenches , 2006 .

[10]  Miroslaw Staron,et al.  Adopting model driven software development in industry: a case study at two companies , 2006, MoDELS'06.

[11]  Josephine Micallef,et al.  Experience with a model-driven approach for enterprise-wide interface specification and XML schema generation , 2003, Seventh IEEE International Enterprise Distributed Object Computing Conference, 2003. Proceedings..

[12]  Miroslaw Staron,et al.  Case Study on a Process of Industrial MDA Realization -- Determinants of Effectiveness , 2004, Nord. J. Comput..

[13]  Daniel M. Russell,et al.  Model-driven development within a legacy system: an industry experience report , 2005, 2005 Australian Software Engineering Conference.

[14]  Arend Rensink.  Model Driven Architecture - Foundations and Applications, 5th European Conference, ECMDA-FA 2009, Enschede, The Netherlands, June 23-26, 2009. Proceedings , 2009, ECMDA-FA.

[15]  Mariano Belaunde,et al.  Applying MDA to Voice Applications: An Experience in Building an MDA Tool Chain , 2005, ECMDA-FA.

[16]  Mark Brörkens,et al.  Definition and Generation of Data Exchange Formats in AUTOSAR , 2006, ECMDA-FA.

[17]  Tony Bloomfield.  MDA, Meta-Modelling and Model Transformation: Introducing New Technology into the Defence Industry , 2005, ECMDA-FA.

[18]  Stefan Biffl,et al.  A Model-Driven Architecture Approach Using Explicit Stakeholder Quality Requirement Models for Building Dependable Information Systems , 2007, Fifth International Workshop on Software Quality (WoSQ'07: ICSE Workshops 2007).

[19]  Alexandre Petrenko,et al.  Reverse Engineering Models from Traces to Validate Distributed Systems - An Industrial Case Study , 2007, ECMDA-FA.

[20]  Brian Fitzgerald,et al.  Experiences from Representing Software Architecture in a Large Industrial Project Using Model Driven Development , 2007, Second Workshop on Sharing and Reusing Architectural Knowledge - Architecture, Rationale, and Design Intent (SHARK/ADI'07: ICSE Workshops 2007).

[21]  Dov Shirtz,et al.  Adopting Model Driven Development in a Large Financial Organization , 2007, ECMDA-FA.

[22]  Véronique Normand,et al.  Tailoring IEEE 1471 for MDE Support , 2004, UML Satellite Activities.

[23]  Bran Selic,et al.  UML Modeling Languages and Applications, «UML» 2004 Satellite Activities, Lisbon, Portugal, October 11-15, 2004, Revised Selected Papers , 2005, UML Satellite Activities.

[24]  Hans Wegener.  Balancing Simplicity and Expressiveness : Designing Domain-Specific Models for the Reinsurance Industry , 2004 .

[25]  Bruce Trask,et al.  Using model-driven engineering to complement software product line engineering in developing software defined radio components and applications , 2006 .

[26]  A. Gokhale,et al.  Model Driven Development of Inventory Tracking System * , 2003 .

[27]  Richard Vdovjak,et al.  Bootstrapping Domain-Specific Model-Driven Software Development within Philips , 2006 .

[28]  Tore Dybå,et al.  Evidence-Based Software Engineering for Practitioners , 2005, IEEE Softw..