What can we learn from enterprise architecture models? An experiment comparing models and documents for capability development

Enterprise architecture (EA) has been established as a discipline to cope with the complex interactions of business operations and technology. Models, i.e., formal descriptions in terms of diagrams and views, are at the heart of the approach. Though it is widely thought that such architecture models can contribute to improved understanding and decision making, this proposition has not rigorously been tested. This article describes an experiment conducted with a real EA model and corresponding real traditional documents, investigating whether the model or the documents lead to better and faster understanding. Understanding is interesting to study, as it is a prerequisite to other EA uses. The subjects ($$N=98$$N=98) were officer cadets, and the experiment was carried out using a comprehensive description of military Close Air Support capability either (1) in the form of a MODAF model or (2) in the form of traditional documents. Based on the results, the model seems to lead to better, though not faster, understanding.

[1]  Marten van Sinderen,et al.  A Goal-Oriented Requirements Modelling Language for Enterprise Architecture , 2009, 2009 IEEE International Enterprise Distributed Object Computing Conference.

[2]  Farhad Arbab,et al.  Enterprise architecture: Management tool and blueprint for the organisation , 2006, Inf. Syst. Frontiers.

[3]  Jianing Shi,et al.  Controlled Field Entries versus Free Text in a Clinical/ Research Emr , 2010 .

[4]  Matthias Lange,et al.  An empirical analysis of the factors and measures of Enterprise Architecture Management success , 2016, Eur. J. Inf. Syst..

[5]  Mathias Ekstedt,et al.  A survey on CIO concerns-do enterprise architecture frameworks support them? , 2006, Inf. Syst. Frontiers.

[6]  Jeff Tyree,et al.  Architecture decisions: demystifying architecture , 2005, IEEE Software.

[7]  Robert Winter,et al.  Viewpoint-based Meta Model Engineering , 2007, EMISA.

[8]  Dharini Balasubramaniam,et al.  Controlling software architecture erosion: A survey , 2012, J. Syst. Softw..

[9]  Markus Buschle,et al.  An enterprise architecture framework for multi-attribute information systems analysis , 2012, Software & Systems Modeling.

[10]  Mathias Ekstedt,et al.  Using Enterprise Architecture for CIO Decision-Making On the Importance of Theory , 2004 .

[11]  James A Schirillo,et al.  The Greater Ability of Graphical Versus Numerical Displays to Increase Risk Avoidance Involves a Common Mechanism , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[12]  P. Yeung,et al.  Comparison of text versus video for teaching laparoscopic knot tying in the novice surgeon: a randomized, controlled trial. , 2009, Journal of minimally invasive gynecology.

[13]  Michelene T. H. Chi,et al.  Simulation versus Text: Acquisition of Implicit and Explicit Information , 2006 .

[14]  E. Callahan,et al.  Obesity and the unbalanced energy equation: exercise versus eating habit change. , 1979, Journal of consulting and clinical psychology.

[15]  Markus Buschle,et al.  Enterprise Architecture Management's Impact on Information Technology Success , 2011, 2011 44th Hawaii International Conference on System Sciences.

[16]  Ramin Nassiri,et al.  Developing effective project management for enterprise architecture projects , 2010, 2010 2nd International Conference on Software Technology and Engineering.

[17]  Stephen H. Kaisler,et al.  Enterprise Architecting: Critical Problems , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[18]  Joachim Schelp,et al.  A Reassessment of Enterprise Architecture Implementation , 2009, ICSOC/ServiceWave Workshops.

[19]  Florian Matthes,et al.  Towards a Conceptual Framework for Interactive Enterprise Architecture Management Visualizations , 2012, Modellierung.

[20]  Harrison Si,et al.  Handbook of Research Methods in Social and Personality Psychology: Author Index , 2013 .

[21]  Scott W. Ambler,et al.  A Practical Guide to Enterprise Architecture , 2003 .

[22]  Robert Winter,et al.  A Federated Approach to Enterprise Architecture Model Maintenance , 2007, Enterp. Model. Inf. Syst. Archit. Int. J. Concept. Model..

[23]  Stephan Aier,et al.  Mediterranean Conference on Information Systems ( MCIS ) 1-1-2012 ENTERPRISE ARCHITECTURE AS A MEANS FOR COORDINATION – AN EMPIRICAL STUDY ON ACTUAL AND POTENTIAL PRACTICE , 2012 .

[24]  Christian Schalles.  Usability Evaluation of Modeling Languages , 2012 .

[25]  Robert Yoder,et al.  A study of video-based versus text-based labs for a management information systems course , 2011, ITiCSE '11.

[26]  Hans van Vliet,et al.  Stakeholder Perception of Enterprise Architecture , 2008, ECSA.

[27]  Martin Fowler,et al.  Patterns of Enterprise Application Architecture , 2002 .

[28]  Frank Leymann,et al.  Reusable Architectural Decision Models for Enterprise Application Development , 2007, QoSA.

[29]  Ruth Breu,et al.  Using an Enterprise Architecture for IT Risk Management , 2006, ISSA.

[30]  Janne J. Korhonen,et al.  Enterprise Architecture as Capability: Strategic Application of Competencies to Govern Enterprise Transformation , 2014, 2014 IEEE 16th Conference on Business Informatics.

[31]  M. Brewer,et al.  Research Design and Issues of Validity , 2000 .

[32]  Jane M. Carey,et al.  The Effects of Graphical Versus Numerical Response on the Accuracy of Graph-Based Forecasts , 1991 .

[33]  Geoffrey T Fong,et al.  Text and graphic warnings on cigarette packages: findings from the international tobacco control four country study. , 2007, American journal of preventive medicine.

[34]  Bradley W. Bergey,et al.  Using diagrams versus text for spaced restudy: Effects on learning in 10th grade biology classes. , 2015, The British journal of educational psychology.

[35]  Iris Vessey,et al.  Cognitive Fit: A Theory‐Based Analysis of the Graphs Versus Tables Literature* , 1991 .

[36]  Sabine Buckl,et al.  A Survival Analysis of Application Life Spans based on Enterprise Architecture Models , 2009, EMISA.

[37]  David W. Bates,et al.  Coded entry versus free-text and alert overrides: What you get depends on how you ask , 2010, Int. J. Medical Informatics.

[38]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[39]  Kristian Hjort-Madsen,et al.  Enterprise Architecture Implementation and Management: A Case Study on Interoperability , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[40]  Carol Herron.  A comparison study of the effects of video-based versus text-based instruction in the foreign language classroom , 1995 .

[41]  Marlies van Steenbergen,et al.  The Contribution of Enterprise Architecture to the Achievement of Organizational Goals: A Review of the Evidence , 2010, TEAR.

[42]  Marc M. Lankhorst,et al.  Enterprise architecture modelling--the issue of integration , 2004, Adv. Eng. Informatics.

[43]  Christian M. Schweda,et al.  Interactive Functions of a Cockpit for Enterprise Architecture Planning , 2014, 2014 IEEE 18th International Enterprise Distributed Object Computing Conference Workshops and Demonstrations.

[44]  Jeanne W. Ross,et al.  Enterprise Architecture As Strategy: Creating a Foundation for Business Execution , 2006 .

[45]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[46]  Michael Rohloff,et al.  Enterprise Architecture - Framework and Methodology for the Design of Architectures in the Large , 2005, ECIS.

[47]  Stephen M. Corey,et al.  Learning from lectures vs. learning from readings. , 1934 .

[48]  Janice C. Honeyman-Buck,et al.  Free text versus structured format: information transfer efficiency of radiology reports. , 2005, AJR. American journal of roentgenology.

[49]  Khadija Iqbal,et al.  An introduction , 1996, Neurobiology of Aging.

[50]  Alan MacCormack,et al.  Visualizing and Measuring Enterprise Application Architecture: An Exploratory Telecom Case , 2014, 2014 47th Hawaii International Conference on System Sciences.

[51]  Jorg Desel,et al.  Enterprise Modelling and Information Systems Architectures , 2005 .