Evaluating Design Science Outputs – The Case of Enterprise Architecture Business Value Assessments

In Design Science Research (DSR), evaluation of research outputs in form of design artifacts has been discussed in numerous publications. Many researchers have emphasized the criteria of utility for design artifacts. In this paper we use the case of Enterprise Architecture (EA) Management to demonstrate how design artefacts can be evaluated. Although EA has been extensively discussed in literature, the impact of the actual contribution of EA to the business value is not entirely understood. The focus of this paper is to evaluate our approach of EA business value assessment and demonstrate how we can effectively determine the relevant criteria and adapt an appropriate evaluation method.

[1]  Stephan Murer,et al.  Managed Evolution: A Strategy for Very Large Information Systems , 2010 .

[2]  Alexander L. Wolf,et al.  Software architecture , 2001 .

[3]  Tamara Sumner,et al.  Supporting evaluation in design , 1996 .

[4]  Peter Forbrig,et al.  Perspectives in Business Informatics Research - 9th International Conference, BIR 2010, Rostock Germany, September 29-October 1, 2010. Proceedings , 2010, BIR.

[5]  Stephen H. Kaisler,et al.  Enterprise Architecting: Critical Problems , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[6]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[7]  Tuure Tuunanen,et al.  Design Science Research Evaluation , 2012, DESRIST.

[8]  Peter Mertens,et al.  Memorandum on design-oriented information systems research , 2011, Eur. J. Inf. Syst..

[9]  Peter B. Seddon,et al.  Assessing and managing the benefits of enterprise systems: the business manager's perspective , 2002, Inf. Syst. J..

[10]  FRANK BANNISTER,et al.  Acts of faith: instinct, value and IT investment decisions , 2000, J. Inf. Technol..

[11]  Markus Helfert,et al.  Practical Aspects of Design Science , 2011, Communications in Computer and Information Science.

[12]  Jerry N. Luftman.  Assessing Business-IT Alignment Maturity , 2000, Commun. Assoc. Inf. Syst..

[13]  Fred Niederman,et al.  Design science and the accumulation of knowledge in the information systems discipline , 2012, TMIS.

[14]  M. Fotini,et al.  ERP Systems Business Value: A Critical Review of Empirical Literature , 2008, 2008 Panhellenic Conference on Informatics.

[15]  Randy V. Bradley,et al.  The Role of Enterprise Architecture in the Quest for IT Value , 2011, MIS Q. Executive.

[16]  Marlies van Steenbergen,et al.  Achieving Enterprise Architecture Benefits: What Makes the Difference? , 2011, 2011 IEEE 15th International Enterprise Distributed Object Computing Conference Workshops.

[17]  Markus Helfert,et al.  Applying Design Science Research for Enterprise Architecture Business Value Assessments , 2012, DESRIST.

[18]  Samuli Pekkola,et al.  Adapting the DeLone and McLean Model for the Enterprise Architecture Benefit Realization Process , 2009 .

[19]  Joachim Schelp,et al.  A Balanced Scorecard Approach to Measure the Value of Enterprise Architecture , 2007 .

[20]  Erik Brynjolfsson,et al.  Intangible Assets: Computers and Organizational Capital , 2002 .

[21]  Marten Schönherr,et al.  Towards a Common Terminology in the Discipline of Enterprise Architecture , 2009, ICSOC Workshops.

[22]  Hans van Vliet,et al.  Stakeholder Perception of Enterprise Architecture , 2008, ECSA.

[23]  Jeanne W. Ross,et al.  Creating a Strategic IT Architecture Competency: Learning in Stages , 2003, MIS Q. Executive.

[24]  André Vasconcelos,et al.  Information System Architecture Metrics: an Enterprise Engineering Evaluation Approach , 2010 .

[25]  George Westerman,et al.  Measuring IT Performance and Communicating Value , 2011, MIS Q. Executive.

[26]  Jan Pries-Heje,et al.  Strategies for Design Science Research Evaluation , 2008, ECIS.

[27]  Steffen Zimmermann,et al.  Governance im IT-Portfoliomanagement – Ein Ansatz zur Berücksichtigung von Strategic Alignment bei der Bewertung von IT , 2008, Wirtschaftsinf..

[28]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[29]  Markus Helfert,et al.  An Analysis of Enterprise Architecture Maturity Frameworks , 2011, BIR.

[30]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[31]  Mark Kasunic.  Measurement and Analysis Infrastructure Diagnostic, Version 1.0: Method Definition Document , 2010 .

[32]  S. Chatterjee,et al.  Design Science Research in Information Systems , 2010 .

[33]  Jeanne W. Ross,et al.  Enterprise Architecture As Strategy: Creating a Foundation for Business Execution , 2006 .

[34]  Markus Helfert,et al.  The case for design science utility and quality - Evaluation of design science artifact within the sustainable ICT capability maturity framework , 2012 .

[35]  Florian Matthes,et al.  Towards an Agile Design of the Enterprise Architecture Management Function , 2011, 2011 IEEE 15th International Enterprise Distributed Object Computing Conference Workshops.

[36]  M. Meyer,et al.  Applying Design Science Research in Enterprise Architecture Business Value Assessments , 2011 .

[37]  Johan F. Hoorn,et al.  Alignment and Maturity Are Siblings in Architecture Assessment , 2005, CAiSE.

[38]  Alan R. Hevner,et al.  Design Research in Information Systems , 2010 .