Criteria of progress for information systems design theories

According to Kuhn, science and progress are strongly interrelated. In this paper, we define criteria of progress for design theories. A broad analysis of the literature on information systems design science reveals that there is no consensus on the criteria of progress for design theories. We therefore analyze different concepts of progress for natural science theories. Based on well-founded criteria stemming from the philosophy of science and referring to natural science theories, we develop a set of criteria of progress for design theories. In summary, our analysis results in six criteria of progress for design theories: A design theory is partially progressive compared to another if it is ceteris paribus (1) more useful, (2) internally more consistent, (3) externally more consistent, (4) more general, (5) simpler, or (6) more fruitful of further research. Although the measurement of these criteria is not the focus of this paper, the problem of measurement cannot be totally neglected. We therefore discuss different methods for measuring the criteria based on different concepts of truth: the correspondence theory of truth, the coherence theory of truth, and the consensus theory of truth. We finally show the applicability of the criteria with an example.

[1]  E. F. Codd,et al.  Relational database: a practical foundation for productivity , 1982, CACM.

[2]  Barry Devlin,et al.  Data Warehouse: From Architecture to Implementation , 1996 .

[3]  Les Gasser,et al.  A Design Theory for Systems That Support Emergent Knowledge Processes , 2002, MIS Q..

[4]  E. F. CODD,et al.  A relational model of data for large shared data banks , 1970, CACM.

[5]  Allen S. Lee.  Rigor and relevance in MIS research: beyond the approach of positivism alone , 1999 .

[6]  G. Hempel,et al.  Deductive-Nomological vs. Statistical Explanation , 1962 .

[7]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[8]  Tobias Bucher,et al.  Situational Method Engineering - On the Differentiation of "Context" and "Project Type" , 2007 .

[9]  Paul K. Feyerabend,et al.  Explanation, reduction, and empiricism , 1962 .

[10]  Omar El Sawy,et al.  Building an Information System Design Theory for Vigilant EIS , 1992, Inf. Syst. Res..

[11]  Michael R. Clarkson,et al.  Formal Methods Application: An Empirical Tale of Software Development , 2002, IEEE Trans. Software Eng..

[12]  Martin Bichler,et al.  Design science in information systems research , 2006, Wirtschaftsinf..

[13]  Robert Winter,et al.  Situational Method Engineering , 2007, Situational Method Engineering.

[14]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[15]  W. H. Inmon,et al.  Dw 2.0: The Architecture for the Next Generation of Data Warehousing , 2008 .

[16]  Peter P. Chen.  The entity-relationship model: toward a unified view of data , 1975, VLDB '75.

[17]  Brian Fitzgerald,et al.  Competing dichotomies in IS research and possible strategies for resolution , 1998, ICIS '98.

[18]  John R. Venable,et al.  A framework for Design Science research activities , 2006 .

[19]  Ernest Nagel,et al.  The Structure of Science , 1962 .

[20]  Ron Weber,et al.  Should Optional Properties Be Used in Conceptual Modelling? A Theory and Three Empirical Tests , 2001, Inf. Syst. Res..

[21]  E. F. Codd,et al.  A relational model of data for large shared data banks , 1970, CACM.

[22]  Sandeep Purao,et al.  Design Research in the Technology of Information Systems: Truth or Dare , 2002 .

[23]  Walter F. Tichy,et al.  Comments on "Formal Methods Application: An Empirical Tale of Software Development" , 2003, IEEE Trans. Software Eng..

[24]  T. Kuhn.  The Structure of Scientific Revolutions. , 1964 .

[25]  M. J. Charlesworth,et al.  Aristotle’s Razor , 1956 .

[26]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[27]  Björn Niehaves,et al.  On Episemological Diversity in Design Science: New Vistas for a Design-Oriented IS Research? , 2007, ICIS.

[28]  J. Losee,et al.  Theories of Scientific Progress: An Introduction , 2003 .

[29]  B. Kitchenham,et al.  Inter-item correlations among function points , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[30]  Alan R. Hevner,et al.  The Use of Focus Groups in Design Science Research , 2010 .

[31]  Björn Niehaves,et al.  Epistemological perspectives on IS research: a framework for analysing and systematizing epistemological assumptions , 2007, Inf. Syst. J..

[32]  Ulrich Frank,et al.  Towards a pluralistic conception of research methods in information systems research , 2006 .

[33]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[34]  C. Hempel,et al.  Studies in the Logic of Explanation , 1948, Philosophy of Science.

[35]  Omar A. El Sawy,et al.  Assessing Information System Design Theory in Perspective: How Useful Was our 1992 Initial Rendition? , 2004 .

[36]  T. Kuhn,et al.  The essential tension : selected studies in scientific tradition and change , 1977 .

[37]  Vijay K. Vaishnavi,et al.  Theory Development in Design Science Research: Anatomy of a Research Project , 2008 .

[38]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[39]  David Arnott,et al.  The Use of Focus Groups in Design Science Research , 2007 .

[40]  John R. Venable,et al.  The role of theory and theorising in Design Science research , 2006 .

[41]  C. Robert Carlson,et al.  A Comparison of the Relational and CODASYL Approaches to Data-Base Management , 1976, CSUR.

[42]  David Hillel Gelernter.  Machine Beauty: Elegance And The Heart Of Technology , 1998 .

[43]  Björn Niehaves,et al.  On Epistemological Pluralism in Design Science , 2007, Scand. J. Inf. Syst..

[44]  Göran Goldkuhl,et al.  DESIGN THEORIES IN INFORMATION SYSTEMS - A NEED FOR MULTI-GROUNDING , 2004 .

[45]  Shirley Gregor,et al.  Building theory in the sciences of the artificial , 2009, DESRIST.

[46]  Michael R. Clarkson,et al.  Response to "Comments on 'Formal Methods Application: An Empirical Tale of Software Development'" , 2003, IEEE Trans. Software Eng..

[47]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .