Genres of Inquiry in Design-Science Research: Justification and Evaluation of Knowledge Production

Recognizing that design is at the core of information systems development has led to a design-science research paradigm where differing kinds of knowledge goals give form to differing kinds of knowledge processes within a single study. This paper analyzes knowledge production in design-science research to explain how an endogenous form of pluralism characterizes such studies, making it problematic to associate any design-science study with a single view of knowledge production. Instead, a design-science research study exhibits up to four different modes of reasoning, called genres of inquiry. These genres are derived from two dualities that contrast differing knowledge goals and differing knowledge scope in the knowledge production process. The first duality arises from the sometimes seemingly contradictory knowledge goals of science versus design. The second duality reflects the contradiction between the scope of the knowledge produced, which may be idiographic or nomothetic. The evolutionary and iterative nature of a design-science study compels different knowledge goals and scope at different moments throughout a project. Because of this momentary nature, a single design-science study can be associated with multiple genres of inquiry. This understanding of the variety in the genres of inquiry advances the discourse on the nature of design-science research and the justification and evaluation of its outcomes. Consequently, a corresponding set of criteria for knowledge justification and evaluation is provided for each genre of inquiry.

[1]  Hsinchun Chen,et al.  CyberGate: A Design Framework and System for Text Analysis of Computer-Mediated Communication , 2008, MIS Q..

[2]  Vijay K. Vaishnavi,et al.  A Framework for Theory Development in Design Science Research: Multiple Perspectives , 2012, J. Assoc. Inf. Syst..

[3]  Yolande E. Chan,et al.  A Multilevel Model for Measuring Fit Between a Firm's Competitive Strategies and Information Systems Capabilities , 2011, MIS Q..

[4]  Maurice Landry,et al.  A disciplined methodological pluralism for mis research , 1992 .

[5]  M. Patton,et al.  Enhancing the quality and credibility of qualitative analysis. , 1999, Health services research.

[6]  Ranulph Glanville,et al.  Re-searching Design and Designing Research , 1999 .

[7]  Alan R. Hevner,et al.  Design Research in Information Systems: Theory and Practice , 2010 .

[8]  Detmar W. Straub,et al.  A response to the design-oriented information systems research memorandum , 2011, Eur. J. Inf. Syst..

[9]  P. Molenaar A Manifesto on Psychology as Idiographic Science: Bringing the Person Back Into Scientific Psychology, This Time Forever , 2004 .

[10]  Peter J. Denning,et al.  A new social contract for research , 1997, CACM.

[11]  Debra L. Shapiro,et al.  Maximizing cross-functional new product teams' innovativeness and constraint adherence: A conflict communications perspective. , 2001 .

[12]  Nicholas Rescher,et al.  Realistic Pragmatism: An Introduction to Pragmatic Philosophy , 1999 .

[13]  E. Guba Criteria for assessing the trustworthiness of naturalistic inquiries , 1981 .

[14]  D. Campbell,et al.  Unobtrusive Measures: Nonreactive Research in the Social Sciences , 1966 .

[15]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[16]  P. Järvinen Action Research is Similar to Design Science , 2007 .

[17]  Andrew K. Shenton Strategies for ensuring trustworthiness in qualitative research projects , 2004, Educ. Inf..

[18]  Ken Friedman,et al.  Theory construction in design research: criteria: approaches, and methods , 2003 .

[19]  Omar El Sawy,et al.  Building an Information System Design Theory for Vigilant EIS , 1992, Inf. Syst. Res..

[20]  Hanfried Lenz,et al.  Design theory , 1985 .

[21]  Wilhelm Windelband,et al.  History and Natural Science , 1980 .

[22]  유창조 Naturalistic Inquiry , 2022, The SAGE Encyclopedia of Research Design.

[23]  Richard Baskerville,et al.  Diversity in information systems action research methods , 1998 .

[24]  Les Gasser,et al.  A Design Theory for Systems That Support Emergent Knowledge Processes , 2002, MIS Q..

[25]  M. Lindvall,et al.  Knowledge management in software engineering , 2002, IEEE Software.

[26]  Stafford Beer,et al.  The Viable System Model : its provenance , development , methodology and pathology * Stafford Beer = President of the World Organization for Systems and Cybernetics , 2000 .

[27]  Ervin Laszlo,et al.  Introduction to Systems Philosophy - Toward a New Paradigm of Contemporary Thought , 1972 .

[28]  E. Jantsch The self-organizing universe : scientific and human implications of the emerging paradigm of evolution , 1980 .

[29]  Neil Mercer,et al.  From Social Interaction to Individual Reasoning : An Empirical Investigation of a Possible Model of Cognitive Development , 2004 .

[30]  Michael D. Myers,et al.  Design ethnography in information systems , 2015, Inf. Syst. J..

[31]  R. B. Frost Why Does Industry Ignore Design Science , 1999 .

[32]  Julienne Ford Paradigms and Fairy Tales: An Introduction to the Science of Meanings , 1975 .

[33]  K. Malterud Qualitative research: standards, challenges, and guidelines , 2001, The Lancet.

[34]  N. Cross Designerly Ways of Knowing: Design Discipline Versus Design Science , 2001, Design Issues.

[35]  N. Cross Designerly ways of knowing , 2006 .

[36]  Bonnie Kaplan,et al.  Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study , 1988, MIS Q..

[37]  Michael D. Myers,et al.  Qualitative Research in Information Systems , 1997, MIS Q..

[38]  Patrick Olivier,et al.  Waves: exploring idiographic design for live performance , 2013, CHI.

[39]  Keng Siau,et al.  Evaluation of information modeling methods-a review , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[40]  David Wang,et al.  Architectural Research Methods , 2001 .

[41]  C. Bazerman Shaping Written Knowledge: The Genre and Activity of the Experimental Article in Science , 1989 .

[42]  Per Galle,et al.  Science and design: Identical twins? , 2014 .

[43]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[44]  Juhani Iivari,et al.  A Paradigmatic Analysis of Information Systems As a Design Science , 2007, Scand. J. Inf. Syst..

[45]  K. Popper,et al.  Conjectures and refutations;: The growth of scientific knowledge , 1972 .

[46]  Veda C. Storey,et al.  Unpacking the Duality of Design Science , 2011, ICIS.

[47]  Allen S. Lee Thinking about Social Theory and Philosophy for Information Systems , 2004 .

[48]  Arash Saghafi,et al.  What is a Contribution to IS Design Science Knowledge? , 2014, ICIS.

[49]  Bruce Kogut,et al.  Chapter 2 – Knowledge of the Firm: Combinative Capabilities, and the Replication of Technology , 1997 .

[50]  Merriam-Webster,et al.  The Merriam Webster Dictionary , 1983 .

[51]  J. Morse,et al.  Verification Strategies for Establishing Reliability and Validity in Qualitative Research , 2002 .

[52]  David Lorge Parnas,et al.  A rational design process: How and why to fake it , 1986, IEEE Transactions on Software Engineering.

[53]  John N. Warfield,et al.  Generic planning: Research results and applications , 1990, Knowledge, Technology and Policy.

[54]  Paul Hart,et al.  Requisite Variety: The problem with generic guidelines for diverse genres of inquiry , 2000 .

[55]  T. Gieryn Boundary-work and the demarcation of science from non-science: Strains and interests in professional , 1983 .

[56]  William R. King,et al.  External Validity in IS Survey Research , 2005, Commun. Assoc. Inf. Syst..

[57]  Judy McKay,et al.  The design construct in information systems design science , 2012, J. Inf. Technol..

[58]  J. Creswell,et al.  Determining Validity in Qualitative Inquiry , 2000 .

[59]  Paulien M. Herder,et al.  Follow the rainbow: a knowledge management framework for new product introduction , 2003, J. Knowl. Manag..

[60]  Michael Halliday,et al.  An Introduction to Functional Grammar , 1985 .

[61]  Diego Latella,et al.  Dependability analysis in the early phases of UML-based system design , 2001, Comput. Syst. Sci. Eng..

[62]  A. George,et al.  Case Studies and Theory Development in the Social Sciences , 2005 .

[63]  Timothy E. Eastman,et al.  Duality without Dualism , 2007 .

[64]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[65]  Daniel L. Sherrell,et al.  Communications of the Association for Information Systems , 1999 .

[66]  Herbert A. Simon,et al.  The Science of Design: Creating the Artificial , 1988 .

[67]  M. Hoepfl Choosing Qualitative Research: A Primer for Technology Education Researchers , 1997 .

[68]  Nico Verdonschot,et al.  Science versus design; comparable, contrastive or conducive? , 2013, Journal of the mechanical behavior of biomedical materials.

[69]  E. Matthews PATTERNS OF DISCOVERY IN THE SOCIAL SCIENCES , 1973 .

[70]  Masaki Suwa,et al.  Unexpected discoveries and S-invention of design requirements , 2000 .

[71]  Jan Pries-Heje,et al.  Explanatory Design Theory , 2010, Bus. Inf. Syst. Eng..

[72]  Jay F. Nunamaker,et al.  Systems Development in Information Systems Research , 1990, J. Manag. Inf. Syst..

[73]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[74]  Dirk S. Hovorka,et al.  Incommensurability and Multi-paradigm Grounding in Design Science Research: Implications for Creating Knowledge , 2010, Human Benefit through the Diffusion of Information Systems Design Science Research.

[75]  New York Teachers , 1894 .

[76]  Sandeep Purao,et al.  Action Design Research , 2011, MIS Q..

[77]  Alan Bullock,et al.  The Fontana dictionary of modern thought , 1977 .

[78]  Nancy A. Bonner Predicting Leadership Success in Agile Environments: An Inquiring Systems Approach , 2010 .

[79]  N. Denzin Sociological Methods: A Sourcebook , 1978 .

[80]  E. Schein The clinical perspective in fieldwork , 1987 .

[81]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[82]  Martin Goldstein,et al.  How We Know: An Exploration of the Scientific Process. , 1980 .

[83]  Maurice Landry,et al.  Can the field of MIS be disciplined? , 1989, CACM.

[84]  Robert O. Briggs,et al.  On Expanding the Scope of Design Science in IS Research , 2011, DESRIST.

[85]  Mario Bunge,et al.  Social Science under Debate: A Philosophical Perspective , 1998 .

[86]  A. Kellerman,et al.  The Constitution of Society : Outline of the Theory of Structuration , 2015 .

[87]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[88]  Charles L. Owen,et al.  Design research: building the knowledge base☆ , 1998 .

[89]  L. Willcocks,et al.  Social theory and philosophy for information systems , 2004 .

[90]  Helmut Krcmar,et al.  Long Live Design Science Research! .... and Remind Me Again About Whether It Is a New Research Paradigm or a Rationale of Last Resort for Worthwhile Research That Doesn't Fit Under Any Other Umbrella , 2012, ICIS.

[91]  Jan Pries-Heje,et al.  Soft design science methodology , 2009, DESRIST.

[92]  W. Overton,et al.  The structure of developmental theory. , 1991, Advances in child development and behavior.

[93]  Sari Stenfors,et al.  Exploring the Edges of Theory-Practice Gap: Epistemic Cultures in Strategy-Tool Development and Use , 2009 .

[94]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[95]  Simone Fattorini,et al.  A statistical method for idiographic analyses in biogeographical research , 2007 .

[96]  Pierre N. Robillard,et al.  The role of knowledge in software development , 1999, CACM.

[97]  J. Piaget Psychology and Epistemology: Towards a Theory of Knowledge , 1972 .

[98]  M. Markus Electronic Mail as the Medium of Managerial Choice , 1994 .

[99]  Sandeep Purao,et al.  Design Research in the Technology of Information Systems: Truth or Dare , 2002 .

[100]  Charles C. Ragin,et al.  Set Relations in Social Research: Evaluating Their Consistency and Coverage , 2006, Political Analysis.

[101]  J. Gerring Single-Outcome Studies , 2006 .

[102]  Michel Wedel,et al.  Breaking Through the Clutter: Benefits of Advertisement Originality and Familiarity for Brand Attention and Memory , 2002, Manag. Sci..

[103]  Juhani Iivari,et al.  Distinguishing and contrasting two strategies for design science research , 2015, Eur. J. Inf. Syst..

[104]  Julie Travis,et al.  Exploring the Constructs of Evaluative Criteria for Interpretivist Research , 1999 .

[105]  Andrzej Malewski,et al.  THE NOMOTHETIC VERSUS THE IDIOGRAPHIC APPROACH TO HISTORY , 2009 .

[106]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[107]  David A. Erlandson Doing Naturalistic Inquiry: A Guide to Methods , 1993 .

[108]  Lukasz Lamza,et al.  How much history can chemistry take , 2010 .

[109]  Jan Pries-Heje,et al.  FEDS: a Framework for Evaluation in Design Science Research , 2016, Eur. J. Inf. Syst..

[110]  N. Mercer,et al.  From social interaction to individual reasoning: an empirical investigation of a possible socio-cultural model of cognitive development , 1999 .

[111]  R. Hirschheim,et al.  The paradigm is dead, the paradigm is dead ... long live the paradigm: the legacy of Burrell and Morgan , 2000 .

[112]  Richard Buchanan,et al.  Wicked Problems in Design Thinking , 1992 .

[113]  Vijay K. Vaishnavi,et al.  Theory Development in Design Science Research: Anatomy of a Research Project , 2008 .

[114]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[115]  Allen S. Lee Electronic Mail as a Medium for Rich Communication: An Empirical Investigation Using Hermeneutic Interpretation , 1994, MIS Q..

[116]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[117]  Daniel Robey,et al.  Research Commentary: Diversity in Information Systems Research: Threat, Promise, and Responsibility , 1996, Inf. Syst. Res..

[118]  Samuel B. Bacharach,et al.  Organizational Theories: Some Criteria for Evaluation , 1989 .

[119]  Stanley L. Deno,et al.  Individual Differences and Individual Difference , 1990 .

[120]  Glenn H. Bracht,et al.  The External Validity of Experiments1 , 1968 .

[121]  Björn Niehaves,et al.  On Epistemological Pluralism in Design Science , 2007, Scand. J. Inf. Syst..

[122]  Göran Goldkuhl,et al.  DESIGN THEORIES IN INFORMATION SYSTEMS - A NEED FOR MULTI-GROUNDING , 2004 .

[123]  J. Eyles,et al.  Evaluating Qualitative Research in Social Geography: Establishing ‘Rigour’ in Interview Analysis , 1997 .

[124]  Ernest Nagel,et al.  The Structure of Science , 1962 .

[125]  Brian Randell,et al.  Fundamental Concepts of Dependability , 2000 .

[126]  E. Hippel,et al.  Lead users: a source of novel product concepts , 1986 .

[127]  Sunny Y. Auyang,et al.  Foundations of Complex-system Theories , 1998 .

[128]  Fred Niederman,et al.  Design science and the accumulation of knowledge in the information systems discipline , 2012, TMIS.

[129]  Sven A. Carlsson,et al.  Towards an Information Systems Design Research Framework: A Critical Realist Perspective , 2006 .

[130]  A. Georges L. Romme,et al.  Making a Difference: Organization as Design , 2003, Organ. Sci..

[131]  Roger Martin The Design of Business: Why Design Thinking is the Next Competitive Advantage , 2009 .

[132]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[133]  Christoph Rosenkranz,et al.  The variety engineering method: analyzing and designing information flows in organizations , 2011, Inf. Syst. E Bus. Manag..

[134]  Isaac Franck Psychology as a Science: Resolving the Idiographic‐Nomothetic Controversy , 1982 .

[135]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[136]  Jennifer Jie Xu,et al.  Business Intelligence in Blogs: Understanding Consumer Interactions and Communities , 2012, MIS Q..

[137]  A. Giddens Central Problems in Social Theory: Action, Structure and Contradiction in Social Analysis , 1979 .

[138]  Martin Harris,et al.  Strategic planning for information systems , 1991, J. Inf. Technol..

[139]  Russell E. Glasgow,et al.  Evaluating the Relevance, Generalization, and Applicability of Research , 2006, Evaluation & the health professions.

[140]  J. Aken Management Research Based on the Paradigm of the Design Sciences: The Quest for Field-Tested and Grounded Technological Rules , 2004 .

[141]  Sandeep Purao,et al.  The Sciences of Design: Observations on an Emerging Field , 2008, Commun. Assoc. Inf. Syst..

[142]  Ian Hacking,et al.  ‘Language, Truth and Reason’ 30 years later , 2012 .

[143]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[144]  G. Āllport The general and the unique in psychological science. , 1962, Journal of personality.

[145]  Peter Mertens,et al.  Memorandum on design-oriented information systems research , 2011, Eur. J. Inf. Syst..

[146]  John D. Murphy,et al.  A design science based evaluation framework for patterns , 2010, DATB.

[147]  Göran Goldkuhl,et al.  From Action Research to Practice Research , 2012, Australas. J. Inf. Syst..

[148]  Robert Winter,et al.  Design science research in Europe , 2008 .

[149]  Ralf Dresner,et al.  Rethinking Context Language As An Interactive Phenomenon , 2016 .

[150]  R. Burchfield Oxford English dictionary , 1982 .

[151]  Richard Baskerville,et al.  Going back to basics in design science: from the information technology artifact to the information systems artifact , 2015, Inf. Syst. J..

[152]  H. Tsoukas The Validity of Idiographic Research Explanations , 1989 .

[153]  Paulo B. Góes,et al.  Editor's comments: design science research in top information systems journals , 2014 .

[154]  Ray J. Paul,et al.  Measuring research quality: the United Kingdom Government's Research Assessment Exercise , 2008, Eur. J. Inf. Syst..

[155]  M. Bornstein,et al.  Attention and memory. , 1989, Pediatric annals.

[156]  Roger L. Martin,et al.  The opposable mind : winning through integrative thinking , 2009 .

[157]  E. Jantsch The design of inquiring systems,: by C. West Churchman New York, Basic Books, 1972. , 1972 .

[158]  Elliot W. Eisner,et al.  Qualitative Inquiry in Education: The Continuing Debate , 1990 .

[159]  N. Leech,et al.  Validity and Qualitative Research: An Oxymoron? , 2007 .

[160]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[161]  R. Kolbe,et al.  Content-Analysis Research: An Examination of Applications with Directives for Improving Research Reliability and Objectivity , 1991 .