Exploring the Scientific Impact of Information Systems Design Science Research: A Scientometric Study

Design science is a fundamental research stream that contends its position in the information systems discipline. While ongoing debates address the relative importance of design science contributions in the information systems community, insights into the scientific impact of design science research (DSR) are missing and this lack of understanding arguably poses challenges to an informed discourse. To identify the most influential papers and those factors that explain their scientific impact, this paper presents an exploratory study of the scientific impact of DSR papers published in the AIS Senior Scholars' Basket of Journals. We uncover the current DSR landscape by taking stock of influential papers and theories and develop a model to explain the scientific impact of DSR papers. Our findings show that scientific impact is significantly explained by theorization and novelty. We discuss how the implications of our work can be projected on the overarching discourse on DSR.

[1]  Arun Rai,et al.  Editor's comments: diversity of Design Science Research , 2017 .

[2]  Jay F. Nunamaker,et al.  Creating High-Value Real-World Impact through Systematic Programs of Research , 2017, MIS Q..

[3]  Alexander Benlian,et al.  Factors Affecting the Scientific Impact of Literature Reviews: A Scientometric Study , 2016, ICIS.

[4]  Jacky Akoka,et al.  The Structure of DSR Knowledge as Reflected by DESRIST - A Citation Analysis (2009-2015) , 2016, DESRIST.

[5]  Ahmad Alturki,et al.  Information System Design Theory: A Lifecycle Perspective , 2016, DESRIST.

[6]  Veda C. Storey,et al.  Genres of Inquiry in Design-Science Research: Justification and Evaluation of Knowledge Production , 2015, MIS Q..

[7]  Carol Tenopir,et al.  The role of trust and authority in the citation behaviour of researchers , 2015, Inf. Res..

[8]  Jacky Akoka,et al.  A Taxonomy of Evaluation Methods for Information Systems Artifacts , 2015, J. Manag. Inf. Syst..

[9]  Detmar W. Straub,et al.  Knowledge Contributions in Design Science Research: A Meta-Analysis , 2014, DESRIST.

[10]  Andreas Drechsler,et al.  What Kinds of Artifacts Are We Designing? An Analysis of Artifact Types and Artifact Relevance in IS Journal Publications , 2014, DESRIST.

[11]  Roman Lukyanenko,et al.  Reconciling Theories with Design Choices in Design Science Research , 2013, DESRIST.

[12]  John R. Venable,et al.  Rethinking Design Theory in Information Systems , 2013, DESRIST.

[13]  Paulo B. Góes,et al.  Editor's comments: commonalities across IS silos and intradisciplinary information systems research , 2013 .

[14]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[15]  Yair Wand,et al.  Extending Classification Principles from Information Modeling to Other Disciplines , 2013, J. Assoc. Inf. Syst..

[16]  Jan Muntermann,et al.  A method for taxonomy development and its application in information systems , 2013, Eur. J. Inf. Syst..

[17]  Mathias Ekstedt,et al.  Using enterprise architecture analysis and interview data to estimate service response time , 2013, J. Strateg. Inf. Syst..

[18]  Yunjie Calvin Xu,et al.  Alternate Strategies for a Win-Win Seeking Agent in Agent-Human Negotiations , 2012, J. Manag. Inf. Syst..

[19]  Richard Baskerville,et al.  Eating Our Own Cooking: Toward a More Rigorous Design Science of Research Methods , 2012 .

[20]  Jennifer Jie Xu,et al.  Business Intelligence in Blogs: Understanding Consumer Interactions and Communities , 2012, MIS Q..

[21]  Konrad Paul Kording,et al.  Future impact: Predicting scientific success , 2012, Nature.

[22]  Vijay K. Vaishnavi,et al.  A Framework for Theory Development in Design Science Research: Multiple Perspectives , 2012, J. Assoc. Inf. Syst..

[23]  Alexander Maedche,et al.  Anatomy of Knowledge Bases Used in Design Science Research - A Literature Review , 2012, DESRIST.

[24]  George R. Widmeyer,et al.  Towards a Formal Approach to Information Systems Design Theory Using Category Theory , 2012, DESRIST.

[25]  Björn Niehaves,et al.  On the Relationship between the IT Artifact and Design Theory: The Case of Virtual Social Facilitation , 2012, DESRIST.

[26]  Fred Niederman,et al.  Design science and the accumulation of knowledge in the information systems discipline , 2012, TMIS.

[27]  Stefan Seidel,et al.  Leaving the Beaten Tracks in Creative Work - A Design Theory for Systems that Support Convergent and Divergent Thinking , 2011, J. Assoc. Inf. Syst..

[28]  Johann Füller,et al.  Co-Creation in Virtual Worlds: The Design of the User Experience , 2011, MIS Q..

[29]  Christian Fischer,et al.  The Information Systems Design Science Research Body Of Knowledge - A Citation Analysis In Recent Top-Journal Publications , 2011, PACIS.

[30]  Lutz Bornmann,et al.  A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants , 2011, J. Informetrics.

[31]  Alan R. Hevner,et al.  A Fitness-Utility Model for Design Science Research , 2011, TMIS.

[32]  Ahmad Alturki,et al.  A Design Science Research Roadmap , 2011, PACIS.

[33]  Jan Pries-Heje,et al.  Theorizing in Design Science Research , 2011, DESRIST.

[34]  ZhouLina,et al.  The effects of tree-view based presentation adaptation on mobile web browsing , 2011 .

[35]  Peter Mertens,et al.  Memorandum on design-oriented information systems research , 2011, Eur. J. Inf. Syst..

[36]  Fang Xu,et al.  The drivers of citations in management science journals , 2010, Eur. J. Oper. Res..

[37]  Jan Pries-Heje,et al.  Explanatory Design Theory , 2010, Bus. Inf. Syst. Eng..

[38]  Ofer Arazy,et al.  A Theory-Driven Design Framework for Social Recommender Systems , 2010, J. Assoc. Inf. Syst..

[39]  Marten Schönherr,et al.  Artifact Types in Information Systems Design Science - A Literature Review , 2010, DESRIST.

[40]  Rafael A. Gonzalez,et al.  Quo Vadis, Design Science? - A Survey of Literature , 2010, DESRIST.

[41]  Samir Chatterjee,et al.  Meta-analysis of Design Science Research within the IS Community: Trends, Patterns, and Outcomes , 2010, DESRIST.

[42]  Kalle Lyytinen,et al.  Design theory for dynamic complexity in information infrastructures: the case of building internet , 2010, J. Inf. Technol..

[43]  Detmar W. Straub,et al.  Editor's comments: why top journals accept your paper , 2009 .

[44]  Gwendolyn L. Kolfschoten,et al.  A Design Approach for Collaboration Processes: A Multimethod Design Science Study in Collaboration Engineering , 2009, J. Manag. Inf. Syst..

[45]  Duane P. Truex,et al.  Assessing Scholarly Influence: Using the Hirsch Indices to Reframe the Discourse , 2009, J. Assoc. Inf. Syst..

[46]  Ron Weber,et al.  Guidelines for Empirical Evaluations of Conceptual Modeling Grammars , 2009, J. Assoc. Inf. Syst..

[47]  Shirley Gregor,et al.  Building theory in the sciences of the artificial , 2009, DESRIST.

[48]  Yair Wand,et al.  Using Cognitive Principles to Guide Classification in Information Systems Modeling , 2008, MIS Q..

[49]  Robert J. Kauffman,et al.  Making Sense of Technology Trends in the Information Technology Landscape: A Design Science Approach , 2008, MIS Q..

[50]  Hsinchun Chen,et al.  CyberGate: A Design Framework and System for Text Analysis of Computer-Mediated Communication , 2008, MIS Q..

[51]  Jan Pries-Heje,et al.  The Design Theory Nexus , 2008, MIS Q..

[52]  Richard Baskerville,et al.  What design science is not , 2008, Eur. J. Inf. Syst..

[53]  Vijay K. Vaishnavi,et al.  Theory Development in Design Science Research: Anatomy of a Research Project , 2008 .

[54]  Anna Sidorova,et al.  Uncovering the Intellectual Core of the Information Systems Discipline , 2008, MIS Q..

[55]  John Mingers,et al.  Exploring the dynamics of journal citations: Modelling with s-curves , 2008, J. Oper. Res. Soc..

[56]  Lutz Bornmann,et al.  What do citation counts measure? A review of studies on citing behavior , 2008, J. Documentation.

[57]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[58]  Xin Luo,et al.  A Scientometric Investigation into the Validity of IS Journal Quality Measures , 2007, J. Assoc. Inf. Syst..

[59]  Jeffrey G. Gray,et al.  DSMDiff: a differentiation tool for domain-specific models , 2007 .

[60]  Matt Germonprez,et al.  A Theory of Tailorable Technology Design , 2007, J. Assoc. Inf. Syst..

[61]  T. Judge,et al.  What Causes a Management Article to be Cited—Article, Author, or Journal? , 2007 .

[62]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[63]  Olivia R. Liu Sheng,et al.  Formulating the Data-Flow Perspective for Business Process Management , 2006, Inf. Syst. Res..

[64]  P. Verhoef,et al.  The Quest for Citations: Drivers of Article Impact , 2006 .

[65]  Richard Baskerville,et al.  A Design Theory for Secure Information Systems Design Methods , 2006, J. Assoc. Inf. Syst..

[66]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[67]  Detmar W. Straub,et al.  The Value of Scientometric Studies: An Introduction to a Debate on IS as a Reference Discipline , 2006, J. Assoc. Inf. Syst..

[68]  Rajendra P. Srivastava,et al.  An Information Systems Security Risk Assessment Model Under the Dempster-Shafer Theory of Belief Functions , 2006, J. Manag. Inf. Syst..

[69]  Mark A. Fuller,et al.  Research Standards for Promotion and Tenure in Information Systems , 2006, MIS Q..

[70]  John Krogstie,et al.  Process models representing knowledge for action: a revised quality framework , 2006, Eur. J. Inf. Syst..

[71]  David Arnott,et al.  Cognitive biases and decision support systems development: a design science approach , 2006, Inf. Syst. J..

[72]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[73]  William H. Starbuck,et al.  How Much Better are the Most Prestigious Journals? The Statistics of Academic Publication , 2005, Organ. Sci..

[74]  Jan Marco Leimeister,et al.  Design, Implementation, and Evaluation of Trust-Supporting Components in Virtual Communities for Patients , 2005, J. Manag. Inf. Syst..

[75]  Weiguo Fan,et al.  Genetic Programming-Based Discovery of Ranking Functions for Effective Web Search , 2005, J. Manag. Inf. Syst..

[76]  Juha-Pekka Tolvanen,et al.  Managing Evolutionary Method Engineering by Method Rationale , 2004, J. Assoc. Inf. Syst..

[77]  Alok Gupta,et al.  GIST: A Model for Design and Management of Content and Interactivity of Customer-Centric Web Sites , 2004, MIS Q..

[78]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[79]  Alan M. Davis,et al.  A Unified Model of Requirements Elicitation , 2004, J. Manag. Inf. Syst..

[80]  Daniel Robey,et al.  Identity, Legitimacy and the Dominant Research Paradigm: An Alternative Prescription for the IS Discipline: A Response to Benbasat and Zmud's Call for Returning to the IT Artifact , 2003, J. Assoc. Inf. Syst..

[81]  Gerardine DeSanctis,et al.  The Social Life of Information Systems Research: A Response to Benbasat and Zmud's Call for Returning to the IT Artifact , 2003, J. Assoc. Inf. Syst..

[82]  Robert D. Galliers,et al.  Change as Crisis or Growth? Toward a Trans-disciplinary View of Information Systems as a Field of Study: A Response to Benbasat and Zmud's Call for Returning to the IT Artifact , 2003, J. Assoc. Inf. Syst..

[83]  Rudy Hirschheim,et al.  Crisis in the IS Field? A Critical Reflection on the State of the Discipline , 2003, J. Assoc. Inf. Syst..

[84]  Izak Benbasat,et al.  The Identity Crisis Within the IS Discipline: Defining and Communicating the Discipline's Core Properties , 2003, MIS Q..

[85]  Ken Peffers,et al.  Collaboration and Author Order: Changing Patterns in IS Research , 2003, Commun. Assoc. Inf. Syst..

[86]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[87]  Hendrik P. van Dalen,et al.  What makes a scientific article influential? The case of demographers , 2001, Scientometrics.

[88]  S. Baldi.  Normative versus social constructivist processes in the allocation of citations : A network-analytic model , 1998 .

[89]  S. Ghoshal,et al.  Social Capital, Intellectual Capital, and the Organizational Advantage , 1998 .

[90]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[91]  W. Shadish,et al.  Author Judgements about Works They Cite: Three Studies from Psychology Journals , 1995 .

[92]  Ronald N. Kostoff,et al.  Assessing Research Impact , 1994 .

[93]  Omar El Sawy,et al.  Building an Information System Design Theory for Vigilant EIS , 1992, Inf. Syst. Res..

[94]  M. H. MacRoberts,et al.  Problems of citation analysis: A critical review , 1989, JASIS.

[95]  Loet Leydesdorff,et al.  Towards a theory of citation? , 1987, Scientometrics.

[96]  J. A. Stewart,et al.  Achievement and Ascriptive Processes in the Recognition of Scientific Articles , 1983 .

[97]  K. Knorr-Cetina.  The Manufacture of Knowledge: an Essay on the Constructivist and Contextual Nature of Science , 1982 .

[98]  Robert P. Bostrom,et al.  Mis problems and failures: a socio-technical perspective , 1977 .

[99]  Robert P. Bostrom,et al.  MIS Problems and failures: a sociotechnical perspective part I: the cause , 1977 .

[100]  G. Gilbert.  Referencing as Persuasion , 1977 .

[101]  M. Moravcsik,et al.  Some Results on the Function and Quality of Citations , 1975 .

[102]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[103]  E Garfield,et al.  "Science Citation Index"--A New Dimension in Indexing. , 1964, Science.

[104]  Andrea Bergmann,et al.  Citation Indexing Its Theory And Application In Science Technology And Humanities , 2016 .

[105]  Vijayan Sugumaran,et al.  The State of Design Science Research within the BISE Community: An Empirical Investigation , 2014, ICIS.

[106]  Varun Grover,et al.  What Affects Citation Counts in MIS Research Articles? An Empirical Investigation , 2014, Commun. Assoc. Inf. Syst..

[107]  E. Burton Swanson,et al.  A Simple Research Impacts Model Applied to the Information Systems Field , 2014, Commun. Assoc. Inf. Syst..

[108]  Kai Zimmermann,et al.  Read This! How to Boost the Interest towards Research Articles - A Study on SSRN Research Impact , 2014, ICIS.

[109]  W. Myers,et al.  Atypical Combinations and Scientific Impact , 2013 .

[110]  Erik Brynjolfsson,et al.  Network Analysis for Predicting Academic Impact , 2013, ICIS.

[111]  Joseph Feller,et al.  Procedurally Transparent Design Science Research: A Design Process Model , 2012, ICIS.

[112]  S. Chatterjee,et al.  Design Science Research in Information Systems , 2010 .

[113]  Varun Grover,et al.  The Effect of an IS Article's Structure on Its Impact , 2010, Commun. Assoc. Inf. Syst..

[114]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[115]  Juhani Iivari,et al.  A Paradigmatic Analysis of Information Systems As a Design Science , 2007, Scand. J. Inf. Syst..

[116]  Claudia Löbbecke,et al.  Research Importance in the Information Systems Field: A Citations Analysis , 2007, ICIS.

[117]  Jennifer Jie Xu,et al.  The Social Identity of IS: Analyzing the Collaboration Network of the ICIS Conferences (1980-2005) , 2006, ICIS.

[118]  Kalle Lyytinen,et al.  The Legacy of "Power and Politics" in Disciplinary Discourse: A Citation Analysis , 2006, ICIS.

[119]  Omar A. El Sawy,et al.  Assessing Information System Design Theory in Perspective: How Useful Was our 1992 Initial Rendition? , 2004 .

[120]  R. Kostoff.  The (scientific) wealth of nations , 2004 .

[121]  Ron Weber,et al.  Still desperately seeking the IT artifact , 2003 .

[122]  F. E.,et al.  A Relational Model of Data Large Shared Data Banks , 2000 .

[123]  Per Ottar Seglen,et al.  Causal relationship between article citedness and journal impact , 1994 .

[124]  Anthony F. J. van Raan,et al.  On Determinants of Citation Scores: A Case Study in Chemical Engineering , 1994, J. Am. Soc. Inf. Sci..

[125]  I. Lakatos.  Falsification and the Methodology of Scientific Research Programmes , 1976 .

[126]  K. Back.  The sociology of science: Theoretical and empirical investigations. , 1975 .