Assessing the Impact of Premier Information Systems Research over Time

In this study we examine the influence of premier information systems research over time to assess the maturity of the Information Systems (IS) field and its impact on subsequent IS and non-IS research. 19,357 citations from the Social Science Citation Index (SSCI) (1982-2004) are attributed to 879 articles published in MIS Quarterly (MISQ), Information Systems Research (ISR), and the IS articles from Management Science (MS) between 1982 and 2004, and this number continues to increase over time. The results suggest that research in premier IS journals has an influence on other disciplines as 7,137 citations come from outside the IS discipline and this number continues to increase over time. Of particular note is the consistent increase over time in citations of premier IS research articles from the management, engineering and physical sciences, organizational behavior, and computer science disciplines. Given recent debates regarding the IT artifact, we also directly test the impact of articles that address the IT artifact and those that do not. We find that articles that directly address the IT artifact are cited significantly more often than those that do not, consistent with arguments made by Benbasat et al. [2003].

[1]  Varun Grover,et al.  The evolution of empirical research in IS: A study in IS maturity , 1993, Inf. Manag..

[2]  Herman Manakyan,et al.  A citation analysis of business computing research journals , 1993, Inf. Manag..

[3]  Joseph A. Cote,et al.  Assessing the Influence of Journal of Consumer Research: A Citation Analysis , 1991 .

[4]  Mary J. Culnan,et al.  Mapping the Intellectual Structure of MIS, 1980-1985: A Co-Citation Analysis , 1987, MIS Q..

[5]  Henry C. Lucas,et al.  The information systems identity crisis , 2005 .

[6]  Daniel Robey,et al.  Identity, Legitimacy and the Dominant Research Paradigm: An Alternative Prescription for the IS Discipline: A Response to Benbasat and Zmud's Call for Returning to the IT Artifact , 2003, J. Assoc. Inf. Syst..

[7]  N. Carr.  IT doesn't matter , 2003, IEEE Engineering Management Review.

[8]  Daniel Robey,et al.  Research Commentary: Diversity in Information Systems Research: Threat, Promise, and Responsibility , 1996, Inf. Syst. Res..

[9]  David Blair,et al.  Communicating MIS Research: A Citation Study of Journal Influence , 1993, Inf. Process. Manag..

[10]  Rudy Hirschheim,et al.  Crisis in the IS Field? A Critical Reflection on the State of the Discipline , 2003, J. Assoc. Inf. Syst..

[11]  Bill C. Hardgrave,et al.  Forums for MIS scholars , 1997, CACM.

[12]  Scott Hamilton,et al.  Communication of MIS Research: an Analysis of Journal Stratification , 1980, ICIS.

[13]  Paul F. Anderson,et al.  Marketing, Scientific Progress, and Scientific Method , 1983 .

[14]  Varun Grover,et al.  An assessment of institutional research productivity in MIS , 1992, DATB.

[15]  Izak Benbasat,et al.  Empirical Research in Information Systems: The Practice of Relevance , 1999, MIS Q..

[16]  M. Moravcsik,et al.  Some Results on the Function and Quality of Citations , 1975 .

[17]  Izak Benbasat,et al.  The Identity Crisis Within the IS Discipline: Defining and Communicating the Discipline's Core Properties , 2003, MIS Q..

[18]  Lori N. K. Leonard,et al.  Citation classics from the information systems literature , 2000, Inf. Manag..

[19]  K. Peffers,et al.  Identifying and Evaluating the Universe of Outlets for Information Systems Research: Ranking the Journals , 2003 .

[20]  Mark L. Gillenson,et al.  Academic Issues in MIS: Journals and Books , 1991, MIS Q..

[21]  Kee Young Kim,et al.  An Assessment of Individual and Institutional Research Productivity in DEA , 1998 .

[22]  C. Avgerou,et al.  The academic field of information systems in Europe , 1999 .

[23]  Detmar W. Straub,et al.  Measuring Researcher-Production in Information Systems , 2002, J. Assoc. Inf. Syst..

[24]  Patricia Carlson,et al.  A Review of MIS Research and Disciplinary Development , 1992, J. Manag. Inf. Syst..

[25]  Suzanne Rivard,et al.  A Keyword Classification Scheme for IS Research Literature: An Update , 1993 .

[26]  Nikolaos A. Mylonopoulos,et al.  On site: global perceptions of IS journals , 2001, CACM.

[27]  Diane Lending,et al.  Update on MIS research: a profile of leading journals and U.S. universities , 1992, DATB.

[28]  Mary J. Culnan,et al.  The intellectual development of management information systems, 1972-1982: a co-citation analysis , 1986 .

[29]  Izak Benbasat,et al.  Research Commentary: Rethinking "Diversity" in Information Systems Research , 1996, Inf. Syst. Res..

[30]  Pairin Katerattanakul,et al.  Are European IS Journals under-rated? An answer based on citation analysis , 2003, Eur. J. Inf. Syst..

[31]  E. Burton Swanson,et al.  Research in Management Information Systems, 1980-1984: Points of Work and Reference , 1986, MIS Q..

[32]  James Backhouse,et al.  On the discipline of information systems , 1991, Inf. Syst. J..

[33]  Ronald A. Berk,et al.  How to Use Citation Analysis for Faculty Evaluations, and When Is It Relevant? Part 1 , 1983 .

[34]  Mark D. Miller,et al.  Examining differences across journal rankings , 2005, CACM.

[35]  Scott Hamilton,et al.  Knowledge Utilization Among MIS Researchers , 1982, MIS Q..

[36]  Russell L. Ackoff,et al.  Management misinformation systems , 1967 .

[37]  Anthony R. Hendrickson,et al.  Research Commentary. Academic Rewards for Teaching, Research, and Service: Data and Discourse , 1999, Inf. Syst. Res..

[38]  Douglas R. Vogel,et al.  MIS research: a profile of leading journals and universities , 1984, DATB.

[39]  Varun Grover,et al.  Research in MIS—points of work and reference: a replication and extension of the Culnan and Swanson study , 1992, DATB.