A Citation Analysis of the Evolution and State of Information Systems within a Constellation of Reference Disciplines

For the past two decades notions of “cumulative tradition” and “reference disciplines” have been a significant part of the introspective debates on the IS field. We provide an 1 Detmar Straub was the accepting senior editor. This paper was submitted on June 5, 2004, and went through three revisions. 2 We are indebted to Detmar Straub, and three anonymous reviewers for their many insightful comments on earlier drafts of this article. Grover et al./ The Evolution and State of IS Journal of the Association for Information Systems Vol. 7 No. 5, pp. 270-325/ May 2006 271 exploratory test on these notions using sociometric analysis. In doing so, we extend the work of Culnan and Swanson originally carried out about 25 years ago. By using the concept of a “work point” and “reference points” to identify where an IS article is published and the extent to which it draws from or contributes to other disciplines, we can position research in the IS field. First, a quantitative analysis of over 72,600 citations spread across 1406 IS articles in 16 journals over the period 1990-2003 reveals a distinct trend toward a cumulative tradition, a changing mix of reference disciplines, and a two-way relationship between IS and some of the more mature disciplines. Second, post-hoc content analysis provides a glimpse of how IS work is being utilized by other disciplines. Overall, our analysis indicates that IS is taking up a more socio-technical persona, building upon its own knowledge base, and repaying its debts by contributing to other disciplines. We interpret the movement towards building a cumulative tradition, and informing work in other disciplines as positive, as we strive toward being part of an intellectual network and establish centrality in areas that matter to us most.

[1]  David Y. Y. Yun,et al.  An Agent for Intelligent Model Management , 1990, J. Manag. Inf. Syst..

[2]  R. Ryan Nelson,et al.  Educational Needs as Perceived by IS and End-User Personnel: A Survey of Knowledge and Skill Requirements , 1991, MIS Q..

[3]  Jeffrey H. Moore,et al.  International Conference on Information Systems ( ICIS ) 1980 ECONOMICS AND MANAGEMENT INFORMATION SYSTEMS , 2017 .

[4]  Qing Hu,et al.  Information Technology Investments and Firms' Performance--A Duopoly Perspective , 2003, J. Manag. Inf. Syst..

[5]  M. Lynne Markus,et al.  Finding a happy medium: explaining the negative effects of electronic communication on social life at work , 1994, TOIS.

[6]  Anthony R. Hendrickson,et al.  Research Commentary. Academic Rewards for Teaching, Research, and Service: Data and Discourse , 1999, Inf. Syst. Res..

[7]  Robert J. Kauffman,et al.  Opening the "Black Box" of Network Externalities in Network Adoption , 2000, Inf. Syst. Res..

[8]  Varun Grover,et al.  Research in MIS—points of work and reference: a replication and extension of the Culnan and Swanson study , 1992, DATB.

[9]  GroverVarun,et al.  An empirically derived taxonomy of information technology structure and its relationship to organizational structure , 1996 .

[10]  Daniel Robey,et al.  A Social Process Model of User-Analyst Relationships , 1992, MIS Q..

[11]  Akbar Zaheer,et al.  Electronic Integration and Strategic Advantage: A Quasi-Experimental Study in the Insurance Industry , 1990, Inf. Syst. Res..

[12]  M. Bazerman Conducting Influential Research: The Need for Prescriptive Implications , 2005 .

[13]  Tridas Mukhopadhyay,et al.  Interdependent Benefits from Interorganizational Systems: Opportunities for Business Partner Reengineering , 1994, J. Manag. Inf. Syst..

[14]  James L. McKenney,et al.  Airline Reservations Systems: Lessons from History , 1988, MIS Q..

[15]  R. Kauffman,et al.  Appropriating Value from Computerized Reservation System Ownership in the Airline Industry , 2001 .

[16]  Efraim Turban,et al.  Integrating Expert Systems and Decision Support Systems , 1986, MIS Q..

[17]  Gordon B. Davis,et al.  Reengineering the Systems Development Process: The Link Between Autonomous Teams and Business Process Outcomes , 1997, J. Manag. Inf. Syst..

[18]  G. Hult,et al.  Faculty Perceptions of Marketing Journals , 1997 .

[19]  Moshe Zviran,et al.  Factors Affecting the Policy for Distributing Computing Resources , 1989, MIS Q..

[20]  Sirkka L. Jarvenpaa,et al.  Is Anybody Out There? Antecedents of Trust in Global Virtual Teams , 1998, J. Manag. Inf. Syst..

[21]  J. G. Miller Living systems. , 1972, Currents in modern biology.

[22]  Yannis Bakos,et al.  A Strategic Analysis of Electronic Marketplaces , 1991, MIS Q..

[23]  Lorin M. Hitt,et al.  Productivity, Business Profitability, and Consumer Surplus: Three Different Measures of Information Technology Value , 1996, MIS Q..

[24]  Robert J. Kauffman,et al.  50th Anniversary Article: The Evolution of Research on Information Systems: A Fiftieth-Year Survey of the Literature in Management Science , 2004, Manag. Sci..

[25]  Robert W. Zmud,et al.  The Influence of IT Management Practice on IT Use in Large Organizations , 1994, MIS Q..

[26]  Carol V. Brown,et al.  Alignment of the IS Functions With the Enterprise: Toward a Model of Antecedents , 1994, MIS Q..

[27]  C. Wiseman,et al.  Information systems for competitive advantage: implementation of a planning process , 1990 .

[28]  E. Burton Swanson,et al.  Information Systems Research Thematics: Submissions to a New Journal, 1987-1992 , 1993, Inf. Syst. Res..

[29]  Wanda J. Orlikowski,et al.  Studying Information Technology in Organizations: Research Approaches and Assumptions , 1991, Inf. Syst. Res..

[30]  Pantelis Kalaitzidakis,et al.  RANKINGS OF ACADEMIC JOURNALS AND INSTITUTIONS IN ECONOMICS , 2003 .

[31]  Fabrizio Ferraro,et al.  Economics Language and Assumptions: How Theories Can Become Self-Fulfilling , 2003 .

[32]  Michael J. Ginzberg,et al.  MIS and the behavioral sciences: research patterns and prescriptions , 1982, DATB.

[33]  Carol V. Brown,et al.  Reconceptualizing the Context-Design Issue for the Information Systems Function , 1998 .

[34]  Jeff Butterfield,et al.  Analyzing Information System Investments: A Game-Theoretic Approach , 2001, Inf. Syst. Manag..

[35]  Blake Ives,et al.  Executive Involvement and Participation in the Management of Information Technology , 1991, MIS Q..

[36]  Anthony Wensley,et al.  Game theory as a tool for understanding information services outsourcing , 1997, J. Inf. Technol..

[37]  Peter G. W. Keen,et al.  Mis Research: Reference disciplines and a Cumulative Tradition , 1980, ICIS.

[38]  Bill C. Hardgrave,et al.  Forums for MIS scholars , 1997, CACM.

[39]  Sree Nilakanta,et al.  Implementation of Electronic Data Interchange: An Innovation Diffusion Perspective , 1994, J. Manag. Inf. Syst..

[40]  V BrownCarol,et al.  Alignment of the IS functions with the enterprise , 1994 .

[41]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[42]  Young-Soo Chung,et al.  Critical Success Factors for is Outsourcing Implementation from an Interorganizational Relationship Perspective , 2003, J. Comput. Inf. Syst..

[43]  Patricia Carlson,et al.  A Review of MIS Research and Disciplinary Development , 1992, J. Manag. Inf. Syst..

[44]  Michael T. Vanecek,et al.  Dispersed Group Decision Making Using Nonsimultaneous Computer Conferencing: A Report of Research , 1990, J. Manag. Inf. Syst..

[45]  M. Bensaou,et al.  Interorganizational Cooperation: The Role of Information Technology an Empirical Comparison of U.S. and Japanese Supplier Relations , 1997, Inf. Syst. Res..

[46]  Paul Benjamin Lowry,et al.  Global Journal Prestige and Supporting Disciplines: A Scientometric Study of Information Systems Journals , 2004, J. Assoc. Inf. Syst..

[47]  Scott Hamilton,et al.  Knowledge Utilization Among MIS Researchers , 1982, MIS Q..

[48]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[49]  Gerardine DeSanctis,et al.  Coordination of Information Technology Management: Team-Based Structures and Computer-based Communication Systems , 1994, J. Manag. Inf. Syst..

[50]  Robert J. Kauffman,et al.  Discovering Potential and Realizing Value from Information Technology Investments , 2000, J. Manag. Inf. Syst..

[51]  M. Meehan General System Theory: Foundations, Development, Applications , 1969 .

[52]  Burt V. Bronk,et al.  Hierarchy of sciences , 1977 .

[53]  Richard Y. Wang,et al.  Modeling Information Manufacturing Systems to Determine Information Product Quality Management Scien , 1998 .

[54]  Mary J. Culnan,et al.  The intellectual development of management information systems, 1972-1982: a co-citation analysis , 1986 .

[55]  Eric K. Clemons,et al.  Alternative Securities Trading Systems: Tests and Regulatory Implications of the Adoption of Technology , 1996, Inf. Syst. Res..

[56]  Pairin Katerattanakul,et al.  Is information systems a reference discipline? , 2006, CACM.

[57]  E. Burton Swanson,et al.  Research in Management Information Systems, 1980-1984: Points of Work and Reference , 1986, MIS Q..

[58]  T. S. Ragu-Nathan,et al.  Investigating the Level of End-User Development and Involvement Among Time-Based Competitors , 2002, Decis. Sci..

[59]  Daniel Robey,et al.  User Response to an Online Information System: A Field Experiment , 1986, MIS Q..

[60]  John B. Miner,et al.  The Validity and Usefulness of Theories in an Emerging Organizational Science , 1984 .

[61]  Kalle Lyytinen,et al.  Nothing At The Center?: Academic Legitimacy in the Information Systems Field , 2004, J. Assoc. Inf. Syst..

[62]  Jay F. Nunamaker,et al.  Automating Planning Environments: Knowledge Integration and Model Scripting , 1986, J. Manag. Inf. Syst..

[63]  Stephanie S. Barrett,et al.  Inter-Organization Information Sharing Systems , 1982, MIS Q..

[64]  K. Peffers,et al.  Identifying and Evaluating the Universe of Outlets for Information Systems Research: Ranking the Journals , 2003 .

[65]  B. R. Nault,et al.  Mitigating Underinvestment Through an IT-Enabled Organization Form , 1996 .

[66]  Olivia R. Liu Sheng,et al.  Integrating expert systems with group decision support systems , 1991, TOIS.

[67]  M. Maznevski,et al.  Bridging Space Over Time: Global Virtual Team Dynamics and Effectiveness , 2000 .

[68]  Rajiv Sabherwal,et al.  The Dynamics of Alignment: Insights from a Punctuated Equilibrium Model , 2001 .

[69]  Niv Ahituv,et al.  A Systematic Approach Toward Assessing the Value of an Information System , 1980, MIS Q..

[70]  Wanda J. Orlikowski,et al.  Research Commentary: Desperately Seeking the "IT" in IT Research - A Call to Theorizing the IT Artifact , 2001, Inf. Syst. Res..

[71]  Robert P. Bostrom,et al.  Mis problems and failures: a socio-technical perspective , 1977 .

[72]  Ken Peffers,et al.  The Impact of Information Technology Investment Announcements on the Market Value of the Firm , 1993, Inf. Syst. Res..

[73]  Gordon B. Davis,et al.  Management information systems : conceptual foundations, structure, and development , 1985 .

[74]  Wanda J. Orlikowski,et al.  Information Technology and the Structuring of Organizations , 2011 .

[75]  F FarhoomandAli Scientific progress of management information systems , 1987 .

[76]  James L. McKenney,et al.  Developing an Historical Tradition in MIS Research , 1997, MIS Q..

[77]  Paul J. Dixon,et al.  Technology Issues Facing Corporate Management in the 1990s , 1989, MIS Q..

[78]  A. Pritchard,et al.  Statistical bibliography or bibliometrics , 1969 .

[79]  Nikolaos A. Mylonopoulos,et al.  Global perceptions of IS journals , 2001 .

[80]  Blake Ives,et al.  Information Technology and Corporate Strategy: A View from the Top , 1990, Inf. Syst. Res..

[81]  M. Markus Electronic Mail as the Medium of Managerial Choice , 1994 .

[82]  Btjbsell L. Ackoft,et al.  MANAGEMENT MISINFORMATION SYSTEMS* , 2007 .

[83]  Michael R. Vitale,et al.  Creating Competitive Advantage with Interorganizational Information Systems , 1988, MIS Q..

[84]  A. Zaheer,et al.  Determinants of Electronic Integration in the Insurance Industry: An Empirical Test , 1994 .

[85]  Allen S. Lee A Scientific Methodology for MIS Case Studies , 1989, MIS Q..

[86]  Ross Hightower,et al.  Effects of Communication Mode and Prediscussion Information Distribution Characteristics on Information Exchange in Groups , 1996, Inf. Syst. Res..

[87]  Sunder Kekre,et al.  Strategic and Operational Benefits of Electronic Integration in B2B Procurement Processes , 2002, Manag. Sci..

[88]  Norman L. Chervany,et al.  The Relationship Between Organizational Characteristics and the Structure of the Information Services Function , 1980, MIS Q..

[89]  Wim Bouman,et al.  Balance in Business Reengineering: An Empirical Study of Fit and Performance , 1997, J. Manag. Inf. Syst..

[90]  Daniel Robey,et al.  Identity, Legitimacy and the Dominant Research Paradigm: An Alternative Prescription for the IS Discipline: A Response to Benbasat and Zmud's Call for Returning to the IT Artifact , 2003, J. Assoc. Inf. Syst..

[91]  Izak Benbasat,et al.  Research Commentary: Rethinking "Diversity" in Information Systems Research , 1996, Inf. Syst. Res..

[92]  Hamid Tavakolian,et al.  Linking the Information Technology Structure with Organizational Competitive Strategy: A Survey , 1989, MIS Q..

[93]  Rajiv Sabherwal,et al.  Alignment Between Business and IS Strategies: A Study of Prospectors, Analyzers, and Defenders , 2001, Inf. Syst. Res..

[94]  Tor Guimaraes,et al.  Exploring the Importance of Business Clockspeed as a Moderator for Determinants of Supplier Network Performance , 2002, Decis. Sci..

[95]  William R. King,et al.  Strategic Planning for Management Information Systems , 1978, MIS Q..

[96]  A. Milton Jenkins,et al.  What the information analyst should know about body language , 1977 .

[97]  George P. Huber,et al.  Issues in the Design of Group Decision Support Systems , 1984, MIS Q..

[98]  Rob Kling,et al.  The Web of Computing: Computer Technology as Social Organization , 1982, Adv. Comput..

[99]  Blake Ives,et al.  Applications of Global Information Technology: Key Issues for Management , 1991, MIS Q..

[100]  James N. Baron,et al.  The Impact of Economics on Contemporary Sociology , 1994 .

[101]  Louis Kaplow,et al.  Economic Analysis of Law , 2004 .

[102]  Michael H. Zack,et al.  Interactivity and Communication Mode Choice in Ongoing Management Groups , 1993, Inf. Syst. Res..

[103]  P. Kotler,et al.  Marketing in the Network Economy , 1999 .

[104]  Starr Roxanne Hiltz,et al.  Distributed Group Support Systems , 1993, MIS Q..

[105]  Henri Barki,et al.  Measuring User Participation, User Involvement, and User Attitude , 1994, MIS Q..

[106]  Charles H. Kriebel,et al.  Contributions of the management sciences to the evolution of management information systems , 1982, DATB.

[107]  Carol V. Brown Examining the Emergence of Hybrid IS Governance Solutions: Evidence From a Single Case Site , 1997, Inf. Syst. Res..

[108]  Daniel Robey,et al.  Research Commentary: Diversity in Information Systems Research: Threat, Promise, and Responsibility , 1996, Inf. Syst. Res..

[109]  Sunder Kekre,et al.  Business Value of Information Technology: A Study of Electronic Data Interchange , 1995, MIS Q..

[110]  Ian I. Mitroff,et al.  A Program for Research on Management Information Systems , 1973 .

[111]  Varun Grover,et al.  Six Myths of Information and Markets: Information Technology Networks, Electronic Commerce, and The Battle for Consumer Surplus , 1999, MIS Q..

[112]  Il Im,et al.  Topics of interest in IS: evolution of themes and differences between research and practice , 1999, Inf. Manag..

[113]  Wanda J. Orlikowski,et al.  Learning from Notes: organizational issues in groupware implementation , 1992, CSCW '92.

[114]  Young-Gul Kim,et al.  Effect of Partnership Quality on IS Outsourcing Success: Conceptual Framework and Empirical Validation , 1999, J. Manag. Inf. Syst..

[115]  Varun Grover,et al.  An Empirically Derived Taxonomy of Information Technology Structure and Its Relationship to Organizational Structure , 1996, J. Manag. Inf. Syst..

[116]  Huseyin Leblebici New Directions for Organization Theory: Problems and Prospects , 1999 .

[117]  Marios Koufaris,et al.  Applying the Technology Acceptance Model and Flow Theory to Online Consumer Behavior , 2002, Inf. Syst. Res..

[118]  Jay F. Nunamaker,et al.  Information Technology to Support Electronic Meetings , 1988, MIS Q..

[119]  Hugh J. Watson,et al.  Critical Success Factors for Information Center Managers , 1988, MIS Q..

[120]  Donna B. Stoddard,et al.  Reengineering: Business Change of Mythic Proportions? , 1994, MIS Q..

[121]  William J. Kettinger,et al.  Business Process Change: A Study of Methodologies, Techniques, and Tools , 1997, MIS Q..

[122]  Erik Brynjolfsson,et al.  Information Technology and Productivity: A Review of the Literature , 1996, Adv. Comput..

[123]  Gerardine DeSanctis,et al.  The Social Life of Information Systems Research: A Response to Benbasat and Zmud's Call for Returning to the IT Artifact , 2003, J. Assoc. Inf. Syst..

[124]  Starr Roxanne Hiltz,et al.  Group Decision Support: The Effects of Designated Human Leaders and Statistical Feedback in Computerized Conferences , 1991, J. Manag. Inf. Syst..

[125]  Herman Manakyan,et al.  A citation analysis of business computing research journals , 1993, Inf. Manag..

[126]  Yolande E. Chan,et al.  Business Strategic Orientation, Information Systems Strategic Orientation, and Strategic Alignment , 1997, Inf. Syst. Res..

[127]  Albert S. Dexter,et al.  Added Value and Pricing with Information Technology , 1995, MIS Q..

[128]  John F. Rockart,et al.  Changing Role of the Corporate Information Systems Officer , 1985, MIS Q..

[129]  Sirkka L. Jarvenpaa,et al.  Consumer trust in an Internet store , 2000, Inf. Technol. Manag..

[130]  JelassiTawfik,et al.  Competing through EDI at Brun Passot , 1994 .

[131]  Charles H. Kriebel,et al.  Information Technologies and Business Value: An Analytic and Empirical Investigation , 1995, Inf. Syst. Res..

[132]  Olivia R. Liu Sheng,et al.  Artificial intelligence based simulation in the design of a GDSS idea generation tool , 1991, Inf. Manag..

[133]  Varun Grover,et al.  Business Process Change and Organizational Performance: Exploring an Antecedent Model , 1997, J. Manag. Inf. Syst..

[134]  Bill C. Hardgrave,et al.  Forums for management information systems scholars , 1995, CACM.

[135]  Starr Roxanne Hiltz,et al.  The Effects of Distributed Group Support and Process Structuring on Software Requirements Development Teams: Results on Creativity and Quality , 1995, J. Manag. Inf. Syst..

[136]  Gordon B. Davis,et al.  A Research Perspective for Information Systems and Example of Emerging Area of Research , 1999, Inf. Syst. Frontiers.

[137]  Yannis Bakos,et al.  Information Links and Electronic Marketplaces: The Role of Interorganizational Information Systems in Vertical Markets , 1991, J. Manag. Inf. Syst..

[138]  Eric K. Clemons,et al.  McKesson Drug Company: A Case Study of Economost - A Strategic Information System , 1988, J. Manag. Inf. Syst..

[139]  Starr Roxanne Hiltz,et al.  Effects of Four Modes of Group Communication on the Outcomes of Software Requirements Determination , 1998, J. Manag. Inf. Syst..

[140]  Varun Grover,et al.  Special Section: Toward a Theory of Business Process Change Management , 1995, J. Manag. Inf. Syst..

[141]  Louis Raymond,et al.  Identification of Strategic Information Systems Opportunities: Applying and Comparing Two Methodologies , 1991, MIS Q..

[142]  Jeffrey E. Kottemann,et al.  Information Systems Planning and Development: Strategic Postures and Methodologies , 1984, J. Manag. Inf. Syst..

[143]  R. Pieters,et al.  Who talks to whom? Intra-and interdisciplinary communication of economics journals , 2002 .

[144]  Peter Weill,et al.  The Relationship Between Investment in Information Technology and Firm Performance: A Study of the Valve Manufacturing Sector , 1992, Inf. Syst. Res..

[145]  Sue Holwell,et al.  Information, Systems and Information Systems: Making Sense of the Field , 1998 .

[146]  D. Green,et al.  Pathologies of Rational Choice Theory: A Critique of Applications in Political Science , 1994 .

[147]  Gordon B. Davis,et al.  The Knowledge and Skill Requirements for the doctorate in MIS , 1980, International Conference on Interaction Sciences.

[148]  Deborah Estrin,et al.  Inter-organization networks, computer integration, and shifts in interdependence: the case of the semiconductor industry , 1991, TOIS.

[149]  Nick Rackoff,et al.  SIM Competition Paper: Information Systems for Competitive Advantage: Implemenation of a Planning Process , 1985, MIS Q..

[150]  William L. Fuerst,et al.  Information technology and sustained competitive advantage: a resource-based analysis , 1995 .

[151]  Phillip Ein-Dor,et al.  Organizational Context and MIS Structure: Some Empirical Evidence , 1982, MIS Q..

[152]  R. Kelly Rainer,et al.  The Influence of Individual Differences on Skill in End-User Computing , 1992, J. Manag. Inf. Syst..

[153]  Venkataraman Ramesh,et al.  Research in Information Systems: An Empirical Study of Diversity in the Discipline and Its Journals , 2002, J. Manag. Inf. Syst..

[154]  Varun Grover,et al.  The Effect of Service Quality and Partnership on the Outsourcing of Information Systems Functions , 1996, J. Manag. Inf. Syst..

[155]  Detmar W. Straub,et al.  Current and Future Uses of the Group Decision Support System Technology: Report on a Recent Empirical Study , 1988, J. Manag. Inf. Syst..

[156]  J. Robb Dixon,et al.  Information Systems Adaptation and the Successful Implementation of Advanced Manufacturing Technologies , 1999 .

[157]  Izak Benbasat,et al.  Empirical Research in Information Systems: The Practice of Relevance , 1999, MIS Q..

[158]  Donald P. Ballou,et al.  Designing Information Systems to Optimize the Accuracy-Timeliness Tradeoff , 1995, Inf. Syst. Res..

[159]  Maurice Landry,et al.  Can the field of MIS be disciplined? , 1989, CACM.

[160]  Norman L. Chervany,et al.  An Experimental Evaluation of Information Overload in a Production Environment , 1974 .

[161]  Andrew C. Boynton,et al.  Information Architecture: In Search of Efficient Flexibility , 1991, MIS Q..

[162]  Ralph H. Sprague,et al.  A Framework for the Development of Decision Support Systems , 1993 .

[163]  Peter Weill,et al.  An Assessment of the Contingency Theory of Management Information Systems , 1989, J. Manag. Inf. Syst..

[164]  Shouhong Wang,et al.  The Implementation of Business Process Reengineering , 1995, J. Manag. Inf. Syst..