Research in Information Systems: An Empirical Study of Diversity in the Discipline and Its Journals

Throughout its history, the information systems (IS) discipline has engaged in extensive self-examination, particularly with regard to its apparent diversity. Our overall objective in this study is to better understand the diversity in IS research, and the extent to which diversity is universal across journals that publish IS research. We developed a classification system that comprises five key characteristics of diversity (reference discipline, level of analysis, topic, research approach, and research method) based on a review of prior literature. We then examined articles over a five-year period, from 1995 to 1999, in five journals acknowledged as the top journals of the field, at least in NorthAmerica.Analyses reveal considerable diversity in each of the key characteristics. Perhaps not surprisingly, the research approach used is more focused with most studies being conducted using hypothetico-deductive approaches, whereas reference discipline is perhaps the most diverse of the characteristics examined. An interesting finding is that IS itself emerged as a key reference discipline in the late 1990s. The Journal of Management Information Systems and Information Systems Research publish articles displaying the greatest diversity, and MIS Quarterly and Decision Sciences publish articles that focus on subsets of the field. Our research provides a foundation for addressing the direction that diversity in the IS discipline takes over time. In the shorter term, researchers can use our classification system as a guide to writing abstracts and selecting key words, and the findings of our journal analyses to determine the best outlet for their type of research.

[1]  E. Burton Swanson,et al.  Information Systems Research Thematics: Submissions to a New Journal, 1987-1992 , 1993, Inf. Syst. Res..

[2]  Suzanne Rivard,et al.  An Information Systems Keyword Classification Scheme , 1988, MIS Q..

[3]  Guy Fitzgerald,et al.  Research methods in information systems , 1985 .

[4]  Geoff Walsham,et al.  The Emergence of Interpretivism in IS Research , 1995, Inf. Syst. Res..

[5]  Jeffrey Pfeffer,et al.  Mortality, Reproducibility, and the Persistence of Styles of Theory , 1995 .

[6]  F FarhoomandAli Scientific progress of management information systems , 1987 .

[7]  Dale Goodhue,et al.  Develop Long-Term Competitiveness through IT Assets , 1996 .

[8]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[9]  Reza Barkhi,et al.  THE STATE OF THEORETICAL DIVERSITY IN INFORMATION SYSTEMS , 1996 .

[10]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[11]  Henk G. Sol,et al.  Decision support systems: A decade in perspective , 1987, Decis. Support Syst..

[12]  K. Lyytinen,et al.  Exploring the intellectual structures of information systems development: A social action theoretic analysis , 1996 .

[13]  T. Kuhn The structure of scientific revolutions, 3rd ed. , 1996 .

[14]  Maurice Landry,et al.  A disciplined methodological pluralism for mis research , 1992 .

[15]  T. H. Kwon,et al.  Unifying the fragmented models of information systems implementation , 1987 .

[16]  Bill C. Hardgrave,et al.  Forums for information systems scholars: III , 2001, Inf. Manag..

[17]  Viswanath Venkatesh,et al.  Creation of Favorable User Perceptions: Exploring the Role of Intrinsic Motivation , 1999, MIS Q..

[18]  Maryam Alavi,et al.  The ecology of MIS research: a twenty year status review , 1989, ICIS '89.

[19]  Scott Hamilton,et al.  MIS research strategies , 1982, Inf. Manag..

[20]  Anne H. Soukhanov,et al.  The american heritage dictionary of the english language , 1992 .

[21]  E. Burton Swanson,et al.  Research in Management Information Systems, 1980-1984: Points of Work and Reference , 1986, MIS Q..

[22]  Izak Benbasat,et al.  Evaluating the Impact of DSS, Cognitive Effort, and Incentives on Strategy Selection , 1999, Inf. Syst. Res..

[23]  Scott Hamilton,et al.  Knowledge Utilization Among MIS Researchers , 1982, MIS Q..

[24]  Daniel Robey,et al.  Research Commentary: Diversity in Information Systems Research: Threat, Promise, and Responsibility , 1996, Inf. Syst. Res..

[25]  J CulnanMary Mapping the intellectual structure of MIS, 1980-1985: a co-citation analysis , 1987 .

[26]  Jay F. Nunamaker,et al.  Verifying the Proximity and Size Hypothesis for Self-Organizing Maps , 2000, J. Manag. Inf. Syst..

[27]  J. Beckmann,et al.  Action control : from cognition to behavior , 1985 .

[28]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[29]  A. Milton Jenkins,et al.  RESEARCH METHDOLOGIES AND MIS RESEARCH , 2000 .

[30]  Jay F. Nunamaker,et al.  Systems Development in Information Systems Research , 1990, J. Manag. Inf. Syst..

[31]  R. A. Rademacher,et al.  The Changing Profile of Information Systems Research: 1995–2000 , 2001, J. Comput. Inf. Syst..

[32]  Rajiv Sabherwal,et al.  An analysis of research in information systems from the IS executive's perspective , 1989, Inf. Manag..

[33]  J. V. Maanen,et al.  Fear and Loathing in Organization Studies , 1995 .

[34]  Diane Lending,et al.  Update on MIS research: a profile of leading journals and U.S. universities , 1992, DATB.

[35]  Vincent S. Lai,et al.  Exploring the research in information technology implementation , 1997, Inf. Manag..

[36]  C. Brodsky The Discovery of Grounded Theory: Strategies for Qualitative Research , 1968 .

[37]  Richard T. Watson,et al.  Measuring Information Systems Service Quality: Lessons From Two Longitudinal Case Studies , 1998, MIS Q..

[38]  I. Ajzen,et al.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[39]  Hugh J. Watson,et al.  Leaders Assess the Current State of the Academic IS Discipline , 1999, Commun. Assoc. Inf. Syst..

[40]  Hugh J. Watson,et al.  Business School Deans Assess the Current State of the IS Academic Field , 2000, Commun. Assoc. Inf. Syst..

[41]  Douglas R. Vogel,et al.  MIS research: a profile of leading journals and universities , 1984, DATB.

[42]  Varun Grover,et al.  Research in MIS—points of work and reference: a replication and extension of the Culnan and Swanson study , 1992, DATB.

[43]  Scott Hamilton,et al.  The journal communication system for MIS research , 1982, DATB.

[44]  Donald H. Drury,et al.  A Historiographical Examination of Information Systems , 1999, Commun. Assoc. Inf. Syst..

[45]  Iris Vessey,et al.  Cognitive Fit: A Theory‐Based Analysis of the Graphs Versus Tables Literature* , 1991 .

[46]  Mary J. Culnan,et al.  The intellectual development of management information systems, 1972-1982: a co-citation analysis , 1986 .

[47]  Izak Benbasat,et al.  Research Commentary: Rethinking "Diversity" in Information Systems Research , 1996, Inf. Syst. Res..

[48]  H. Echols Scientific Community , 1972, Nature.

[49]  Stu Westin,et al.  Cross-Fertilization of Knowledge: The Case of MIS and its Reference Disciplines , 1994 .

[50]  Icek Ajzen,et al.  From Intentions to Actions: A Theory of Planned Behavior , 1985 .

[51]  William Morris The American Heritage dictionary of the English language , 1969 .

[52]  Ali F. Farhoomand,et al.  Scientific progress of management information systems , 1987, DATB.

[53]  R. Whitley The Intellectual and Social Organization of the Sciences (Second Edition: with new introductory chapter entitled 'Science Transformed? The Changing Nature of Knowledge Production at the End of the Twentieth Century') , 1984 .

[54]  Maurice Landry,et al.  Can the field of MIS be disciplined? , 1989, CACM.

[55]  Anil Kumar,et al.  Key Information Systems Issues: An Analysis of MIS Publications , 1996, Inf. Process. Manag..

[56]  Donald H. Drury,et al.  Diversity and Scientific Progress in the Information Systems Discipline , 2001, Commun. Assoc. Inf. Syst..

[57]  Wanda J. Orlikowski,et al.  Studying Information Technology in Organizations: Research Approaches and Assumptions , 1991, Inf. Syst. Res..

[58]  Varun Grover,et al.  The evolution of empirical research in IS: A study in IS maturity , 1993, Inf. Manag..

[59]  J. D. Bernal Science in History, Volume 4: The Social Sciences: A Conclusion , 1971 .

[60]  Peter G. W. Keen,et al.  Mis Research: Reference disciplines and a Cumulative Tradition , 1980, ICIS.

[61]  Robert L. Glass A comparative analysis of the topic areas of computer science, software engineering, and information systems , 1992, J. Syst. Softw..

[62]  Patricia Carlson,et al.  A Review of MIS Research and Disciplinary Development , 1992, J. Manag. Inf. Syst..

[63]  Jonathan Coopersmith,et al.  Texas Politics and the Fax Revolution , 1996, Inf. Syst. Res..

[64]  G. Northcraft,et al.  Serving Constituencies In Business Schools: M.B.A. Program Versus Research Performance , 2000 .

[65]  Michael J. Ginzberg,et al.  MIS and the behavioral sciences: research patterns and prescriptions , 1982, DATB.

[66]  L ChervanyNorman,et al.  Research in Management Information Systems , 1977 .

[67]  Nikolaos A. Mylonopoulos,et al.  On site: global perceptions of IS journals , 2001, CACM.

[68]  Alan R. Dennis,et al.  Lessons from the Early Adopters of Web Groupware , 1998, J. Manag. Inf. Syst..

[69]  Varun Grover,et al.  Analyzing methodological rigor of MIS survey research from 1980-1989 , 1993, Inf. Manag..

[70]  Tridas Mukhopadhyay,et al.  Software Processes and Project Performance , 1995, J. Manag. Inf. Syst..

[71]  Shouhong Wang,et al.  The Implementation of Business Process Reengineering , 1995, J. Manag. Inf. Syst..

[72]  Robert W. Blanning,et al.  The Analysis of Assumptions in Model Bases Using Metagraphs , 1998 .

[73]  Joey F. George,et al.  Exploring the software engineering component in MIS research , 1995, CACM.

[74]  Shouhong Wang The unpredictability of standard back propagation neural networks in classification applications , 1995 .

[75]  Wanda J. Orlikowski,et al.  Research Commentary: Desperately Seeking the "IT" in IT Research - A Call to Theorizing the IT Artifact , 2001, Inf. Syst. Res..

[76]  Nikolaos A. Mylonopoulos,et al.  Global perceptions of IS journals , 2001 .

[77]  Suzanne Rivard,et al.  A Keyword Classification Scheme for IS Research Literature: An Update , 1993 .

[78]  R. Hirschheim,et al.  Critical issues in information systems research , 1987 .

[79]  Judy E. Scott,et al.  Does the Trend Toward E-Business Call for Changes in the Fundamental Concepts of Information Systems? A Debate , 2000, Commun. Assoc. Inf. Syst..

[80]  J. Bakos Reducing buyer search costs: implications for electronic marketplaces , 1997 .

[81]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[82]  Reyes Gonzalez,et al.  An analysis of research in information systems (1981-1997) , 2000, Inf. Manag..

[83]  John F. Rockart,et al.  Editor’s comments , 2005, MIS Q. Executive.

[84]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[85]  J. Pfeffer Barriers to the Advance of Organizational Science: Paradigm Development as a Dependent Variable , 1993 .

[86]  A. Dennis,et al.  Serving Multiple Constituencies in the Business School: MBA Program vs. Research Performance , 2000 .