A Content Analysis of Content analyses in is Research: Purposes, Data Sources, and Methodological Characteristics

Qualitative research relies primarily on qualitative data in form of texts. The method of content analysis (CA) represents a scientifically well-founded and effective solution for making valid inferences from varied sources of textual information. This paper investigates the use of CA in the context of high-quality IS research with a focus on the underlying research questions, data sources, and methodological characteristics. Building on that, distinctive patterns, trends through time, and potentials will be discussed and compared with a reference discipline (organizational research). The results indicate that the general application of CA in high-quality IS research has steadily increased. In this context, CA is used in a very wide range of ways to understand and explain complex phenomena. Furthermore, CA is frequently used to categorize primary data collections, derived, for example, from transcribed interviews or open-ended surveys, and to transform qualitative data into quantitative outcomes. Besides other methodological issues, the increasing application of computational approaches seems to distinguish the IS discipline. Finally, this paper should also serve as an introduction to CA, bring transparency with respect to the methodological characteristics, and inspire researchers to carry out further CAs in the context of IS research.

[1]  Victor R. Prybutok,et al.  Latent Semantic Analysis: five methodological recommendations , 2012, Eur. J. Inf. Syst..

[2]  Izak Benbasat,et al.  Attributions of Trust in Decision Support Technologies: A Study of Recommendation Agents for E-Commerce , 2008, J. Manag. Inf. Syst..

[3]  Christine Moser,et al.  Communicative genres as organising structures in online communities – of team players and storytellers , 2013, Inf. Syst. J..

[4]  Daniel Riffe,et al.  A Content Analysis of Content Analyses: Twenty-Five Years of Journalism Quarterly , 1997 .

[5]  John Mingers,et al.  The paucity of multimethod research: a review of the information systems literature , 2003, Inf. Syst. J..

[6]  Samer Faraj,et al.  The Structure of Collaboration in Electronic Networks , 2008, J. Assoc. Inf. Syst..

[7]  InduShobha N. Chengalur-Smith,et al.  Metrics for characterizing the form of security policies , 2010, J. Strateg. Inf. Syst..

[8]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[9]  Rajiv Kishore,et al.  Outsourcing Success: Psychological Contract Perspective , 2007, AMCIS.

[10]  John Chelliah,et al.  Disintermediation of traditional chemical intermediary roles in the Electronic Business-to-Business (e-B2B) exchange world , 2011, J. Strateg. Inf. Syst..

[11]  Sonja Wiley-Patton,et al.  Building Legitimacy for IT Innovations: The Case of Computerized Physician Order Entry Systems , 2010, J. Assoc. Inf. Syst..

[12]  Liisa von Hellens,et al.  Qualitative Research in Information Systems , 2007, Australas. J. Inf. Syst..

[13]  S. Elo,et al.  Qualitative Content Analysis , 2014 .

[14]  Margaret Tan,et al.  Establishing Mutual Understanding in Systems Design: An Empirical Study , 1994, J. Manag. Inf. Syst..

[15]  T. Scandura,et al.  Research Methodology In Management: Current Practices, Trends, And Implications For Future Research , 2000 .

[16]  Angelika Dimoka,et al.  The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation , 2006, Inf. Syst. Res..

[17]  Henrique Mello Rodrigues de Freitas,et al.  Content Analyzing Qualitative Data on Information Systems , 1998 .

[18]  Mary Lacity,et al.  Understanding Qualitative Data: A Framework of Text Analysis Methods , 1994, J. Manag. Inf. Syst..

[19]  John M. Ward,et al.  A study of subsidiaries' views of information systems strategic planning in multinational organisations , 2007, J. Strateg. Inf. Syst..

[20]  Steven E. Stemler,et al.  An Overview of Content Analysis. , 2001 .

[21]  Sarah Spiekermann,et al.  Online social networks: why we disclose , 2010, J. Inf. Technol..

[22]  Gail Ridley,et al.  Theoretical approaches to gender and IT: examining some Australian evidence , 2012, Inf. Syst. J..

[23]  Nirup M. Menon,et al.  Managing Technology and Administration Innovations: Four Case Studies on Software Reuse , 2004, J. Assoc. Inf. Syst..

[24]  Anindya Ghose,et al.  Internet Exchanges for Used Goods: An Empirical Analysis of Trade Patterns and Adverse Selection , 2008, MIS Q..

[25]  Anandhi Bharadwaj,et al.  An Empirical Analysis of Contract Structures in IT Outsourcing , 2009, Inf. Syst. Res..

[26]  Michael J. Gallivan,et al.  Striking a balance between trust and control in a virtual organization: a content analysis of open source software case studies , 2001, Inf. Syst. J..

[27]  Petra Schubert,et al.  B2B integration in global supply chains: An identification of technical integration scenarios , 2011, J. Strateg. Inf. Syst..

[28]  Michael J. Gallivan,et al.  Trust, control and the role of interorganizational systems in electronic partnerships , 2003, Inf. Syst. J..

[29]  James D. McKeen,et al.  The Evolution of IS Job Skills: A Content Analysis of IS Job Advertisements from 1970 to 1990 , 1995, MIS Q..

[30]  René Riedl,et al.  Understanding the dominance and advocacy of the design-oriented research approach in the business informatics community: a history-based examination , 2013, J. Inf. Technol..

[31]  Erja Mustonen-Ollila,et al.  Why organizations adopt information system process innovations: a longitudinal study using Diffusion of Innovation theory , 2003, Inf. Syst. J..

[32]  Michael Parent,et al.  Relationships Between Job Skills and Performance: A Study of Webmasters , 2002, J. Manag. Inf. Syst..

[33]  Anol Bhattacherjee,et al.  Understanding Changes in Belief and Attitude Toward Information Technology Usage: A Theoretical Model and Longitudinal Test , 2004, MIS Q..

[34]  Guy Fitzgerald,et al.  Understanding web site redesigns in small- and medium-sized enterprises (SMEs): a U.K.-based study on the applicability of e-commerce Stage Models , 2009, Eur. J. Inf. Syst..

[35]  Feng Li.  Textual Analysis of Corporate Disclosures: A Survey of the Literature , 2011 .

[36]  Mark Keil,et al.  The user–developer communication process: a critical case study , 2003, Inf. Syst. J..

[37]  Rhonda K. Reger,et al.  A Content Analysis of the Content Analysis Literature in Organization Studies: Research Themes, Data Sources, and Methodological Refinements , 2007 .

[38]  Bonnie Kaplan,et al.  Qualitative Research Methods for Evaluating Computer Information Systems , 2005 .

[39]  M. McLure Wasko,et al.  "It is what one does": why people participate and help others in electronic communities of practice , 2000, J. Strateg. Inf. Syst..

[40]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[41]  Dave Oliver,et al.  Justifying enterprise resource planning adoption , 2002, J. Inf. Technol..

[42]  R. Weber.  Basic content analysis, 2nd ed. , 1990 .

[43]  Björn Niehaves,et al.  Reconstructing the giant: On the importance of rigour in documenting the literature search process , 2009, ECIS.

[44]  B. Berg.  Qualitative Research Methods for the Social Sciences , 1989 .

[45]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[46]  Kevin Crowston,et al.  Using natural language processing technology for qualitative data analysis , 2012, International Journal of Social Research Methodology.

[47]  R. Weber.  Basic Content Analysis , 1986 .

[48]  Glenn A. Bowen.  Document Analysis as a Qualitative Research Method , 2009 .

[49]  Pairin Katerattanakul,et al.  Is information systems a reference discipline? , 2006, CACM.

[50]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[51]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[52]  Linda Shields,et al.  Content Analysis , 2015 .

[53]  Graham Pervan,et al.  Design Science in Decision Support Systems Research: An Assessment using the Hevner, March, Park, and Ram Guidelines , 2012, J. Assoc. Inf. Syst..

[54]  William R. King.  Text Analytics: Boon to Knowledge Management? , 2009, Inf. Syst. Manag..

[55]  Steffen Raub,et al.  The knowledge management tussle – speech communities and rhetorical strategies in the development of knowledge management , 2001, J. Inf. Technol..

[56]  Suzanne Rivard,et al.  Information Technology Implementers' Responses to User Resistance: Nature and Effects , 2012, MIS Q..

[57]  Ojelanki K. Ngwenyama,et al.  Contextual influences on user satisfaction with mobile computing: findings from two healthcare organizations , 2006, Eur. J. Inf. Syst..

[58]  Christoph Rosenkranz,et al.  The emergence of shared understanding: applying functional pragmatics to study the requirements development process , 2013, Inf. Syst. J..

[59]  Michael R. Wade,et al.  A Comprehensive Review and Synthesis of Open Source Research , 2010, J. Assoc. Inf. Syst..

[60]  Marta Indulska,et al.  Quantitative approaches to content analysis: identifying conceptual drift across publication outlets , 2012, Eur. J. Inf. Syst..

[61]  T. D. Wilson,et al.  Review of: Berg, Bruce L. Qualitative research methods for the social sciences, 6th ed. Boston, MA: Allyn and Bacon, 2007 , 2008, Inf. Res..

[62]  Colin Seymour-Ure,et al.  Content Analysis in Communication Research. , 1972 .

[63]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[64]  Jan Marco Leimeister,et al.  Towards a competency model for requirements analysts , 2012, Inf. Syst. J..

[65]  Zhenyu Huang,et al.  A comprehensive analysis of U.S. counties’ e-Government portals: development status and functionalities , 2007, Eur. J. Inf. Syst..

[66]  R. Petty,et al.  Using content analysis as a research method to inquire into intellectual capital reporting , 2004 .

[67]  Wendy L. Cukier,et al.  A critical analysis of media discourse on information technology: preliminary results of a proposed method for critical discourse analysis , 2009, Inf. Syst. J..

[68]  Robert W. Zmud,et al.  Systematic Differences in Firm's Information Technology Signaling: Implications for Research Design , 2010, J. Assoc. Inf. Syst..

[69]  Rob Gray.  Lifting the Lid on the Use of Content Analysis to Investigate Intellectual Capital Disclosures , 2013 .

[70]  Dan Remenyi,et al.  Researching information systems: data analysis methodology using content and correspondence analysis , 1992, J. Inf. Technol..

[71]  Jeremy Rose,et al.  Decoupling, re‐engaging: managing trust relationships in implementation projects , 2013, Inf. Syst. J..

[72]  Stephanie Watts,et al.  Innovative IT climates: CIO perspectives , 2006, J. Strateg. Inf. Syst..

[73]  Yogesh Kumar Dwivedi,et al.  The diffusion and use of institutional theory: a cross-disciplinary longitudinal literature survey , 2009, J. Inf. Technol..