Toward an Anatomy of "Successful" Qualitative Research Manuscripts in IS: A Critical Review and Some Recommendations

In this study, we assess the current trends and patterns of 85 qualitative research articles published over the period of 2001-2011 from four mainstream IS journals with no stated preference for qualitative research (MISQ, ISR, JMIS, JAIS). We analyze each article with respect to it anatomical elements. More specifically, we review the nature of the research question; the way the IT artifact issue is handled; theoretical engagement; methodological aspects of data collection, data analysis, and criteria of rigor; research contribution; and presentation. Our findings are not meant to be normative per se, but do make visible the strategies of authors who have been successful in publishing in the leading mainstream journals of the discipline. We also propose a set of principles that we believe can help assist authors and evaluators in further enhancing the status of qualitative research in the discipline.

[1]  Gerold Riempp,et al.  Understanding the Economic Potential of Service-Oriented Architecture , 2010, J. Manag. Inf. Syst..

[2]  Geoff Walsham,et al.  Trans-Situated Learning: Supporting a Network of Practice with an Information Infrastructure , 2009, Inf. Syst. Res..

[3]  Rudy Hirschheim,et al.  A paradigmatic and methodological examination of information systems research from 1991 to 2001 , 2004, Inf. Syst. J..

[4]  Ulrike Schultze,et al.  A Confessional Account of an Ethnography About Knowledge Work , 2000, MIS Q..

[5]  Line Dubé,et al.  Rigor in Information Systems Positivist Case Research: Current Practices , 2003, MIS Q..

[6]  J. Creswell.  Qualitative inquiry and research design: choosing among five traditions. , 1998 .

[7]  Gianluca Miscione,et al.  Telemedicine in the Upper Amazon: Interplay with Local Health Care Practices , 2007, MIS Q..

[8]  K. Weick.  What Theory Is Not, Theorizing Is , 1995 .

[9]  Izak Benbasat,et al.  The Identity Crisis Within the IS Discipline: Defining and Communicating the Discipline's Core Properties , 2003, MIS Q..

[10]  M. Markus.  The qualitative difference in information systems research and practice , 1997 .

[11]  Richard T. Vidgen,et al.  Coevolving Systems and the Organization of Agile Software Development , 2009, Inf. Syst. Res..

[12]  Barry M. Staw,et al.  What Theory is Not , 1995 .

[13]  Susan R. Fussell,et al.  Multiple Group Coordination in Complex and Dynamic Task Environments: Interruptions, Coping Mechanisms, and Technology Recommendations , 2008, J. Manag. Inf. Syst..

[14]  Gerardine DeSanctis,et al.  Kiosks, Clubs and Neighborhoods: The Language Games of Online Forums , 2008, J. Assoc. Inf. Syst..

[15]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[16]  Cecil Eng Huang Chua,et al.  Artifacts, Actors, and Interactions in the Cross-Project Coordination Practices of Open-Source Communities , 2010, J. Assoc. Inf. Syst..

[17]  Suprateek Sarker,et al.  Understanding Virtual Team Development: An Interpretive Study , 2003, J. Assoc. Inf. Syst..

[18]  M. Alvesson,et al.  Reflexive Methodology: New Vistas for Qualitative Research , 2000, QMiP Bulletin.

[19]  Brian Fitzgerald,et al.  Towards dissolution of the is research debate: from polarization to polarity , 1998, J. Inf. Technol..

[20]  Kalle Lyytinen,et al.  The Disruptive Nature of Information Technology Innovations: The Case of Internet Computing in Systems Development Organizations , 2003, MIS Q..

[21]  Suprateek Sarker.  Qualitative Research Genres in the IS Literature: Emerging Issues and Potential Implications , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[22]  Jay F. Nunamaker,et al.  Toward a broader vision for Information Systems , 2011, TMIS.

[23]  W. Chismar,et al.  The interaction of institutionally triggered and technology-triggered social structure change: an investigation of computerized physician order entry , 2007 .

[24]  Wanda J. Orlikowski,et al.  Research Commentary: Desperately Seeking the "IT" in IT Research - A Call to Theorizing the IT Artifact , 2001, Inf. Syst. Res..

[25]  Merriam-Webster.  Merriam-Webster's Collegiate Dictionary , 1998 .

[26]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[27]  M. Lynne Markus,et al.  Special Issue on Intensive Research in Information Systems: Using Qualitative, Interpretive, and Case Methods to Study Information Technology-Third Installment; Foreword , 2000, MIS Q..

[28]  Cathy Urquhart,et al.  Putting the ‘theory’ back into grounded theory: guidelines for grounded theory studies in information systems , 2009, Inf. Syst. J..

[29]  Mark E. Nissen,et al.  Dynamic Knowledge Patterns to Inform Design: A Field Study of Knowledge Stocks and Flows in an Extreme Organization , 2005, J. Manag. Inf. Syst..

[30]  James A. Holstein,et al.  The new language of qualitative method , 1997 .

[31]  Saonee Sarker,et al.  Exploring Agility in Distributed Information Systems Development Teams: An Interpretive Study in an Offshoring Context , 2009, Inf. Syst. Res..

[32]  Eric Monteiro,et al.  Configurable Politics and Asymmetric Integration: Health e-Infrastructures in India , 2009, J. Assoc. Inf. Syst..

[33]  Jan Pries-Heje,et al.  Making IT Project De-Escalation Happen: An Exploration into Key Roles , 2008, J. Assoc. Inf. Syst..

[34]  E. Guba,et al.  The Only Generalization Is: There Is No Generalization , 2009 .

[35]  Paul C. van Fenema,et al.  Cocreating Understanding and Value in Distributed Work: How Members of Onsite and Offshore Vendor Teams Give, Make, Demand, and Break Sense , 2008, MIS Q..

[36]  Emmanuel Josserand,et al.  Online Reverse Auctions and the Dynamics of Trust , 2008, J. Manag. Inf. Syst..

[37]  Allen S. Lee,et al.  Information systems and qualitative research , 1997 .

[38]  C. Urquhart.  An encounter with grounded theory: tackling the practical and philosophical issues , 2001 .

[39]  Paul M. Leonardi,et al.  When Flexible Routines Meet Flexible Technologies: Affordance, Constraint, and the Imbrication of Human and Material Agencies , 2011, MIS Q..

[40]  Hope Koch,et al.  Stuck in the Conflicted Middle: A Role-Theoretic Perspective on B2B E-Marketplaces , 2011, MIS Q..

[41]  Nicholas Berente,et al.  Arguing the Value of Virtual Worlds: Patterns of Discursive Sensemaking of an Innovative Technology , 2011, MIS Q..

[42]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[43]  Suzanne Rivard,et al.  An Organizational Culture-Based Theory of Clinical Information Systems Implementation in Hospitals , 2011, J. Assoc. Inf. Syst..

[44]  Geoff Walsham,et al.  GIS for District-Level Administration in India: Problems and Opportunities , 1999, MIS Q..

[45]  Jens Dibbern,et al.  Explaining Variations in Client Extra Costs Between Software Projects Offshored to India , 2008, MIS Q..

[46]  Guy Fitzgerald,et al.  Qualitative methods research in information systems: motivations, themes, and contributions , 2012, Eur. J. Inf. Syst..

[47]  Donald Davidson,et al.  Subjective, Intersubjective, Objective , 2003 .

[48]  James Backhouse,et al.  Circuits of Power in Creating de jure Standards: Shaping an International Information Systems Security Standard , 2006, MIS Q..

[49]  Göran Goldkuhl,et al.  From Action Research to Practice Research , 2012, Australas. J. Inf. Syst..

[50]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1992 .

[51]  Richard Baskerville,et al.  Conceptualizing Generalizability: New Contributions and a Reply , 2012, MIS Q..

[52]  Suprateek Sarker,et al.  Using A Positivist Case Research Methodology To Test Three Competing Theories-In-Use Of Business Process Redesign , 2001, J. Assoc. Inf. Syst..

[53]  Wanda J. Orlikowski,et al.  Studying Information Technology in Organizations: Research Approaches and Assumptions , 1991, Inf. Syst. Res..

[54]  Natalia Levina,et al.  Collaborating on Multi-Party Information Systems Development Projects: A Collective Reflection-in-Action View , 2005, Inf. Syst. Res..

[55]  Emmanuelle Vaast,et al.  Innovating or Doing as Told? Status Differences and Overlapping Boundaries in Offshore Collaboration , 2008, MIS Q..

[56]  A. V. D. Ven,et al.  Engaged Scholarship: A Guide for Organizational and Social Research , 2007 .

[57]  Dorothy E. Leidner,et al.  An Empirical Examination of the Influence of Organizational Culture on Knowledge Management Practices , 2005, J. Manag. Inf. Syst..

[58]  Allen S. Lee.  Electronic Mail as a Medium for Rich Communication: An Empirical Investigation Using Hermeneutic Interpretation , 1994, MIS Q..

[59]  Rob Kling,et al.  Reconceptualizing Users as Social Actors in Information Systems Research , 2003, MIS Q..

[60]  Ole Hanseth,et al.  Reflexive Standardization: Side Effects and Complexity in Standard Making , 2006, MIS Q..

[61]  Michael D. Myers,et al.  Investigating Information Systems with Ethnographic Research , 1999, Commun. Assoc. Inf. Syst..

[62]  Rudy Hirschheim,et al.  The History of Texaco's Corporate Information Technology Function: A General Systems Theoretical Interpretation , 2005, MIS Q..

[63]  Elizabeth J. Davidson,et al.  Unity in Diversity: Electronic Patient Record Use in Multidisciplinary Practice , 2011, Inf. Syst. Res..

[64]  Mani R. Subramani,et al.  Situated Learning and the Situated Knowledge Web: Exploring the Ground Beneath Knowledge Management , 2001, J. Manag. Inf. Syst..

[65]  Leiser Silva,et al.  Information Flow Impediments in Disaster Relief Supply Chains , 2009, J. Assoc. Inf. Syst..

[66]  Mark Srite,et al.  Web Documents' Cultural Masculinity and Femininity , 2006, J. Manag. Inf. Syst..

[67]  Emmanuelle Vaast,et al.  Turning a Community into a Market: A Practice Perspective on Information Technology Use in Boundary Spanning , 2006, J. Manag. Inf. Syst..

[68]  Anna Sidorova,et al.  Understanding Business Process Change Failure: An Actor-Network Perspective , 2006, J. Manag. Inf. Syst..

[69]  Elizabeth J. Davidson,et al.  Technology Frames and Framing: A Socio-Cognitive Investigation of Requirements Determination , 2002, MIS Q..

[70]  Edgar A. Maldonado.  The Process of Introducing FLOSS in the Public Administration: The Case of Venezuela , 2010, J. Assoc. Inf. Syst..

[71]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[72]  Shan Ling Pan,et al.  Examining the Strategic Alignment and Implementation Success of a KMS: A Subculture-Based Multilevel Analysis , 2011, Inf. Syst. Res..

[73]  Pär J. Ågerfalk,et al.  Two-Stage Offshoring: An Investigation of the Irish Bridge , 2008, MIS Q..

[74]  Robert D. Galliers,et al.  Vive les differences? Developing a profile of European information systems research as a basis for international comparisons , 2007, Eur. J. Inf. Syst..

[75]  Eileen M. Trauth.  Choosing qualitative methods in IS research: lessons learned , 2001 .

[76]  Rajiv Sabherwal,et al.  Portfolios of Control in Outsourced Software Development Projects , 2003, Inf. Syst. Res..

[77]  Suzanne Rivard,et al.  A Multilevel Model of Resistance to Information Technology Implementation , 2005, MIS Q..

[78]  Geoff Walsham,et al.  Interpretive case studies in IS research: nature and method , 1995 .

[79]  Suzanne D. Pawlowski,et al.  Bridging User Organizations: Knowledge Brokering and the Work of Information Technology Professionals , 2004, MIS Q..

[80]  Saonee Sarker,et al.  An Exploration into the Process of Requirements Elicitation: A Grounded Approach , 2010, J. Assoc. Inf. Syst..

[81]  Leiser Silva,et al.  Fighting Against Windmills: Strategic Information Systems and Organizational Deep Structures , 2007, MIS Q..

[82]  James Backhouse,et al.  The Circuits-of-Power Framework for Studying Power in Institutionalization of Information Systems , 2003, J. Assoc. Inf. Syst..

[83]  Atreyi Kankanhalli,et al.  Conflict and Performance in Global Virtual Teams , 2006, J. Manag. Inf. Syst..

[84]  Jean Hartley,et al.  Case study research , 2004 .

[85]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[86]  N. Denzin,et al.  Handbook of Qualitative Research , 1994 .

[87]  Alan R. Hevner,et al.  Control of Flexible Software Development Under Uncertainty , 2009, Inf. Syst. Res..

[88]  Diane M. Strong,et al.  Understanding Organization-Enterprise System Fit: A Path to Theorizing the Information Technology Artifact , 2010, MIS Q..

[89]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[90]  Richard Baskerville,et al.  Special issue on action research in information systems: making is research relevant to practice--foreword , 2004 .

[91]  R. Daft.  Why I Recommended That Your Manuscript Be Rejected and What You Can Do about it , 1995 .

[92]  Geoff Walsham,et al.  Doing interpretive research , 2006, Eur. J. Inf. Syst..

[93]  France Bélanger,et al.  Communication Media Repertoires: Dealing with the Multiplicity of Media Choices , 2007, MIS Q..

[94]  M. Lynne Markus,et al.  Information Technology Standards Choices and Industry Structure Outcomes: The Case of the U.S. Home Mortgage Industry , 2005, J. Manag. Inf. Syst..

[95]  Dale Goodhue,et al.  Comment on Benbasat and Barki's "Quo Vadis TAM" article , 2007, J. Assoc. Inf. Syst..

[96]  Allen S. Lee.  A Scientific Methodology for MIS Case Studies , 1989, MIS Q..