Using quantitative data in mixed-design grounded theory studies: an enhanced path to formal grounded theory in information systems

This article discusses a key development in the use of grounded theory (GT) in information systems (IS) – the use of quantitative data in mixed studies to build on and elaborate theories. We examine the design of one of our research projects and describe how this mixed-design GT project helped elaborate emerging theories using slices of qualitative and quantitative data. Our contributions are threefold: (i) we show that the use of mixed data and techniques can be leveraged to help build credible theories in IS because it allows researchers to build theories of greater abstraction and scope: it helps sense-making in the drive from substantive to parsimonious formal theories; (ii) in line with classic GT, we propose a mixed typological design to help build a pathway to formal grounded theories in rupture with existing literature; and (iii) we highlight GT as a meta-theory of research design and revisit some of its main principles in a mixed-design perspective.

[1]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[2]  Stefan Seidel,et al.  On emergence and forcing in information systems grounded theory studies: the case of Strauss and Corbin , 2013, J. Inf. Technol..

[3]  Samuel B. Bacharach,et al.  Organizational Theories: Some Criteria for Evaluation , 1989 .

[4]  J. V. Maanen,et al.  The Fact of Fiction in Organizational Ethnography. , 1979 .

[5]  Lorelei Lingard,et al.  Grounded theory, mixed methods, and action research , 2008, BMJ : British Medical Journal.

[6]  Akhilesh Bajaj,et al.  A Study of Senior Information Systems Managers' Decision Models in Adopting New Computing Architectures , 2000, J. Assoc. Inf. Syst..

[7]  S. Tarrow.  Bridging the Quantitative-Qualitative Divide in Political Science , 1995, American Political Science Review.

[8]  J. Corbin,et al.  Shifting the Grounds: Constructivist Grounded Theory Methods , 2016 .

[9]  M Sandelowski,et al.  Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. , 2000, Research in nursing & health.

[10]  William H. Glick,et al.  Typologies As a Unique Form Of Theory Building: Toward Improved Understanding and Modeling , 1994 .

[11]  David J. Will.  A realist theory of science , 1981, Medical History.

[12]  Eileen M. Trauth,et al.  Understanding Computer-Mediated Discussions: Positivist and Interpretive Analyses of Group Support System Use , 2000, MIS Q..

[13]  Abraham Wolf.  Essentials Of Scientific Method , 1925 .

[14]  Girish N. Punj,et al.  Cluster Analysis in Marketing Research: Review and Suggestions for Application , 1983 .

[15]  Thomas Østerlie,et al.  On Countering Methods Erosion: Contributing towards Stronger and More Empirically Grounded Information Systems Theory , 2012, 2012 45th Hawaii International Conference on System Sciences.

[16]  P. Sopp.  Cluster analysis. , 1996, Veterinary immunology and immunopathology.

[17]  Mary Tate,et al.  Fitting Covariance Models for Theory Generation , 2011, J. Assoc. Inf. Syst..

[18]  J. D. Tardós,et al.  Publish or Perish , 1987 .

[19]  John F. Rockart,et al.  Editor’s comments , 2005, MIS Q. Executive.

[20]  John Mingers,et al.  The paucity of multimethod research: a review of the information systems literature , 2003, Inf. Syst. J..

[21]  Pär J. Ågerfalk,et al.  Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy , 2008, MIS Q..

[22]  Jan Pries-Heje,et al.  Grounded action research: a method for understanding IT in practice , 1999 .

[23]  Emmanuelle Vaast,et al.  Innovating or Doing as Told? Status Differences and Overlapping Boundaries in Offshore Collaboration , 2008, MIS Q..

[24]  K. Weick.  What Theory Is Not, Theorizing Is , 1995 .

[25]  Jacqueline Fawcett,et al.  The relationship of theory and research , 1986 .

[26]  Isabelle Walsh,et al.  The Role of IT Culture in IT Management: Searching for Individual Archetypal IT Cultural Profiles , 2008, AMCIS.

[27]  Allen S. Lee.  Integrating Positivist and Interpretive Approaches to Organizational Research , 1991 .

[28]  Anselm L. Strauss,et al.  Qualitative Analysis For Social Scientists , 1987 .

[29]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[30]  R. Bhaskar.  The Possibility of Naturalism , 2014 .

[31]  Willie Breeze,et al.  The Relationship of Theory and Research , 1993, AORN Journal.

[32]  G. W. Milligan,et al.  An examination of the effect of six types of error perturbation on fifteen clustering algorithms , 1980 .

[33]  T. C. Edwin Cheng,et al.  Value of Information Integration to Supply Chain Management: Roles of Internal and External Contingencies , 2011, J. Manag. Inf. Syst..

[34]  Rolph E. Anderson,et al.  Multivariate data analysis with readings (2nd ed.) , 1986 .

[35]  Michael I. Barrett,et al.  Methodological Implications of Critical Realism for Mixed-Methods Research , 2013, MIS Q..

[36]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1993 .

[37]  Merilyn Annells,et al.  Grounded Theory Method: Philosophical Perspectives, Paradigm of Inquiry, and Postmodernism , 1996 .

[38]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[39]  Viswanath Venkatesh,et al.  Bridging the Qualitative-Quantitative Divide: Guidelines for Conducting Mixed Methods Research in Information Systems , 2013, MIS Q..

[40]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[41]  A. Maslow.  Motivation and Personality , 1954 .

[42]  Thomas A. Horan,et al.  The Dynamics of Information Collaboration: A Case Study of Blended IT Value Propositions for Health Information Exchange in Disability Determination , 2011, J. Assoc. Inf. Syst..

[43]  Mireille Gettler-Summa,et al.  Users' groups Interpreted Through the Lens of the Users' Needs and Motivation , 2010 .

[44]  Pär J. Ågerfalk.  Embracing diversity through mixed methods research , 2013, Eur. J. Inf. Syst..

[45]  Judith A. Holton,et al.  Grounded Theory as a General Research Methodology , 2008 .

[46]  Norbert L Kerr,et al.  Satisficing in hypothesis generation. , 2002, The American journal of psychology.

[47]  Guy G. Gable,et al.  Integrating case study and survey research methods: an example in information systems , 1994 .

[48]  John W. Tukey,et al.  Methodology, and the Statistician's Responsibility for BOTH Accuracy AND Relevance , 1979 .

[49]  John Mingers,et al.  Real-izing information systems: critical realism as an underpinning philosophy for information systems , 2004, Inf. Organ..

[50]  Henri Barki,et al.  User Participation in Information Systems Security Risk Management , 2010, MIS Q..

[51]  Marko Sarstedt,et al.  An assessment of the use of partial least squares structural equation modeling in marketing research , 2012 .

[52]  R. Zmud,et al.  Editor's Comments Research in Information Systems: What We Haven't Learned , 2022 .

[53]  Irwin Brown,et al.  Profiling grounded theory approaches in information systems research , 2013, Eur. J. Inf. Syst..

[54]  Jorgen P. Bansler,et al.  Corporate Intranet Implementation: Managing Emergent Technologies and Organizational Practices , 2000, J. Assoc. Inf. Syst..

[55]  R. Vallerand.  Toward A Hierarchical Model of Intrinsic and Extrinsic Motivation , 1997 .

[56]  Robert D. Galliers,et al.  Relevance and rigour in Information Systems Research: some personal reflections on issues facing the Information Systems research community , 1994, Business Process Re-Engineering.

[57]  Edward Shils,et al.  Max Weber on the Methodology of the Social Sciences , 2011 .

[58]  Irit Hadar,et al.  Applying ontology-based rules to conceptual modeling: a reflection on modeling decision making , 2007, Eur. J. Inf. Syst..

[59]  Detmar W. Straub,et al.  An Update and Extension to SEM Guidelines for Admnistrative and Social Science Research , 2011 .

[60]  Judith A. Holton,et al.  Remodeling Grounded Theory , 2004 .

[61]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[62]  Michael R. Harwell,et al.  Research design: Qualitative, quantitative, and mixed methods: Pursuing ideas as the keystone of exemplary inquir , 2011 .

[63]  K. Francis,et al.  Adopting a constructivist approach to grounded theory: implications for research design. , 2006, International journal of nursing practice.

[64]  Kevin G. Corley,et al.  Building Better Theory by Bridging the Quantitative-Qualitative Divide , 2006 .

[65]  J. Alexander,et al.  Theory and Methods: Critical Essays in Human Geography , 2008 .

[66]  N. Denzin,et al.  The discipline and practice of qualitative research [Introduction]. Denzin & Y. S. Lincoln (Eds.), The handbook of qualitative research (2nd ed. , 2000 .

[67]  Isabelle Walsh,et al.  A strategic path to study IT use through users' IT culture and IT needs: A mixed-method grounded theory , 2014, J. Strateg. Inf. Syst..

[68]  Kalle Lyytinen,et al.  Data matters in IS theory building , 2009, J. Assoc. Inf. Syst..

[69]  Shirley Gregor,et al.  A Multi-Paradigm Approach to Grounded Theory , 2007 .

[70]  K. Punch.  Quantitative and Qualitative Approaches , 2008 .

[71]  P. J. Runkel,et al.  A guide to usage for writers and students in the social sciences , 1984 .

[72]  J. Creswell.  Qualitative Inquiry and Research Design: Choosing Among Five Approaches , 2006 .

[73]  Robert Jones,et al.  Grounded theory and management research: a lack of integrity? , 2007 .

[74]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[75]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[76]  Donald R. MacQueen,et al.  PHILOSOPHY AND SCIENTIFIC REALISM , 1964 .

[77]  Henry Mintzberg,et al.  Structure in Fives: Designing Effective Organizations , 1983 .

[78]  Maurice Landry,et al.  A disciplined methodological pluralism for mis research , 1992 .

[79]  K. Charmaz,et al.  The sage handbook of grounded theory , 2007 .

[80]  Geoffrey S. Hubona,et al.  A Scientific Basis for Rigor in Information Systems Research , 2009, MIS Q..

[81]  B. Somekh,et al.  Theory and Methods in Social Research , 2013 .

[82]  Cathy Urquhart,et al.  Putting the ‘theory’ back into grounded theory: guidelines for grounded theory studies in information systems , 2009, Inf. Syst. J..

[83]  R. Bhaskar.  A realist theory of science , 1976 .

[84]  Alan L. Mackay,et al.  Publish or perish , 1974, Nature.

[85]  Markus,et al.  Editor's Comments: Looking for a Few Good Concepts...and Theories...for the Information Systems Field , 2007 .

[86]  Wanda J. Orlikowski,et al.  CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development , 1993, MIS Q..

[87]  Bonnie Kaplan,et al.  Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study , 1988, MIS Q..

[88]  R. Suddaby.  From the Editors: What Grounded Theory is Not , 2006 .

[89]  John,et al.  Reclaiming Qualitative Methods for Organizational Research: A Preface. , 1979 .

[90]  Margaret S. Archer,et al.  Philosophy and scientific realism , 2013 .

[91]  J. Creswell.  Qualitative inquiry and research design: Choosing among five approaches, 2nd ed. , 2007 .

[92]  Arthur G. Bedeian,et al.  Management Science on the Credibility Bubble: Cardinal Sins and Various Misdemeanors , 2010 .

[93]  A. Parry.  Handbook of Qualitative Research , 2002 .

[94]  Isabelle Walsh,et al.  The Spinning Top Model, a New Path to Conceptualize Culture and Values: Applications to IS Research , 2008, ICIS.

[95]  D. Morgan.  Paradigms Lost and Pragmatism Regained , 2007 .

[96]  Paul H. J. Hendriks,et al.  The Diving Bell and the Butterfly , 2006 .

[97]  Richard Baskerville,et al.  Managing culture creep: Toward a strategic model of user IT culture , 2010, J. Strateg. Inf. Syst..

[98]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[99]  Philip Fei Wu,et al.  A Mixed Methods Approach to Technology Acceptance Research , 2011, J. Assoc. Inf. Syst..

[100]  Manfred Max Bergman,et al.  7 Quality of Inferences in Mixed Methods Research: Calling for an Integrative Framework , 2008 .

[101]  Henry Mintzberg,et al.  The Structuring of Organizations , 1979 .

[102]  P. Medawar.  Induction and intuition in scientific thought , 1969 .

[103]  N. Cartwright.  Causation: One Word, Many Things , 2004, Philosophy of Science.

[104]  Yvonne Wengström,et al.  Combining qualitative and quantitative research within mixed method research designs: A methodological review , 2011, International Journal of Nursing Studies.

[105]  J. Hood,et al.  Orthodoxy vs. Power: The Defining Traits of Grounded Theory , 2007 .

[106]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[107]  N. Denzin,et al.  Handbook of Qualitative Research , 1994 .

[108]  Tim Weitzel,et al.  The inflation of academic intellectual capital: the case for design science research in Europe , 2011, Eur. J. Inf. Syst..

[109]  Robert D. Galliers,et al.  Research issues in information systems , 1993, J. Inf. Technol..

[110]  Monica J. Garfield,et al.  The Adoption and Use of GSS in Project Teams: Toward More Participative Processes and Outcomes , 2003, MIS Q..

[111]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[112]  M. Sandelowski,et al.  On Quantitizing , 2009, Journal of mixed methods research.

[113]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[114]  Gerald V. Post,et al.  A Structural Equation Evaluation of CASE Tools Attributes , 1999, J. Manag. Inf. Syst..

[115]  Kevin G. Corley,et al.  Seeking Qualitative Rigor in Inductive Research , 2013 .

[116]  A. Stinchcombe.  Information and Organizations , 2019 .

[117]  K. Charmaz.  The legacy of Anselm Strauss in constructivist grounded theory , 2008 .

[118]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[119]  D. Straub,et al.  Editor's comments: a critical look at the use of PLS-SEM in MIS quarterly , 2012 .

[120]  Vincenzo Esposito Vinzi,et al.  PLS Path Modeling: From Foundations to Recent Developments and Open Issues for Model Assessment and Improvement , 2010 .

[121]  Straub,et al.  Editor's Comments: An Update and Extension to SEM Guidelines for Administrative and Social Science Research , 2011 .

[122]  Fatemeh Zahedi,et al.  Cultural Signifiers of Web Site Images , 2011, J. Manag. Inf. Syst..

[123]  John Mingers,et al.  Combining IS Research Methods: Towards a Pluralist Methodology , 2001, Inf. Syst. Res..

[124]  R. Vallerand.  Deci and Ryan's self-determination theory: A view from the hierarchical model of intrinsic and extrinsic motivation. , 2000 .

[125]  Roy Bhaskar,et al.  The Philosophy of Meta-Reality , 2002 .

[126]  Kai R. T. Larsen,et al.  A Taxonomy of Antecedents of Information Systems Success: Variable Analysis Studies , 2003, J. Manag. Inf. Syst..

[127]  François-Xavier de Vaujany,et al.  An historically grounded critical analysis of research articles in IS , 2011, Eur. J. Inf. Syst..

[128]  John W. Creswell,et al.  Research Design: Qualitative and Quantitative Approaches , 1997 .

[129]  C. Whitbeck,et al.  A Realist Theory of Science. , 1977 .

[130]  Matthew L. Smith,et al.  Testable Theory Development for Small-N Studies: Critical Realism and Middle-Range Theory , 2010, Int. J. Inf. Technol. Syst. Approach.

[131]  Isabelle Walsh,et al.  Development of an Instrument to Assess Individual IT Culture , 2009, AMCIS.

[132]  Brian Everitt,et al.  Cluster analysis , 1974 .

[133]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[134]  Torsten Biemann.  What if we are Texas Sharpshooters? A New Look at Publication Bias , 2012 .

[135]  J. McKinney,et al.  Constructive typology and social theory , 1967 .

[136]  Syed Nasirin,et al.  Grounded theory method in information systems research: its nature, diversity and opportunities , 2013, Eur. J. Inf. Syst..

[137]  Robert Klee,et al.  Introduction to the Philosophy of Science: Cutting Nature at Its Seams , 1996 .