Call for mixed analysis: A philosophical framework for combining qualitative and quantitative approaches

Abstract We provide a philosophical justification for analyzing qualitative and quantitative data within the same study. First, we present several recent typologies of analyses in social science research that incorporate both monomethod (i.e. purely quantitative research or purely qualitative research) and mixed research studies. Second, we discuss what has been referred to as the fundamental principle of empirical data analysis, wherein both qualitative and quantitative data analysis techniques are shaped by an attempt to analyze data in a way that yields at least one of five types of generalizations. Third, building on the frameworks of Denzin and Lincoln (2005), Heron and Reason (1997) and Johnson and Onwuegbuzie (2004), we compare and contrast three qualitative-based paradigms (i.e. constructivism, critical theory, participatory), one quantitative-based paradigm (i.e. postpositivism) and one mixed research-based paradigm (i.e. pragmatism) with respect to three axiomatic components (i.e. ontological, epistemological and methodological foundations) and seven issues (i.e. nature of knowledge, knowledge accumulation, goodness or quality criteria, values, ethics, inquirer posture and training). Also, we link each paradigm to data analysis strategies. Fourth, we illustrate similarities in goals between some qualitative and quantitative analyses; in so doing, we deconstruct the strong claim that analysis must be either qualitative or quantitative and illustrate that regardless of perspective (e.g. postpositivist or constructivist), both qualitative and quantitative data can be jointly analyzed. Finally, we compare and contrast 11 mixed research paradigms/worldviews, linking them to mixed analysis strategies, thereby situating mixed analyses in the philosophy of social science and promoting mixed research as a distinctive methodology.

[1]  Jennifer Caroline Greene,et al.  Data Analysis Strategies for Mixed-Method Evaluation Designs , 1993 .

[2]  A. Corden,et al.  Implementing a Mixed Methods Approach to Explore the Financial Implications of Death of a Life Partner , 2008 .

[3]  Burke Johnson,et al.  Editorial: Living With Tensions , 2008 .

[4]  Valerie J. Caracelli,et al.  Advances in mixed-method evaluation : the challenges and benefits of integrating diverse paradigms , 1997 .

[5]  M. Patton.  Qualitative research and evaluation methods , 1980 .

[6]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[7]  A. Bryman.  Quantity and quality in social research , 1988 .

[8]  J. Greene.  Is Mixed Methods Social Inquiry a Distinctive Methodology? , 2008 .

[9]  M. Sandelowski.  Real qualitative researchers do not count: the use of numbers in qualitative research. , 2001, Research in nursing & health.

[10]  Valerie J. Caracelli,et al.  Toward a Conceptual Framework for Mixed-Method Evaluation Designs , 1989 .

[11]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[12]  Young-Ju Lee,et al.  The Predictive Validity of an ESL Placement Test , 2007 .

[13]  Mary M. Kennedy,et al.  Generalizing From Single Case Studies , 1979 .

[14]  Nicholas Rescher,et al.  Realistic Pragmatism: An Introduction to Pragmatic Philosophy , 1999 .

[15]  Nancy L. Leech,et al.  Conducting mixed analyses: A general typology , 2007 .

[16]  K. Louis.  Sociologist as Sleuth , 1982 .

[17]  Ian Alexander,et al.  An introduction to qualitative research , 2000, Eur. J. Inf. Syst..

[18]  Gerd Buchdahl,et al.  In Search of a Better World Lectures and Essays from Thirty years By Karl Popper. Routledge: London & New York 245pp. , 1994, Philosophy.

[19]  P. Reason,et al.  A Participatory Inquiry Paradigm , 1997 .

[20]  K. Stange,et al.  Multimethod research , 1994, Journal of General Internal Medicine.

[21]  Anthony J. Onwuegbuzie,et al.  Positivists, Post-Positivists, Post-Structuralists, and Post-Modernists: Why Can't We All Get Along? Towards a Framework for Unifying Research Paradigms. , 2000 .

[22]  T. Cook,et al.  Beyond qualitative versus quantitative methods , 1979 .

[23]  Doren L. Madey,et al.  Some Benefits of Integrating Qualitative and Quantitative Methods in Program Evaluation, with Illustrations , 1982 .

[24]  M Sandelowski,et al.  Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. , 2000, Research in nursing & health.

[25]  R. Morrow,et al.  Critical theory and methodology , 1994 .

[26]  Ian Hacking,et al.  Representing and Intervening: Introductory Topics in the Philosophy of Natural Science , 1983 .

[27]  E. Cohen.  Book review: John Creswell & Vicki L. Plano Clark, Designing and conducting mixed methods research. , 2008 .

[28]  Chong Ho Yu,et al.  Misconceived Relationships between Logical Positivism and Quantitative Research: An Analysis in the Framework of Ian Hacking. , 2001 .

[29]  Manfred Max Bergman,et al.  Advances in mixed methods research : theories and applications , 2008 .

[30]  유창조.  Naturalistic Inquiry , 2022, The SAGE Encyclopedia of Research Design.

[31]  Manfred Max Bergman,et al.  Advances in mixed methods research , 2008 .

[32]  P. Bazeley.  The contribution of computer software to integrating qualitative and quantitative data and analyses. , 2006 .

[33]  Jennifer Caroline Greene,et al.  Mixed Methods in Social Inquiry , 2007 .

[34]  T. Jick.  Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[35]  Abbas Tashakkori,et al.  Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences , 2008 .

[36]  Dianne M. Finkelstein,et al.  A Beginner's Guide to Structural Equation Modeling , 2005, Technometrics.

[37]  C. Teddlie,et al.  SAGE Handbook of Mixed Methods in Social & Behavioral Research , 2010 .

[38]  A. Onwuegbuzie,et al.  The Validity Issue in Mixed Research , 2006 .

[39]  M. Chi.  Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[40]  W. Firestone.  Alternative Arguments for Generalizing From Data as Applied to Qualitative Research , 1993 .

[41]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[42]  Anthony J. Onwuegbuzie,et al.  Mixed Methods Analysis and Information Visualization: Graphical Display for Effective Communication of Research Results , 2008 .

[43]  E. Epstein,et al.  Boys in White: Student Culture in Medical School , 1962 .

[44]  Nancy L. Leech,et al.  Linking Research Questions to Mixed Methods Data Analysis Procedures 1 , 2006 .

[45]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[46]  R. Rorty.  Objectivity, Relativism, and Truth: Philosophical Papers , 1990 .

[47]  Annelies J. E. Verheugt-Pleiter.  Intervention techniques , 2022, Mentalizing in Child Therapy.

[48]  G. Rolfe.  A critical realist rationale for using a combination of quantitative and qualitative methods , 2006 .

[49]  Mary Lee Smith.  Mixing and matching: Methods and models , 1997 .

[50]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[51]  Pamela Jordan.  Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[52]  John W. Creswell,et al.  The mixed methods reader , 2008 .

[53]  David Richards,et al.  Critical realism: a way forward for evaluation research in nursing? , 2003, Journal of advanced nursing.

[54]  Melvin M. Mark,et al.  Alternative models for the use of multiple methods , 1987 .

[55]  N. Leech,et al.  On Becoming a Pragmatic Researcher: The Importance of Combining Quantitative and Qualitative Research Methodologies , 2005 .

[56]  E. Guba.  The alternative paradigm dialog. , 1990 .

[57]  R. B. Johnson,et al.  Educational Research: Quantitative, Qualitative, and Mixed Approaches , 2007 .

[58]  Margaret Diane LeCompte.  Ethnography and Qualitative Design in Educational Research, 2nd Edition , 1993 .

[59]  E. Guba,et al.  Paradigmatic Controversies, Contradictions, and Emerging Confluences. , 2005 .

[60]  M. Hammersley.  Deconstructing the qualitative-quantitative divide 1 , 1992 .

[61]  M. Lecompte,et al.  Ethnography and Qualitative Design in Educational Research , 1984 .

[62]  W. Gesler,et al.  Approaches to sampling and case selection in qualitative research: examples in the geography of health. , 2000, Social science & medicine.

[63]  Huey T. Chen.  A Theory-Driven Evaluation Perspective on Mixed Methods Research , 2006 .

[64]  A. Roberts.  A Principled Complementarity of Method: In Defence of Methodological Eclecticism and the Qualitative-Quantitative Debate , 2002 .

[65]  Jennifer Caroline Greene,et al.  Defining and describing the paradigm issue in mixed‐method evaluation , 1997 .

[66]  J. Morse.  The Significance of Saturation , 1995 .

[67]  J. Fox.  Applied Regression Analysis, Linear Models, and Related Methods , 1997 .

[68]  M. Fine,et al.  Qualitative and quantitative methods: When stories converge , 1987 .

[69]  G. Fischer.  Communities of Interest: Learning through the Interaction of Multiple Knowledge Systems , 2001 .

[70]  Kathleen M. T. Collins,et al.  A Model Incorporating the Rationale and Purpose for Conducting Mixed-Methods Research in Special Education and Beyond , 2006 .

[71]  Gretchen Rossman,et al.  Numbers and Words , 1985 .

[72]  B. Young.  Postpositivism and Educational Research , 2000 .

[73]  Martyn Denscombe,et al.  Communities of Practice , 2008 .

[74]  Patti Lather.  Paradigm proliferation as a good thing to think with: teaching research in education as a wild profusion , 2006 .

[75]  Anthony J. Onwuegbuzie,et al.  Effect Sizes in Qualitative Research: A Prolegomenon , 2003 .

[76]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[77]  N. Blaikie.  Approaches to Social Enquiry , 1993 .

[78]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[79]  Andrew McConney,et al.  Getting to the Bottom Line: A Method for Synthesizing Findings Within Mixed-method Program Evaluations , 2002 .

[80]  H. Putnam.  The Collapse of the Fact/Value Dichotomy and Other Essays , 2002 .

[81]  R. Bosker.  Boekbespreking van "A.S. Bryk & S.W. Raudenbusch - Hierarchical linear models: Applications and data analysis methods" : Sage Publications, Newbury Parki, London/New Delhi 1992 , 1995 .

[82]  N. Leech,et al.  An Array of Qualitative Data Analysis Tools: A Call for Data Analysis Triangulation. , 2007 .

[83]  R. Henson,et al.  Use of Exploratory Factor Analysis in Published Research , 2006 .

[84]  A. Onwuegbuzie,et al.  Toward a Definition of Mixed Methods Research , 2007 .

[85]  S. Merriam.  Qualitative Case Studies , 2010 .

[86]  Patti Lather.  Research as Praxis , 1986 .

[87]  Jules M. Marquart,et al.  Conceptual Issues and Analytic Strategies in Mixed-Method Studies of Preschool Inclusion , 2000 .

[88]  Derek Layder,et al.  New Strategies in Social Research: An Introduction and Guide , 1993 .

[89]  Souraya Sidani,et al.  Quantitative and qualitative methods:: Is There an Alternative? , 1995 .

[90]  Y. Morrison.  presented at the Annual Meeting of the , 1970 .

[91]  Robert M. Capraro,et al.  Reporting Practice and Use of Exploratory Factor Analysis in Educational Research Journals: Errors and Explanation , 2001 .

[92]  N. Leech,et al.  Qualitative Data Analysis: A Compendium of Techniques and a Framework for Selection for School Psychology Research and Beyond. , 2008 .

[93]  Abbas Tashakkori,et al.  Mixed Methodology: Combining Qualitative and Quantitative Approaches , 1998 .

[94]  Stanley Houston,et al.  Beyond Social Constructionism: Critical Realism and Social Work , 2001 .

[95]  Kathleen M. T. Collins,et al.  Students’ Perceptions of Characteristics of Effective College Teachers: A Validity Study of a Teaching Evaluation Form Using a Mixed-Methods Analysis , 2007 .

[96]  P. Rock.  Sociological Work: Method and Substance , 1972 .

[97]  I. Newman,et al.  Mixed Methods Research , 2008 .

[98]  Nancy L. Leech,et al.  Enhancing the Interpretation of Significant Findings: The Role of Mixed Methods Research , 2004 .

[99]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[100]  Patricia Phelan,et al.  Compatibility of Qualitative and Quantitative Methods , 1987 .