How to Conduct a Mixed Methods Study: Recent Trends in a Rapidly Growing Literature

The present article selectively reviews the large number of recent studies that have been described as based on mixed methods. I begin by discussing a body of work that has emerged to promote mixed methods research across the social sciences. I then review and critique empirical studies in each of two general approaches to mixed methods: mixed data–collection studies, which combine two or more kinds of data; and mixed data–analysis studies, which combine two or more analytical strategies, examine qualitative data with quantitative methods, or explore quantitative data with qualitative techniques. I argue that, although mixed methods research is by no means new, empirical studies today combine methods in more diverse and, at times, innovative ways. Nevertheless, important methodological tensions will likely surface as the research becomes more self-reflexive.

[1]  Christopher A. Bail,et al.  The Configuration of Symbolic Boundaries against Immigrants in Europe , 2008 .

[2]  J. Goering,et al.  Response to Review of Choosing a Better Life? Evaluating the Moving to Opportunity Social Experiment , 2003, Children, Youth and Environments.

[3]  J. Johnston,et al.  Democracy versus Distinction: A Study of Omnivorousness in Gourmet Food Writing1 , 2007, American Journal of Sociology.

[4]  Robin Jacob,et al.  Moving to Opportunity for Fair Housing Demonstration Program , 2003 .

[5]  Stanley Lieberson,et al.  Small N's and Big Conclusions: An Examination of the Reasoning in Comparative Studies Based on a Small Number of Cases , 1991 .

[6]  Robert Faris,et al.  Blocking the Future: New Solutions for Old Problems in Historical Social Science , 1999, Social Science History.

[7]  E. Guba,et al.  Epistemological and methodological bases of naturalistic inquiry. , 1982 .

[8]  David R. Gibson Taking Turns and Talking Ties: Networks and Conversational Interaction1 , 2005, American Journal of Sociology.

[9]  Monica A. Longmore,et al.  Gender and the Meanings of Adolescent Romantic Relationships: A Focus on Boys , 2006 .

[10]  E. Quinlan,et al.  Representations of Rape: Transcending Methodological Divides , 2010 .

[11]  R. Yin Case Study Research: Design and Methods , 1984 .

[12]  Isabel Fernandez-Mateo,et al.  Cumulative Gender Disadvantage in Contract Employment1 , 2009, American Journal of Sociology.

[13]  E. Leahey,et al.  Intellectuals and Democratization, 1905–1912 and 1989–19961 , 2004, American Journal of Sociology.

[14]  B. Uzzi,et al.  Embeddedness in the Making of Financial Capital: How Social Relations and Networks Benefit Firms Seeking Financing , 1999, The New Economic Sociology.

[15]  Laura Tach Moving to Opportunity: The Story of an American Experiment to Fight Ghetto Poverty , 2012 .

[16]  J. Mohr Measuring Meaning Structures , 1998 .

[17]  L. Sherman,et al.  Experimental Ethnography: The Marriage of Qualitative and Quantitative Research , 2004 .

[18]  M. Moore Gendered Power Relations among Women: A Study of Household Decision Making in Black, Lesbian Stepfamilies , 2008 .

[19]  L. Griffin Narrative, Event-Structure Analysis, and Causal Interpretation in Historical Sociology , 1993, American Journal of Sociology.

[20]  Nancy L. Leech,et al.  Conducting mixed analyses: A general typology , 2007 .

[21]  J. Maxwell Using Numbers in Qualitative Research , 2010 .

[22]  F. Bean Brokered Boundaries: Creating Immigrant Identity in Anti-Immigrant Times , 2011 .

[23]  Mario Luis Small,et al.  Unanticipated Gains: Origins of Network Inequality in Everyday Life , 2009 .

[24]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[25]  D. R. Heise Modeling event structures , 1989 .

[26]  H. Bernard Research Methods in Anthropology: Qualitative and Quantitative Approaches , 1988 .

[27]  N. Leech,et al.  Toward a Unified Validation Framework in Mixed Methods Research , 2007 .

[28]  Kevin Brazil,et al.  A Strategy to Identify Critical Appraisal Criteria for Primary Mixed-Method Studies , 2004, Quality & quantity.

[29]  Larry W. Isaac,et al.  Analyzing Historical Contingency with Formal Methods , 1994 .

[30]  S. Sieber The Integration of Fieldwork and Survey Methods , 1973, American Journal of Sociology.

[31]  A. George,et al.  Case Studies and Theory Development in the Social Sciences , 2005 .

[32]  D. Campbell III. “Degrees of Freedom” and the Case Study , 1975 .

[33]  Colin Elman,et al.  Qualitative Research: Recent Developments in Case Study Methods , 2006 .

[34]  Carl W. Roberts,et al.  3. A Generic Semantic Grammar for Quantitative Text Analysis: Applications to East and West Berlin Radio News Content from 1979 , 1997 .

[35]  D. Lichter Unmarried Couples with Children , 2020, Parker’s Will Precedents.

[36]  B. Rihoux Qualitative Comparative Analysis (QCA) and Related Systematic Comparative Methods , 2006 .

[37]  A. Abbott Sequence analysis: new methods for old ideas , 1995 .

[38]  Valerie J. Caracelli,et al.  Toward a Conceptual Framework for Mixed-Method Evaluation Designs , 1989 .

[39]  M. Pedersen Living the Drama : Community , Conflict , and Culture among Inner-City Boys , 2013 .

[40]  Isabel Fernandez-Mateo,et al.  Who Pays the Price of Brokerage? Transferring Constraint through Price Setting in the Staffing Sector , 2007 .

[41]  E. Guba,et al.  Paradigmatic Controversies, Contradictions, and Emerging Confluences. , 2005 .

[42]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[43]  Shelley J. Correll,et al.  Getting a Job: Is There a Motherhood Penalty?1 , 2007, American Journal of Sociology.

[44]  Elizabeth Levy Paluck,et al.  The Promising Integration of Qualitative Methods and Field Experiments , 2010 .

[45]  John G. Richardson,et al.  Mill Owners and Wobblies , 2009, Social Science History.

[46]  J. Gatta,et al.  The Use of Mixed Methods Models and Designs in the Human Sciences: Problems and Prospects , 2006 .

[47]  Martha S. Feldman,et al.  Narrative Networks: Patterns of Technology and Organization , 2007, Organ. Sci..

[48]  Peer C. Fiss,et al.  The Discourse of Globalization: Framing and Sensemaking of an Emerging Concept , 2005 .

[49]  M. Sandelowski,et al.  On Quantitizing , 2009, Journal of mixed methods research.

[50]  M. Cooney,et al.  Aiding Peace, Abetting Violence: Third Parties and the Management of Conflict , 2005 .

[51]  P. Hedström,et al.  Social mechanisms : an analytical approach to social theory , 1999 .

[52]  Charles C. Ragin,et al.  Some Observations on Formal Methods of Qualitative Analysis , 1994 .

[53]  Statistics for sociology , 1979 .

[54]  H. White,et al.  “Structural Equivalence of Individuals in Social Networks” , 2022, The SAGE Encyclopedia of Research Design.

[55]  T. Gieryn Boundary-work and the demarcation of science from non-science: Strains and interests in professional , 1983 .

[56]  A. Bryman The debate about quantitative and qualitative research: A question of method or epistemology? , 1984 .

[57]  Andrew Schrank,et al.  Homeward Bound? Interest, Identity, and Investor Behavior in a Third World Export Platform1 , 2008, American Journal of Sociology.

[58]  Jim Briggs,et al.  A Pragmatist Argument for Mixed Methodology in Medical Informatics , 2009 .

[59]  Rachelle Annechino,et al.  Bridging the Qualitative-Quantitative Software Divide , 2010, Field methods.

[60]  Erik Weber,et al.  Counterfactuals and causal inference: methods and principles for social research , 2008 .

[61]  Abbas Tashakkori,et al.  Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences , 2008 .

[62]  E. Uehara,et al.  Understanding the dynamics of illness and help-seeking: event-structure analysis and a Cambodian-American narrative of "spirit invasion". , 2001, Social science & medicine.

[63]  Jennifer Caroline Greene,et al.  Mixed Methods in Social Inquiry , 2007 .

[64]  W. P. Barnett,et al.  From Red Vienna to the Anschluss: Ideological Competition among Viennese Newspapers during the Rise of National Socialism1 , 2004, American Journal of Sociology.

[65]  K. Brazil,et al.  Revisiting the Quantitative-Qualitative Debate: Implications for Mixed-Methods Research , 2002, Quality & quantity.

[66]  Kimberly D. Elsbach,et al.  Ethnography and Experiment in Social Psychological Theory Building: Tactics for Integrating Qualitative Field Data with Quantitative Lab Data , 2000 .

[67]  Charles Kadushin,et al.  Triangulation and Mixed Methods Designs: Practicing What We Preach in the Evaluation of an Israel Experience Educational Program , 2008 .

[68]  M. Small `How many cases do I need?' , 2009 .

[69]  Pierre Bourdieu,et al.  Outline of a Theory of Practice , 2020, On Violence.

[70]  C. Teddlie,et al.  SAGE Handbook of Mixed Methods in Social & Behavioral Research , 2010 .

[71]  Pamela Jordan Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[72]  Cliff Brown,et al.  The Decline of Industrial Unionism in the Meatpacking Industry: , 2003 .

[73]  Charles C. Ragin,et al.  Workshop on Scientific Foundations of Qualitative Research , 2004 .

[74]  Rossalina Latcheva,et al.  Cognitive interviewing and factor-analytic techniques: a mixed method approach to validity of survey items measuring national identity , 2011 .

[75]  Tracy L. M. Kennedy,et al.  Connected Lives: The Project1 , 2006 .

[76]  Martyn Denscombe,et al.  Communities of Practice , 2008 .

[77]  J. Mohr,et al.  New directions in formalization and historical analysis , 2013 .

[78]  Myra Marx Ferree,et al.  Resonance and Radicalism: Feminist Framing in the Abortion Debates of the United States and Germany1 , 2003, American Journal of Sociology.

[79]  John K. Smith,et al.  Closing Down the Conversation: The End of the Quantitative-Qualitative Debate Among Educational Inquirers , 1986 .

[80]  Vincent J. Roscigno,et al.  The Organizational and Social Foundations of Worker Resistance , 2004 .

[81]  R. Rorty,et al.  Philosophy and the Mirror of Nature. , 1980 .

[82]  A. Bryman Quantity and quality in social research , 1988 .

[83]  Eric Klinenberg,et al.  Heat Wave: A Social Autopsy of Disaster in Chicago , 2002 .

[84]  A. Hunter,et al.  Multimethod Research: A Synthesis of Styles , 1989 .

[85]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[86]  H. Becker How to Find Out How to Do Qualitative Research , 2009 .

[87]  E. Parrado,et al.  Migration and Gender among Mexican Women , 2005 .

[88]  David Collier,et al.  Rethinking Social Inquiry: Diverse Tools, Shared Standards , 2004 .

[89]  Neil Gross A Pragmatist Theory of Social Mechanisms , 2009 .

[90]  M. Savage,et al.  Culture, Class, Distinction , 2009 .

[91]  3. Integrating Survey and Ethnographic Methods for Systematic Anomalous Case Analysis , 2002 .

[92]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[93]  Vicki L. Plano Clark,et al.  Applying Three Strategies for Integrating Quantitative and Qualitative Databases in a Mixed Methods Study of a Nontraditional Graduate Education Program , 2010 .

[94]  D. Harding Violence, Older Peers, and the Socialization of Adolescent Boys in Disadvantaged Neighborhoods , 2009, American sociological review.

[95]  M. Feilzer,et al.  Doing Mixed Methods Research Pragmatically: Implications for the Rediscovery of Pragmatism as a Research Paradigm: , 2010 .

[96]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[97]  D. Pager,et al.  Walking the Talk? What Employers Say Versus What They Do , 2005 .

[98]  Roberto M. Fernandez,et al.  Skill‐Biased Technological Change and Wage Inequality: Evidence from a Plant Retooling1 , 2001, American Journal of Sociology.

[99]  I. Newman,et al.  Mixed Methods Research , 2008 .

[100]  Abbas Tashakkori,et al.  Mixed Methodology: Combining Qualitative and Quantitative Approaches , 1998 .

[101]  David Obstfeld Social Networks, the Tertius Iungens Orientation, and Involvement in Innovation , 2005 .

[102]  Kadija Ferryman,et al.  Why did the moving to opportunity experiment not get young people into better schools? , 2008 .

[103]  P. Hedström,et al.  Causal Mechanisms in the Social Sciences , 2010 .

[104]  K. Kimport,et al.  Culture and Mobilization: Tactical Repertoires, Same-Sex Weddings, and the Impact on Gay Activism , 2009 .

[105]  T. Weisner,et al.  Higher Ground: New Hope for the Working Poor and Their Children , 2007 .

[106]  H. Becker,et al.  Participant Observation and Interviewing: A Comparison , 1957 .

[107]  Katherine Stovel,et al.  Local Sequential Patterns: The Structure of Lynching in the Deep South, 1882-1930 , 2001 .

[108]  D. White,et al.  Comparing Focus Group and Individual Responses on Sensitive Topics: A Study of Water Decision Makers in a Desert City , 2010 .

[109]  G. Duncan,et al.  The Notable and the Null: Using Mixed Methods to Understand the Diverse Impacts of Residential Mobility Programs , 2012 .

[110]  K. Bollen,et al.  Detection and determinants of bias in subjective measures , 1998 .

[111]  Kathleen M. T. Collins,et al.  Call for mixed analysis: A philosophical framework for combining qualitative and quantitative approaches , 2009 .

[112]  S. Steen,et al.  Racial disparities in official assessments of juvenile offenders : Attributional stereotypes as mediating mechanisms , 1998 .

[113]  Roberto Franzosi,et al.  From Words to Numbers: A Set Theory Framework for the Collection, Organization, and Analysis of Narrative Data , 1994 .

[114]  A. Cherlin,et al.  The Influence of Physical and Sexual Abuse on Marriage and Cohabitation , 2004 .

[115]  Silke Aisenbrey,et al.  New Life for Old Ideas: The "Second Wave" of Sequence Analysis Bringing the "Course" Back Into the Life Course , 2010 .

[116]  Martin Trow,et al.  Comment on "Participant Observation and Interviewing: A Comparison" , 1957 .

[117]  Christian Brzinsky-Fay,et al.  New Developments in Sequence Analysis , 2010 .

[118]  L. Edelman,et al.  Diversity Rhetoric and the Managerialization of Law1 , 2001, American Journal of Sociology.

[119]  Randy Hodson,et al.  Unions, Solidarity, and Striking , 2004 .

[120]  J. Steele,et al.  Teenage sexuality and media practice: Factoring in the influences of family, friends, and school , 1999 .

[121]  T. Weisner,et al.  Mixing qualitative and quantitative research in developmental science: uses and methodological choices. , 2008, Developmental psychology.

[122]  D. Morgan Paradigms Lost and Pragmatism Regained , 2007 .

[123]  Adrian E. Raftery,et al.  Statistics In Sociology, 1950–2000: A Selective Review , 2001 .

[124]  M. Waters,et al.  Inheriting the City: The Children of Immigrants Come of Age , 2008 .

[125]  Vincent J. Roscigno,et al.  Age Discrimination, Social Closure and Employment , 2007 .

[126]  Kathleen M. T. Collins,et al.  Assessing legitimation in mixed research: a new framework , 2011 .

[127]  Kathleen M. Carley Coding Choices for Textual Analysis: A Comparison of Content Analysis and Map Analysis , 1993 .

[128]  D. R. Heise,et al.  Event Structure Models from Ethnographic Data , 1990 .

[129]  R. Weiss Learning from strangers : the art and method of qualitative interview studies , 1995 .

[130]  Nancy L. Leech,et al.  A typology of mixed methods research designs , 2009 .

[131]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[132]  Greg j. Duncan,et al.  When to promote, and when to avoid, a population perspective , 2008, Demography.

[133]  Daniel A. McFarland Student Resistance: How the Formal and Informal Organization of Classrooms Facilitate Everyday Forms of Student Defiance1 , 2001, American Journal of Sociology.

[134]  Jennifer Caroline Greene,et al.  Data Analysis Strategies for Mixed-Method Evaluation Designs , 1993 .

[135]  J M Morse,et al.  Approaches to qualitative-quantitative methodological triangulation. , 1991, Nursing research.

[136]  C. W. Roberts,et al.  A Conceptual Framework for Quantitative Text Analysis , 2000 .

[137]  Gretchen Rossman,et al.  Mixed Methods in Evaluation Contexts: A Pragmatic Framework , 2003 .

[138]  Kristen Schilt Just One of the Guys?: Transgender Men and the Persistence of Gender Inequality , 2011 .

[139]  Rebecca J. Shlafer,et al.  Factors Associated With Young Children’s Opportunities for Maintaining Family Relationships During Maternal Incarceration* , 2008 .

[140]  P. Rosenblatt,et al.  Does Moving to Better Neighborhoods Lead to Better Schooling Opportunities? Parental School Choice in an Experimental Housing Voucher Program , 2010, Teachers College Record: The Voice of Scholarship in Education.

[141]  Robert O. Keohane,et al.  Designing Social Inquiry: Scientific Inference in Qualitative Research. , 1995 .

[142]  Evan S. Lieberman,et al.  Nested Analysis as a Mixed-Method Strategy for Comparative Research , 2005, American Political Science Review.

[143]  M. Small,et al.  Why Organizational Ties Matter for Neighborhood Effects: Resource Access through Childcare Centers , 2008 .

[144]  X. Briggs,et al.  Moving to Opportunity , 2010 .

[145]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[146]  Controversies in Doctrine and Method , 1945, American Journal of Sociology.

[147]  Peter S. Bearman,et al.  Becoming a Nazi: A model for narrative networks☆ , 2000 .

[148]  Deborah Carr,et al.  1. Linking Life Histories and Mental Health: A Person-Centered Strategy , 1998 .

[149]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[150]  Peter Blatchford,et al.  Relationships Between Class Size and Teaching: A Multimethod Analysis of English Infant Schools , 2002 .

[151]  S. M. Lee The Diversity Paradox: Immigration and the Color Line in Twenty-First Century America , 2010 .

[152]  James Mahoney,et al.  After KKV: The New Methodology of Qualitative Research , 2010 .

[153]  Cliff Brown,et al.  The Role of Employers in Split Labor Markets: An Event-Structure Analysis of Racial Conflict and AFL Organizing, 1917–1919 , 2000 .

[154]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994 .

[155]  Lisa D. Pearce,et al.  Mixed method data collection strategies , 2006 .

[156]  R. Collins,et al.  STATISTICS VERSUS WORDS , 1984 .

[157]  Jeffrey R. Kling,et al.  Moving At-Risk Teenagers Out of High-Risk Neighborhoods: Why Girls Fare Better Than Boys , 2006 .

[158]  Charles C. Ragin,et al.  Fuzzy-Set Social Science , 2001 .

[159]  T. Cook,et al.  Qualitative and quantitative methods in evaluation research , 1981 .

[160]  J. Greene Is Mixed Methods Social Inquiry a Distinctive Methodology? , 2008 .

[161]  Stoyan V. Sgourev,et al.  Peer Capitalism: Parallel Relationships in the U.S. Economy1 , 2006, American Journal of Sociology.

[162]  M. Lamont,et al.  The Study of Boundaries in the Social Sciences , 2002 .

[163]  William G. Axinn,et al.  Mixed Method Data Collection Strategies by William G. Axinn , 2006 .

[164]  Tammy A. Smith,et al.  Narrative boundaries and the dynamics of ethnic conflict and conciliation , 2007 .

[165]  Michael O. Emerson,et al.  Does Race Matter in Residential Segregation? Exploring the Preferences of White Americans , 2001, American Sociological Review.

[166]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[167]  I. Nevo,et al.  Conflicting Findings in Mixed Methods Research , 2009 .

[168]  M Sandelowski,et al.  Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. , 2000, Research in nursing & health.

[169]  J. Ludwig,et al.  Underground Gun Markets , 2005 .