Achieving Methodological Alignment When Combining QCA and Process tracing in Practice

This article explores the practical challenges one faces when combining qualitative comparative analysis (QCA) and process tracing (PT) in a manner that is consistent with their underlying assumptions about the nature of causal relationships. While PT builds on a mechanism-based understanding of causation, QCA as a comparative method makes claims about counterfactual causal relationships. Given the need to ensure alignment between the ontological understandings of causation that underlie a method and methodological practice, the different ontological foundations result in methodological guidelines that contradict each other, forcing the analyst to choose whether to be more in alignment with one or the other method. This article explores the implications of contrasting guidelines in a practical case study, where a QCA for sufficiency is followed by two PT case studies of positive cases.

[1]  Hussein Kassim The National Co-ordination of EU Policy , 2000 .

[2]  Liesbet Hooghe,et al.  A Postfunctionalist Theory of European Integration: From Permissive Consensus to Constraining Dissensus , 2009, British Journal of Political Science.

[3]  Carlos Closa,et al.  Why convene referendums? Explaining choices in EU constitutional politics , 2007 .

[4]  B. Jones,et al.  Agendas and instability in American politics , 1993 .

[5]  Christopher Wlezien The Public as Thermostat: Dynamics of Preferences for Spending , 1995 .

[6]  I. Budge,et al.  What Are Elections For? Conferring the Median Mandate , 2003, British Journal of Political Science.

[7]  R. Rohrschneider The Democracy Deficit and Mass Support for an EU-Wide Government , 2002 .

[8]  Andrew Bennett Disciplining our conjectures , 2014 .

[9]  T. Schulz,et al.  Using Mass Survey Data to Infer Political Positions , 2005 .

[10]  Phyllis Illari,et al.  Mechanistic Evidence: Disambiguating the Russo–Williamson Thesis , 2011 .

[11]  Keith A. Markus,et al.  Making Things Happen: A Theory of Causal Explanation , 2007 .

[12]  Jonathan A. Waskan,et al.  Mechanistic explanation at the limit , 2011, Synthese.

[13]  M. Steenbergen,et al.  Who’s Cueing Whom? , 2007 .

[14]  Jay Verkuilen,et al.  Assigning Membership in a Fuzzy Set Analysis , 2005 .

[15]  Ingo Rohlfing,et al.  Case Studies Nested in Fuzzy-set QCA on Sufficiency , 2016 .

[16]  Matt Golder,et al.  Ideological Congruence and Electoral Institutions , 2010 .

[17]  G. Powell The Ideological Congruence Controversy: The Impact of Alternative Measures, Data, and Time Periods on the Effects of Election Rules , 2009 .

[18]  J. Olsen,et al.  The European Commission , 2020, The European Union.

[19]  C. D. Vries,et al.  Sleeping Giant: Fact or Fairytale? , 2007 .

[20]  Ingo Rohlfing,et al.  Integrating Cross-case Analyses and Process Tracing in Set-Theoretic Research , 2018 .

[21]  Peter Machamer,et al.  Activities and Causation: The Metaphysics and Epistemology of Mechanisms , 2004 .

[22]  John Garry The general election in Ireland, May 2002 , 2004 .

[23]  K. Stange,et al.  Multimethod research , 1994, Journal of General Internal Medicine.

[24]  C. Eijk,et al.  European Integration and Political Conflict: Potential for contestation on European matters at national elections in Europe , 2004 .

[25]  T. Schulz,et al.  Referendums in the EU’s constitution building process , 2007 .

[26]  Comparative Hypothesis Testing Via Process Tracing , 2014 .

[27]  Leonard Ray When Parties Matter: The Conditional Influence of Party Positions on Voter Opinions about European Integration , 2003 .

[28]  D. Finke Domestic Politics and European Treaty Reform , 2009 .

[29]  Jon Elster,et al.  Social Mechanisms: A plea for mechanisms , 1998 .

[30]  Wolfgang C. Müller,et al.  Coalition Governments in Western Europe , 2000 .

[31]  P. Hall Comparative Historical Analysis in the Social Sciences: ALIGNING ONTOLOGY AND METHODOLOGY IN COMPARATIVE POLITICS , 2003 .

[32]  Hanspeter Kriesi The Role of European Integration in National Election Campaigns , 2007 .

[33]  G. Marks,et al.  Evaluating expert judgments , 2007 .

[34]  Members of parliament and governments in Western Europe: Agency relations and problems of oversight , 2000 .

[35]  Hermann Schmitt,et al.  Dynamic Representation , 1995, American Political Science Review.

[36]  Gary Goertz,et al.  Explaining war and peace : case studies and necessary condition counterfactuals , 2007 .

[37]  John D. Huber,et al.  Congruence between Citizens and Policymakers in Two Visions of Liberal Democracy , 1994, World Politics.

[38]  Charles C. Ragin,et al.  Fuzzy-Set Social Science , 2001 .

[39]  S. Hug,et al.  In View of Ratification: Governmental Preferences and Domestic Constraints at the Amsterdam Intergovernmental Conference , 2002, International Organization.

[40]  Henry E. Brady Causation and Explanation in Social Science , 2008 .

[41]  D. J. Scott,et al.  European Integration and Political Conflict: Contesting Europe? The salience of European integration as a party issue , 2004 .

[42]  S. Hug,et al.  Referendums and Citizen Support for European Integration , 2002 .

[43]  Rasmus Brun Pedersen,et al.  Selecting Appropriate Cases When Tracing Causal Mechanisms , 2018 .

[44]  Rasmus Brun Pedersen,et al.  Process-Tracing Methods: Foundations and Guidelines , 2013 .

[45]  T. Falleti,et al.  Context and Causal Mechanisms in Political Analysis , 2009 .

[46]  Brigid Laffan,et al.  Ireland and the European Union , 2008 .

[47]  Leonard Ray Measuring party orientations towards European integration: Results from an expert survey , 1999 .

[48]  Michael Holmes Ireland and the European Union : Nice, enlargement and the future of Europe , 2005 .

[49]  Jon Williamson,et al.  Interpreting Causality in the Health Sciences , 2007 .

[50]  P. Machamer,et al.  Thinking about Mechanisms , 2000, Philosophy of Science.

[51]  P. Burstein The Impact of Public Opinion on Public Policy: A Review and an Agenda , 2003 .

[52]  Clifford J. Carrubba The Electoral Connection in European Union Politics , 2001, The Journal of Politics.

[53]  Carsten Q. Schneider,et al.  Combining QCA and Process Tracing in Set-Theoretic Multi-Method Research , 2013 .

[54]  Michael J. Licari,et al.  When Parties Matter: The Conditional Influence of Party Positions on Voter Opinions about European Integration , 2014 .

[55]  A. Blais,et al.  Does Proportional Representation Foster Closer Congruence Between Citizens and Policy Makers? , 2006 .

[56]  Kurtuluş Gemici,et al.  Causal Case Study Methods: Foundations and Guidelines for Comparing, Matching, and Tracing , 2018 .

[57]  Svend-Erik Skaaning,et al.  Assessing the Robustness of Crisp-set and Fuzzy-set QCA Results , 2011 .

[58]  S. Hobolt Europe in Question , 2009 .

[59]  Wolfgang C. Müller,et al.  Delegation and accountability in parliamentary democracies , 2003 .

[60]  Warren E. Miller,et al.  System characteristics matter: empirical evidence from ten representation studies , 1999 .

[61]  Thomas Saalfeld Members of parliament and governments in Western Europe: Agency relations and problems of oversight , 2000 .

[62]  Charles C. Ragin,et al.  Redesigning social inquiry , 2008 .

[63]  L. Hooghe Europe Divided? , 2003 .

[64]  Steven Samford,et al.  Averting “Disruption and Reversal”: Reassessing the Logic of Rapid Trade Reform in Latin America , 2010 .

[65]  S. Hobolt Europe in Question: Referendums on European Integration , 2009 .

[66]  John Garry,et al.  ‘Second-order’ versus ‘Issue-voting’ Effects in EU Referendums , 2005 .