Qualitative Comparative Analysis and the Study of Policy Processes

Abstract Given the increasing popularity of Qualitative Comparative Analysis (QCA) for the study of public policy and policy processes, this article offers a review of two key issues: multiple configurational causality and temporality. On the one hand, the study of multiple configurational causal relations allows researchers to deal with the extremely complex set of elements that interact in policy processes. However, this task poses the challenge of balancing deductive and inductive logics in a research design. On the other hand, policy process theories often involve temporal arguments, but QCA does not easily deal with dynamic elements. This article discusses these challenges and proposes several ways to address them. It thereby illustrates the advantages and limitations of QCA for students of policy processes.

[1]  Paul Cairney,et al.  Standing on the Shoulders of Giants: How Do We Combine the Insights of Multiple Theories in Public Policy Studies? , 2013 .

[2]  Benoît Rihoux,et al.  Intermediate-N Comparison : Configurational comparative methods , 2014 .

[3]  Simon Hug,et al.  Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference , 2013, Political Analysis.

[4]  P. Hall.  Comparative Historical Analysis in the Social Sciences: ALIGNING ONTOLOGY AND METHODOLOGY IN COMPARATIVE POLITICS , 2003 .

[5]  P. Sabatier.  The Need for Better Theories , 2019, Theories of the Policy Process.

[6]  N. Bandelow.  Advocacy Coalition Framework , 2015 .

[7]  P. Sabatier,et al.  The conditions of effective implementation: a guide to accomplishing policy objectives. , 1979, Policy analysis.

[8]  Carsten Q. Schneider,et al.  Reducing complexity in Qualitative Comparative Analysis (QCA): Remote and proximate factors and the consolidation of democracy , 2006 .

[9]  N. Zahariadis.  The Multiple Streams Framework , 2019, Theories of the Policy Process.

[10]  B. Jones,et al.  A Failure to Communicate: Agenda Setting in Media and Policy Studies , 2013 .

[11]  Carsten Q. Schneider,et al.  Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis , 2012 .

[12]  Alrik Thiem,et al.  Navigating the Complexities of Qualitative Comparative Analysis , 2014, Evaluation review.

[13]  Bear F. Braumoeller.  Guarding Against False Positives in Qualitative Comparative Analysis , 2015, Political Analysis.

[14]  James Mahoney,et al.  Aligning Ontology and Methodology in Comparative Research , 2003 .

[15]  K. A. Owens,et al.  A Comparative Analysis of How Actors Implement: Testing the Contextual Interaction Theory in 48 Cases of Wetland Restoration , 2013 .

[16]  Peer C. Fiss,et al.  Comment: getting QCA right , 2014 .

[17]  Kuhika Gupta.  Comparative Public Policy: Using the Comparative Method to Advance Our Understanding of the Policy Process , 2012 .

[18]  Bart Cambré,et al.  Combining structure, governance and context: A configurational approach to network effectiveness , 2015 .

[19]  Carsten Q. Schneider,et al.  Set-Theoretic Methods for the Social Sciences: Contents , 2012 .

[20]  S. Adam,et al.  The Network Approach , 2019, Theories of the Policy Process.

[21]  P. Sabatier.  Knowledge, Policy-Oriented Learning, and Policy Change , 1987 .

[22]  Jeffrey T. Checkel.  Tracing Causal Mechanisms , 2006 .

[23]  P. Johnson.  The Politics of Attention: How Government Prioritizes Problems , 2006, Perspectives on Politics.

[24]  D. Choi,et al.  Fuzzy Sets on Shaky Ground: Parameter Sensitivity and Confirmation Bias in fsQCA , 2015, Political Analysis.

[25]  Barry Cooper,et al.  Applying Ragin's Crisp and Fuzzy Set QCA to Large Datasets: Social Class and Educational Achievement in the National Child Development Study , 2005 .

[26]  M. Maggetti.  De facto independence after delegation: A fuzzy‐set analysis , 2007 .

[27]  Ferdinand Jaspers,et al.  The Analysis of Temporally Ordered Configurations: Challenges and Solutions , 2013 .

[28]  M. Maggetti,et al.  The role of independent regulatory agencies in policy-making: a comparative analysis , 2009 .

[29]  M. Maggetti,et al.  Dealing with Errors in QCA , 2013 .

[30]  Evan S. Lieberman,et al.  Nested Analysis as a Mixed-Method Strategy for Comparative Research , 2005, American Political Science Review.

[31]  Paul Pierson,et al.  Historical Institutionalism in Contemporary Political Science , 2002 .

[32]  Richard E. Matland.  Synthesizing the Implementation Literature: The Ambiguity-Conflict Model of Policy Implementation , 1995 .

[33]  Atocha Aliseda,et al.  Abductive Reasoning: Logical Investigations into Discovery and Explanation , 2006 .

[34]  Anna Christmann,et al.  Direct Democracy and Minority Rights: Direct and Indirect Effects on Religious Minorities in Switzerland , 2012, Politics and Religion.

[35]  Carsten Q. Schneider,et al.  Combining QCA and Process Tracing in Set-Theoretic Multi-Method Research , 2013 .

[36]  John W. Kingdon.  Agendas, alternatives, and public policies , 1984 .

[37]  T. Risse,et al.  Transnational Diffusion: Norms, Ideas and Policies , 2013 .

[38]  Erik-Hans Klijn,et al.  What Makes Governance Networks Work? A Fuzzy Set Qualitative Comparative Analysis Of 14 Dutch Spatial Planning Projects , 2013 .

[39]  Manuel Fischer,et al.  Institutions and coalitions in policy processes: a cross-sectoral comparison , 2015 .

[40]  Mark K. Cassell.  Ambiguity and Choice in Public Policy: Political Decision Making in Modern Democracies , 2004, Perspectives on Politics.

[41]  Charles C. Ragin,et al.  The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. , 1990 .

[42]  Carsten Q. Schneider,et al.  Set-Theoretic Methods for the Social Sciences: Potential pitfalls and suggestions for solutions , 2012 .

[43]  Benoît Rihoux,et al.  A Commented Review of Applications , 2009 .

[44]  Axel Marx,et al.  QCA, 25 Years after “The Comparative Method” , 2013 .

[45]  S. Bartolini.  On Time and Comparative Research , 1993 .

[46]  Axel Marx,et al.  Mini-Symposium: QCA, 25 years after 'The Comparative Method': Mapping, Challenges and Innovations , 2013 .

[47]  Keith Dowding,et al.  Model or Metaphor? A Critical Review of the Policy Network Approach , 1995 .

[48]  Colin Elman,et al.  Complex Causal Relations and Case Study Methods: The Example of Path Dependence , 2006, Political Analysis.

[49]  Christoph Engel,et al.  Review of: Fritz Scharpf: Games Real Actors Play. Actor-centered institutionalism in Policy Research. Boulder, Colorado 1997 , 2001 .

[50]  Svend-Erik Skaaning,et al.  Assessing the Robustness of Crisp-set and Fuzzy-set QCA Results , 2011 .

[51]  Dirk Berg-Schlosser,et al.  Comparative Research Design: Case and Variable Selection , 2009 .

[52]  C. Weible,et al.  Policy Change in Comparative Contexts: Applying the Advocacy Coalition Framework Outside of Western Europe and North America , 2014 .

[53]  Charles C. Ragin,et al.  Redesigning social inquiry , 2008 .

[54]  Stephen Vaisey.  Comment QCA Works—When Used with Care , 2014 .

[55]  Samuel R. Lucas,et al.  Qualitative Comparative Analysis in Critical Perspective , 2014 .

[56]  Peer C. Fiss.  Building Better Causal Theories: A Fuzzy Set Approach to Typologies in Organization Research , 2011 .

[57]  A. Christmann.  Damoklesschwert Referendum? Die indirekte Wirkung ausgebauter Volksrechte auf die Rechte religiöser Minderheiten , 2010 .

[58]  J. Hacker.  Privatizing Risk without Privatizing the Welfare State: The Hidden Politics of Social Policy Retrenchment in the United States , 2004, American Political Science Review.

[59]  Arend Lijphart,et al.  Comparative Politics and the Comparative Method , 1971, American Political Science Review.

[60]  Svend-Erik Skaaning,et al.  Making the Most of Configurational Comparative Analysis: An Assessment of QCA Applications in Comparative Welfare State Research , 2013 .

[61]  Manuel Fischer,et al.  Coalition Structures and Policy Change in a Consensus Democracy , 2014 .

[62]  Joachim Blatter,et al.  Designing Case Studies , 2012 .

[63]  David Collier,et al.  QCA Should Set Aside the Algorithms , 2014 .

[64]  Neal Caren,et al.  TQCA A Technique for Adding Temporality to Qualitative Comparative Analysis , 2005 .

[65]  James M. Rubenstein,et al.  The Global Diffusion of Markets and Democracy , 2008 .

[66]  M. Howlett,et al.  Studying Public Policy: Policy Cycles and Policy Subsystems , 1996 .

[67]  Ferdinand Jaspers,et al.  Chapter 5 The Analysis of Temporally Ordered Configurations: Challenges and Solutions , 2013 .

[68]  P. Pierson.  Increasing Returns, Path Dependence, and the Study of Politics , 2000, American Political Science Review.

[69]  Benoît Rihoux,et al.  Qualitative Comparative Analysis (QCA) in Public Policy Analysis : An Extensive Review , 2011 .

[70]  Christopher M. Weible,et al.  The advocacy coalition framework , 2012 .

[71]  Kathleen Thelen,et al.  Timing and Temporality in the Analysis of Institutional Evolution and Change , 2000, Studies in American Political Development.

[72]  Michael Baumgartner,et al.  Still Lost in Translation! A Correction of Three Misunderstandings Between Configurational Comparativists and Regressional Analysts , 2016 .

[73]  Bear F. Braumoeller.  Causal Complexity and the Study of Politics , 2003, Political Analysis.

[74]  Edwin Amenta,et al.  Where to Begin , 1994 .

[75]  Joachim Blatter,et al.  Designing case studies : explanatory approaches in small-n research , 2012 .

[76]  Barbara Vis,et al.  Under which conditions does spending on active labor market policies increase? An fsQCA analysis of 53 governments between 1985 and 2003 , 2011, European Political Science Review.

[77]  M. Lubell,et al.  Collaborative Institutions in an Ecology of Games , 2010 .

[78]  Sandra Lowe,et al.  Redesigning Social Inquiry Fuzzy Sets And Beyond , 2016 .

[79]  Carsten Q. Schneider,et al.  Standards of Good Practice in Qualitative Comparative Analysis (QCA) and Fuzzy-Sets , 2010 .

[80]  Charles C. Ragin,et al.  The Comparative Political Economy of the Welfare State: A qualitative comparative analysis of pension systems , 1994 .

[81]  F. Scharpf.  Games Real Actors Play: Actor-centered Institutionalism In Policy Research , 1997 .

[82]  Bryan D. Jones,et al.  Agenda Dynamics and Policy Subsystems , 1991, The Journal of Politics.

[83]  Joachim Blatter,et al.  Preconditions for Foreign Activities of European Regions: Tracing Causal Configurations of Economic, Cultural, and Political Strategies , 2010 .

[84]  Arend Lijphart.  Patterns of democracy : government forms and performance in thirty-six countries , 2000 .

[85]  C. Weible,et al.  New Theories of the Policy Process , 2013 .