Model Ambiguities in Configurational Comparative Research

For many years, sociologists, political scientists, and management scholars have readily relied on Qualitative Comparative Analysis (QCA) for the purpose of configurational causal modeling. However, this article reveals that a severe problem in the application of QCA has gone unnoticed so far: model ambiguities. These arise when multiple causal models fare equally well in accounting for configurational data. Mainly due to the uncritical import of an algorithm that is unsuitable for causal modeling, researchers have typically been unaware of the whole model space. As a result, there exists an indeterminable risk for practically all QCA studies published in the last quarter century to have presented findings that their data did not warrant. Using hypothetical data, we first identify the algorithmic source of ambiguities and discuss to what extent they affect different methodological aspects of QCA. By reanalyzing a published QCA study from rural sociology, we then show that model ambiguities are not a mere theoretical possibility but a reality in applied research, which can assume such extreme proportions that no causal conclusions whatsoever are possible. Finally, the prevalence of model ambiguities is examined by performing a comprehensive analysis of 192 truth tables across 28 QCA studies published in applied sociology. In conclusion, we urge that future QCA practice ensures full transparency with respect to model ambiguities, both by informing readers of QCA-based research about their extent and by employing algorithms capable of revealing them.

[1]  Benoît Rihoux,et al.  Crisp Set Qualitative Comparative Analysis (csQCA) , 2009 .

[2]  Edwin Amenta,et al.  All the Movements Fit to Print: Who, What, When, Where, and Why SMO Families Appeared in the New York Times in the Twentieth Century , 2009 .

[3]  Mona Lena Krook,et al.  Women's Representation in Parliament: A Qualitative Comparative Analysis , 2010 .

[4]  Edwin Amenta,et al.  Age for Leisure? Political Mediation and the Impact of the Pension Movement on U.S. Old-Age Policy , 2005 .

[5]  Adrian Duşa,et al.  Enhancing the Minimization of Boolean and Multivalue Output Functions With eQMC , 2015 .

[6]  Nripendra N. Biswas,et al.  Minimization of Boolean Functions , 1971, IEEE Transactions on Computers.

[7]  Carsten Q. Schneider,et al.  Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis , 2012 .

[8]  Terry Boswell,et al.  Strikebreaking or Solidarity in the Great Steel Strike of 1919: A Split Labor Market, Game-Theoretic, and QCA Analysis , 1995, American Journal of Sociology.

[9]  Alexander Hicks,et al.  The programmatic emergence of the social security state , 1995 .

[10]  Dirk Berg-Schlosser,et al.  Multi-Value QCA (mvQCA) , 2009 .

[11]  Michael Baumgartner,et al.  Detecting Causal Chains in Small-n Data , 2013 .

[12]  Alrik Thiem,et al.  Unifying Configurational Comparative Methodology Generalized-Set Qualitative Comparative Analysis , 2012 .

[13]  Charles C. Ragin,et al.  Set Relations in Social Research: Evaluating Their Consistency and Coverage , 2006, Political Analysis.

[14]  Carsten Q. Schneider,et al.  Set-Theoretic Methods for the Social Sciences: Potential pitfalls and suggestions for solutions , 2012 .

[15]  A Qualitative Comparative Analysis of Welfare Legitimacy , 1996 .

[16]  Cristina Corduneanu-Huci,et al.  Running Uphill: Political Opportunity in Non-democracies , 2003 .

[17]  Edwin Amenta,et al.  Where to Begin , 1994 .

[18]  Christopher Botsko,et al.  Theoretical Generality, Case Particularity: Qualitative Comparative Analysis of Trade Union Growth and Decline , 1991, Issues and Alternatives in Comparative Social Research.

[19]  Robert D. Putnam,et al.  Bowling alone: the collapse and revival of American community , 2000, CSCW '00.

[20]  Adrian Duşa,et al.  QCA: A Package for Qualitative Comparative Analysis , 2013, R J..

[21]  D. Snow,et al.  The Outcomes of Homeless Mobilization: The Influence of Organization, Disruption, Political Mediation, and Framing , 2000, American Journal of Sociology.

[22]  J. Visser,et al.  When Institutions Matter - Union growth and Decline in Western Europe , 1999 .

[23]  Hilary Boudet,et al.  To Act or Not to Act: Context, Capability, and Community Response to Environmental Risk1 , 2012, American Journal of Sociology.

[24]  Carsten Q. Schneider,et al.  Set-Theoretic Methods for the Social Sciences: Contents , 2012 .

[25]  Sabrina Hirsch,et al.  Logic Minimization Algorithms For Vlsi Synthesis , 2016 .

[26]  Axel Marx,et al.  From Niche to Mainstream Method? A comprehensive mapping of QCA application in journal articles from 1984 to 2011 , 2013 .

[27]  Alrik Thiem,et al.  Unifying Configurational Comparative Methods , 2014 .

[28]  Dag Wollebæk,et al.  Volatility and Growth in Populations of Rural Associations , 2010 .

[29]  Vilmos F. Misangyi,et al.  Substitutes or Complements? A Configurational Examination of Corporate Governance Mechanisms , 2014 .

[30]  Michael Baumgartner,et al.  A Coincidence Analysis of a Causal Chain , 2014 .

[31]  Peer C. Fiss A set-theoretic approach to organizational configurations , 2007 .

[32]  Joya Misra Women as Agents in Welfare State Development: A Cross-National Analysis of Family Allowance Adoption , 2003 .

[33]  Terry Boswell,et al.  The Scope of General Theory , 1999 .

[34]  Michael Baumgartner,et al.  Identifying Complex Causal Dependencies in Configurational Data with Coincidence Analysis , 2015, R J..

[35]  David C. Krehnke Corporate Governance , 2007, Information Security Management Handbook, 6th ed..

[36]  Charles C. Ragin,et al.  Assessing Discrimination: A Boolean Approach. , 1984 .

[37]  Adrian Duşa,et al.  Boolean Minimization in Social Science Research , 2013 .

[38]  Sandra Lowe,et al.  Redesigning Social Inquiry Fuzzy Sets And Beyond , 2016 .

[39]  Carsten Q. Schneider,et al.  Standards of Good Practice in Qualitative Comparative Analysis (QCA) and Fuzzy-Sets , 2010 .

[40]  Jerry M. Mendel,et al.  Charles Ragin's Fuzzy Set Qualitative Comparative Analysis (fsQCA) used for linguistic summarizations , 2012, Inf. Sci..

[41]  Sabina Avdagic When Are Concerted Reforms Feasible? Explaining the Emergence of Social Pacts in Western Europe , 2010 .

[42]  Adrian Duşa,et al.  Qualitative Comparative Analysis with R: A User's Guide , 2012 .

[43]  Randy Hodson,et al.  Unions, Solidarity, and Striking , 2004 .

[44]  Michael Baumgartner,et al.  Inferring Causal Complexity , 2009 .

[45]  J. Walkup Fuzzy-set social science , 2003 .

[46]  W. Quine On Cores and Prime Implicants of Truth Functions , 1959 .

[47]  Ruth V. Aguilera,et al.  Corporate Governance and Investors' Perceptions of Foreign IPO Value: An Institutional Perspective , 2014 .

[48]  Michael Baumgartner,et al.  Parsimony and Causality , 2015 .

[49]  J. Mackie,et al.  The cement of the universe : a study of causation , 1977 .

[50]  Willard Van Orman Quine,et al.  The Problem of Simplifying Truth Functions , 1952 .

[51]  Edward J. McCluskey,et al.  Introduction to the theory of switching circuits , 1965 .