Using Qualitative Comparative Analysis to understand complex policy problems

This article shows how Qualitative Comparative Analysis (QCA) can be used to understand what works to address complex policy problems at a local level, using the example of tackling high rates of teenage conceptions in England’s most deprived local authority areas. QCA is a promising method for providing evidence in situations where interventions interact with contexts, enabling causal pathways to be discerned from how sets of conditions combine with particular outcomes: in this instance, whether inequalities in conception rates do or do not narrow, compared with the England average. A wide range of survey and secondary data, sourced in collaboration with practitioners, was explored to identify conditions that might show a relationship with the outcome. Applying QCA’s process of logical reduction enabled identification of sets of cases. Two narrowing sets and three not-narrowing sets are presented, showing how there are different pathways to narrowing and not-narrowing outcomes, and how conditions often combine to have causal effect. Although based on systematic cross-case comparison, the article also demonstrates the importance of judgement and interpretation in QCA.

[1]  D. Walsh,et al.  Changing places? A comparative analysis of area-based health trends in Scotland through the 1980s and 1990s. , 2007, Public health.

[2]  Peter C. Smith,et al.  Performance Measurement in Health Care: History, Challenges and Prospects , 2005 .

[3]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[4]  P. Tugwell,et al.  Better evidence about wicked issues in tackling health inequities. , 2009, Journal of public health.

[5]  J. Kooiman,et al.  Governing as Governance , 2003 .

[6]  J. Miles,et al.  Deprivation and variations in teenage conceptions and abortions in England , 2005, Journal of Family Planning and Reproductive Health Care.

[7]  Paul Dalziel,et al.  Education and Skills , 2013 .

[8]  John Yen,et al.  Introduction , 2004, CACM.

[9]  L. Young Commissioning a patient-led NHS , 2005 .

[10]  HighWire Press,et al.  Epidemiology and community health , 1979 .

[11]  Rachel Parker,et al.  Bureaucracy or Post-Bureaucracy? Public Sector Organisations in a Changing Context , 2004 .

[12]  Colin Elman,et al.  Complex Causal Relations and Case Study Methods: The Example of Path Dependence , 2006, Political Analysis.

[13]  Tim Blackman,et al.  Exploring Explanations for Local Reductions in Teenage Pregnancy Rates in England: An Approach Using Qualitative Comparative Analysis , 2012, Social Policy and Society.

[14]  David R. Jones,et al.  How can systematic reviews incorporate qualitative research? A critical perspective , 2006 .

[15]  R. Baggott Health and Health Care in Britain , 1994 .

[16]  S. Macintyre,et al.  Good intentions and received wisdom are not good enough: the need for controlled trials in public health , 2010, Journal of Epidemiology & Community Health.

[17]  M. Fotaki Can Directors of Public Health implement the new public health agenda in primary care? A case study of Primary Care Trusts in the North West of England , 2007 .

[18]  Lasse Gerrits,et al.  Managing Complex Governance Systems , 2009 .

[19]  P. De Graaf Placing health: neighbourhood renewal, health improvement and complexity , 2007, International Journal of Integrated Care.

[20]  Benoît Rihoux,et al.  Qualitative Comparative Analysis (QCA) As an Approach , 2009 .

[21]  Tim Blackman,et al.  A Qualitative Comparative Analysis of factors associated with trends in narrowing health inequalities in England. , 2011, Social science & medicine.

[22]  M. Kelly,et al.  Synthesizing diverse evidence: the use of primary qualitative data analysis methods and logic models in public health reviews. , 2010, Public health.

[23]  David Byrne,et al.  Complexity Theory and the Social Sciences , 2022 .

[24]  Peer C. Fiss Case Studies and the Configurational Analysis of Organizational Phenomena , 2009 .

[25]  e-Comms Team Securing Good Health for the Whole Population , 2004 .

[26]  Rebecca S French,et al.  Exploring the attitudes and behaviours of Bangladeshi, Indian and Jamaican young people in relation to reproductive and sexual health. , 2004 .

[27]  D. Mcqueen The evidence debate , 2002, Journal of epidemiology and community health.

[28]  Mark Exworthy,et al.  Big Windows and Little Windows: Implementation in the ‘Congested State’ , 2004 .

[29]  T. Blackman Rethinking policy-related research: charting a path using qualitative comparative analysis and complexity theory , 2013 .

[30]  David Binnerts Freedom from command and control: a better way to make the work work , 2007 .

[31]  Brian Head,et al.  Three lenses of evidence-based policy , 2008 .

[32]  S. Dopson The Potential of the Case Study Method for Organisational Analysis , 2003 .

[33]  H Roberts,et al.  Evidence, hierarchies, and typologies: horses for courses , 2003, Journal of epidemiology and community health.

[34]  L. Coleman New opportunities for reducing the risk from teenage pregnancy--what is the evidence base for tackling risk behaviours in combination? , 2002 .

[35]  R. Parker,et al.  Communities and Local Government , 2008 .

[36]  D. J. Gray,et al.  Teenagers and risk-taking: pregnancy and smoking. , 1998, The British journal of general practice : the journal of the Royal College of General Practitioners.

[37]  H. Graham Tackling Inequalities in Health in England: Remedying Health Disadvantages, Narrowing Health Gaps or Reducing Health Gradients? , 2004, Journal of Social Policy.

[38]  V. Berridge Multidisciplinary public health: what sort of victory? , 2007, Public health.

[39]  A. George,et al.  Case Studies and Theory Development in the Social Sciences , 2005 .

[40]  M. Salvadori Contemporary social science , 1953 .

[41]  Katherine E. Smith,et al.  The Public Health System in England: a Scoping Study , 2007 .

[42]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[43]  Charles C. Ragin,et al.  Fuzzy-Set Social Science , 2001 .

[44]  Lasse Gerrits,et al.  Managing complex governance systems: dynamics, self-organization and coevolution in public investments , 2009 .

[45]  Tackling health inequalities : turning policy into practice ? , 2004 .

[46]  Tim Blackman,et al.  Performance Assessment and Wicked Problems: The Case of Health Inequalities , 2006 .

[47]  Claudius Wagemann,et al.  Qualitative Comparative Analysis (QCA) , 2014 .

[48]  Benoît Rihoux,et al.  Addressing the critiques of QCA , 2009 .