A worked example of initial theory-building: PARTNERS2 collaborative care for people who have experienced psychosis in England

In this article, we present an exemplar of the initial theory-building phase of theory-driven evaluation for the PARTNERS2 project, a collaborative care intervention for people with experience of psychosis in England. Initial theory-building involved analysis of the literature, interviews with key leaders and focus groups with service users. The initial programme theory was developed from these sources in an iterative process between researchers and stakeholders (service users, practitioners, commissioners) involving four activities: articulation of 442 explanatory statements systematically developed using realist methods; debate and consensus; communication; and interrogation. We refute two criticisms of theory-driven evaluation of complex interventions. We demonstrate how the process of initial theory-building made a meaningful contribution to our complex intervention in five ways. Although time-consuming, it allowed us to develop an internally coherent and well-documented intervention. This study and the lessons learnt provide a detailed resource for other researchers wishing to build theory for theory-driven evaluation.

[1]  S. Reilly,et al.  Refining a model of collaborative care for people with a diagnosis of bipolar, schizophrenia or other psychoses in England: a qualitative formative evaluation , 2019, BMC Psychiatry.

[2]  Susan Michie,et al.  Building programme theory to develop more adaptable and scalable complex interventions: Realist formative process evaluation prior to full trial , 2018, Evaluation.

[3]  P. Allmark,et al.  Building Realist Program Theory for Large Complex and Messy Interventions , 2017 .

[4]  S. Asthana,et al.  Collaborative action for person-centred coordinated care (P3C): an approach to support the development of a comprehensive system-wide solution to fragmented care , 2017, Health Research Policy and Systems.

[5]  R. Pawson Middle Range Theory and Program Theory Evaluation: From Provenance to Practice 1 , 2017 .

[6]  R. Byng,et al.  Pilot randomised controlled trial of the ENGAGER collaborative care intervention for prisoners with common mental health problems, near to and after release , 2017, Pilot and Feasibility Studies.

[7]  G. Moore,et al.  What theory, for whom and in which context? Reflections on the application of theory in the development and evaluation of complex population health interventions , 2016, SSM - population health.

[8]  Valéry Ridde,et al.  The concept of mechanism from a realist approach: a scoping review to facilitate its operationalization in public health program evaluation , 2015, Implementation Science.

[9]  S. Donaldson,et al.  Theory in evaluation: Reducing confusion and encouraging debate , 2015 .

[10]  S. Michie,et al.  Using realist review to inform intervention development: methodological illustration and conceptual platform for collaborative care in offender mental health , 2015, Implementation Science.

[11]  C. Neville Collaborative care approaches for people with severe mental illness. , 2015, Clinical nurse specialist CNS.

[12]  R. Kupka,et al.  Collaborative care for patients with bipolar disorder: randomised controlled trial , 2015, British Journal of Psychiatry.

[13]  P. Bower,et al.  Integrated primary care for patients with mental and physical multimorbidity: cluster randomised controlled trial of collaborative care for patients with depression comorbid with diabetes or cardiovascular disease , 2015, BMJ : British Medical Journal.

[14]  Vikram Patel,et al.  Theory of Change: a theory-driven approach to enhance the Medical Research Council's framework for complex interventions , 2014, Trials.

[15]  Gennaro F. Vito,et al.  Theory-Driven Evaluation , 2014 .

[16]  V. Patel,et al.  Effectiveness of a community-based intervention for people with schizophrenia and their caregivers in India (COPSI): a randomised controlled trial , 2014, The Lancet.

[17]  R. Perkins,et al.  Uses and abuses of recovery: implementing recovery‐oriented practices in mental health systems , 2014, World psychiatry : official journal of the World Psychiatric Association.

[18]  M. Slade,et al.  Fit for purpose? Validation of a conceptual framework for personal recovery with current mental health consumers , 2014, The Australian and New Zealand journal of psychiatry.

[19]  B. Druss,et al.  Collaborative care approaches for people with severe mental illness. , 2013, The Cochrane database of systematic reviews.

[20]  R. Araya,et al.  Clinical effectiveness of collaborative care for depression in UK primary care (CADET): cluster randomised controlled trial , 2013, BMJ.

[21]  M. Slade,et al.  Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis , 2011, British Journal of Psychiatry.

[22]  Chris L. S. Coryn,et al.  A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009 , 2011 .

[23]  Patricia J. Rogers,et al.  Purposeful Program Theory: Effective Use of Theories of Change and Logic Models , 2011 .

[24]  Glenn Roberts,et al.  Life coaching for mental health recovery: the emerging practice of recovery coaching , 2010 .

[25]  Alan Shiell,et al.  Theorising Interventions as Events in Systems , 2009, American journal of community psychology.

[26]  Rob Anderson New MRC guidance on evaluating complex interventions , 2008, BMJ : British Medical Journal.

[27]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[28]  A. Kilbourne,et al.  Improving medical and psychiatric outcomes among individuals with bipolar disorder: a randomized controlled trial. , 2008, Psychiatric services.

[29]  Wendy Brown Recovering mental health in Scotland , 2008 .

[30]  Mhairi Mackenzie,et al.  Theories of Change and Realistic Evaluation , 2007 .

[31]  G. Bedi,et al.  Best practices: the consultation-liaison in primary-care psychiatry program: a structured approach to long-term collaboration. , 2007, Psychiatric services.

[32]  D. Anthony Evidence-based Policy: A Realist Perspective , 2007 .

[33]  A. Kilbourne,et al.  Collaborative care for bipolar disorder: part I. Intervention and implementation in a randomized effectiveness trial. , 2006, Psychiatric services.

[34]  M. Petticrew,et al.  Developing and Evaluating Complex Interventions: New Guidance , 2006 .

[35]  Fadhel Kaboub Realistic Evaluation , 2004 .

[36]  Nicoletta Stame,et al.  Theory-Based Evaluation and Types of Complexity , 2004 .

[37]  B. Druss,et al.  Integrated medical care for patients with serious psychiatric illness: a randomized trial. , 2001, Archives of general psychiatry.

[38]  Carol H. Weiss,et al.  Theory‐based evaluation: Past, present, and future , 1997 .

[39]  Brian T. Austin,et al.  Organizing care for patients with chronic illness. , 1996, The Milbank quarterly.

[40]  Stanley H. Cohen,et al.  Evaluative Research , 1975 .

[41]  Lois Beech,et al.  The Five Year Forward View for Mental Health , 2016 .

[42]  A. Beekman,et al.  Study protocol Collaborative care for patients with bipolar disorder: A randomised controlled trial , 2015 .

[43]  M. Petticrew,et al.  Developing and Evaluating Complex Interventions , 2015 .

[44]  David E. Goodrich,et al.  Enhanced fidelity to treatment for bipolar disorder: results from a randomized controlled implementation trial. , 2014, Psychiatric services.

[45]  Carol H. Weiss,et al.  Nothing as Practical as Good Theory : Exploring Theory-Based Evaluation for Comprehensive Community Initiatives for Children and Families , 2011 .

[46]  Vocational rehabilitation for people with severe mental illness (Review) , 2007 .

[47]  Ray Pawson,et al.  Evidence-based policy: a realist perspective. , 2006 .

[48]  James P. Connell and Anne C. Kubisch Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems , 1998 .

[49]  J. Connell,et al.  New Approaches to Evaluating Community Initiatives. Concepts, Methods, and Contexts. Roundtable on Comperhensive Community Initiatives for Children and Families. , 1995 .

[50]  D. Kirkpatrick Techniques for evaluating training programs , 1979 .