Process evaluations of primary care interventions addressing chronic disease: a systematic review

Objective Process evaluations (PEs) alongside randomised controlled trials of complex interventions are valuable because they address questions of for whom, how and why interventions had an impact. We synthesised the methods used in PEs of primary care interventions, and their main findings on implementation barriers and facilitators. Design Systematic review using the UK Medical Research Council guidance for PE as a guide. Data sources Academic databases (MEDLINE, SCOPUS, PsycINFO, Cumulative Index to Nursing and Allied Health Literature, EMBASE and Global Health) were searched from 1998 until June 2018. Eligibility criteria We included PE alongside randomised controlled trials of primary care interventions which aimed to improve outcomes for patients with non-communicable diseases. Data extraction and synthesis Two independent reviewers screened and conducted the data extraction and synthesis, with a third reviewer checking a sample for quality assurance. Results 69 studies were included. There was an overall lack of consistency in how PEs were conducted and reported. The main weakness is that only 30 studies were underpinned by a clear intervention theory often facilitated by the use of existing theoretical frameworks. The main strengths were robust sampling strategies, and the triangulation of qualitative and quantitative data to understand an intervention’s mechanisms. Findings were synthesised into three key themes: (1) a fundamental mismatch between what the intervention was designed to achieve and local needs; (2) the required roles and responsibilities of key actors were often not clearly understood; and (3) the health system context—factors such as governance, financing structures and workforce—if unanticipated could adversely impact implementation. Conclusion Greater consistency is needed in the reporting and the methods of PEs, in particular greater use of theoretical frameworks to inform intervention theory. More emphasis on formative research in designing interventions is needed to align the intervention with the needs of local stakeholders, and to minimise unanticipated consequences due to context-specific barriers. PROSPERO registration number CRD42016035572.

[1]  Yongqing Xu,et al.  Antegrade intramedullary nail versus plate fixation in the treatment of humeral shaft fractures , 2019, Medicine.

[2]  R. Atun,et al.  Action to address the household economic burden of non-communicable diseases , 2018, The Lancet.

[3]  R. Armstrong,et al.  TIDieR-PHP: a reporting guideline for population health and policy interventions , 2018, British Medical Journal.

[4]  Marguerite Schneider,et al.  Process evaluations of task sharing interventions for perinatal depression in low and middle income countries (LMIC): a systematic review and qualitative meta-synthesis , 2018, BMC Health Services Research.

[5]  Peter Byass,et al.  Universal health coverage is needed to deliver NCD control , 2018, The Lancet.

[6]  J. Pandian,et al.  Clinical stroke research in resource limited settings: Tips and hints , 2018, International journal of stroke : official journal of the International Stroke Society.

[7]  A. Booth,et al.  Applying GRADE-CERQual to qualitative evidence synthesis findings—paper 2: how to make an overall CERQual assessment of confidence and create a Summary of Qualitative Findings table , 2018, Implementation Science.

[8]  M. Kieny,et al.  Systems science for universal health coverage , 2017, Bulletin of the World Health Organization.

[9]  Chris Bullen,et al.  The impact of a point-of-care testing device on CVD risk assessment completion in New Zealand primary-care practice: A cluster randomised controlled trial and qualitative investigation , 2017, PloS one.

[10]  Elvin H Geng,et al.  Implementation science: Relevance in the real world without sacrificing rigor , 2017, PLoS medicine.

[11]  Elizabeth Murray,et al.  Standards for Reporting Implementation Studies (StaRI) Statement , 2017, British Medical Journal.

[12]  B. Guthrie,et al.  Process evaluation of the Data-driven Quality Improvement in Primary Care (DQIP) trial: case study evaluation of adoption and maintenance of a complex intervention to reduce high-risk primary care prescribing , 2017, BMJ Open.

[13]  Andrew Booth,et al.  Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework , 2017, Implementation Science.

[14]  Jesse C. Crosson,et al.  Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation , 2017, Implementation Science.

[15]  B. Chi,et al.  Hypertension management in rural primary care facilities in Zambia: a mixed methods study , 2017, BMC Health Services Research.

[16]  B. Guthrie,et al.  Process evaluation of the data-driven quality improvement in primary care (DQIP) trial: active and less active ingredients of a multi-component complex intervention to reduce high-risk primary care prescribing , 2017, Implementation Science.

[17]  J. Rycroft-Malone,et al.  Process evaluations in neurological rehabilitation: a mixed-evidence systematic review and recommendations for future research , 2016, BMJ Open.

[18]  S. Jan,et al.  Examining the use of process evaluations of randomised controlled trials of complex interventions addressing chronic disease in primary health care—a systematic review protocol , 2016, Systematic Reviews.

[19]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation , 2016, British Medical Journal.

[20]  G. Wong,et al.  Can “realist” randomised controlled trials be genuinely realist? , 2016, Trials.

[21]  Graham Moore,et al.  Realist complex intervention science: Applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions , 2016, Evaluation.

[22]  B. McKinstry,et al.  Involving patients in clinical research: the Telescot Patient Panel , 2016, Health expectations : an international journal of public participation in health care and health policy.

[23]  C. Jackson,et al.  Making sense of change: patients’ views of diabetes and GP‐led integrated diabetes care , 2016, Health expectations : an international journal of public participation in health care and health policy.

[24]  Elizabeth Murray,et al.  Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews , 2015, Implementation Science.

[25]  S. Majumdar,et al.  Contextualizing the Effectiveness of a Collaborative Care Model for Primary Care Patients with Diabetes and Depression (Teamcare): A Qualitative Assessment Using RE-AIM. , 2015, Canadian journal of diabetes.

[26]  K. Khunti,et al.  Explaining engagement in self-monitoring among participants of the DESMOND Self-monitoring Trial: a qualitative interview study. , 2015, Family practice.

[27]  C. Fox,et al.  Chronic Kidney Disease Guideline Implementation in Primary Care: A Qualitative Report from the TRANSLATE CKD Study , 2015, The Journal of the American Board of Family Medicine.

[28]  Alex Brown,et al.  Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review , 2015, BMC Health Services Research.

[29]  P. Nilsen Making sense of implementation theories, models and frameworks , 2015, Implementation Science.

[30]  Radha Rao,et al.  Building a primary care/research partnership: lessons learned from a telehealth intervention for diabetes and depression. , 2015, Family practice.

[31]  A. O’Cathain,et al.  Process evaluation of complex interventions: Medical Research Council guidance , 2015, BMJ : British Medical Journal.

[32]  Penelope Hawe,et al.  Lessons from complex interventions to improve health. , 2015, Annual review of public health.

[33]  R. Doughty,et al.  Telecare for Diabetes, CHF or COPD: Effect on Quality of Life, Hospital Use and Costs. A Randomised Controlled Trial and Qualitative Evaluation , 2015, PloS one.

[34]  P. Shekelle,et al.  Reporting of context and implementation in studies of global health interventions: a pilot study , 2014, Implementation Science.

[35]  C. Chew‐Graham,et al.  Facilitating professional liaison in collaborative care for depression in UK primary care; a qualitative study utilising normalisation process theory , 2014, BMC Family Practice.

[36]  J. Pencharz,et al.  Finding a BETTER way: A qualitative study exploring the prevention practitioner intervention to improve chronic disease prevention and screening in family practice , 2014, BMC Family Practice.

[37]  J. Wyatt,et al.  Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide , 2014, BMJ : British Medical Journal.

[38]  David Moher,et al.  Reducing waste from incomplete or unusable reports of biomedical research , 2014, The Lancet.

[39]  Aziz Sheikh,et al.  Exploring telemonitoring and self-management by patients with chronic obstructive pulmonary disease: a qualitative study embedded in a randomized controlled trial. , 2013, Patient education and counseling.

[40]  T. Greenhalgh,et al.  Realist RCTs of complex interventions - an oxymoron. , 2013, Social science & medicine.

[41]  K. Carlisle,et al.  A qualitative case study of telehealth for in-home monitoring to support the management of type 2 diabetes , 2013, Journal of telemedicine and telecare.

[42]  R. Araya,et al.  A cluster randomised controlled trial to determine the clinical effectiveness and cost-effectiveness of classroom-based cognitive-behavioural therapy (CBT) in reducing symptoms of depression in high-risk adolescents , 2013 .

[43]  V. Drennan,et al.  Structured Pro-Active Care for Chronic Depression by Practice Nurses in Primary Care: A Qualitative Evaluation , 2013, PloS one.

[44]  P. Whiting,et al.  Systematic review and meta-analysis of the current evidence on the duration of protection by bacillus Calmette-Guérin vaccination against tuberculosis. , 2013, Health technology assessment.

[45]  Trudy van der Weijden,et al.  The Development of a Mobile Monitoring and Feedback Tool to Stimulate Physical Activity of People With a Chronic Disease in Primary Care: A User-Centered Design , 2013, JMIR mHealth and uHealth.

[46]  A. Sheikh,et al.  Experiences of patients and professionals participating in the HITS home blood pressure telemonitoring trial: a qualitative study , 2013, BMJ Open.

[47]  Bruce Guthrie,et al.  Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting , 2013, Trials.

[48]  Nathaniel Otoo,et al.  Moving towards universal health coverage: health insurance reforms in nine developing countries in Africa and Asia , 2012, The Lancet.

[49]  U. W. Jayasinghe,et al.  Predictors of primary care referrals to a vascular disease prevention lifestyle program among participants in a cluster randomised trial , 2012, BMC Health Services Research.

[50]  Mark G. Davis,et al.  A pragmatic randomised controlled trial to evaluate the cost-effectiveness of a physical activity intervention as a treatment for depression: the treating depression with physical activity (TREAD) trial. , 2012, Health technology assessment.

[51]  S Rachel Skinner,et al.  School-based vaccination: a systematic review of process evaluations. , 2011, Vaccine.

[52]  V. Patel,et al.  The integration of the treatment for common mental disorders in primary care: experiences of health care providers in the MANAS trial in Goa, India , 2011, International journal of mental health systems.

[53]  D. Casey,et al.  Developing a structured education programme for clients with COPD. , 2011, British journal of community nursing.

[54]  E. O'Shea,et al.  Peer support for patients with type 2 diabetes: cluster randomised controlled trial , 2011, BMJ : British Medical Journal.

[55]  D. Mant,et al.  Systematic review and validation of prediction rules for identifying children with serious infections in emergency departments and urgent-access primary care. , 2012, Health technology assessment.

[56]  P. Bower,et al.  What work has to be done to implement collaborative care for depression? Process evaluation of a trial utilizing the Normalization Process Model , 2010, Implementation science : IS.

[57]  Claire Glenton,et al.  Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study , 2009, BMJ : British Medical Journal.

[58]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[59]  P. Bower,et al.  Developing guided self-help for depression using the Medical Research Council complex interventions framework: a description of the modelling phase and results of an exploratory randomised controlled trial , 2008, BMC psychiatry.

[60]  S. Tobe,et al.  Diabetes risk evaluation and microalbuminuria (DREAM) studies: ten years of participatory research with a First Nation’s home and community model for type 2 diabetes care in Northern Saskatchewan , 2008, International journal of circumpolar health.

[61]  C. Chew‐Graham,et al.  Failure to improve appropriateness of referrals to adult community mental health services--lessons from a multi-site cluster randomized controlled trial. , 2008, Family practice.

[62]  V. Patel,et al.  Integrating evidence‐based treatments for common mental disorders in routine primary care: feasibility and acceptability of the MANAS intervention in Goa, India , 2008, World psychiatry : official journal of the World Psychiatric Association.

[63]  A. Dietrich,et al.  Sustainable Impact of a Primary Care Depression Intervention , 2007, The Journal of the American Board of Family Medicine.

[64]  B. Tiemens A randomised controlled trial to test the feasibility of a collaborative care model for the management of depression in older people1 , 2007 .

[65]  J. Schaefer,et al.  Qualitative study of an intervention for depression among patients with diabetes: how can we optimize patient-professional interaction? , 2006, Chronic illness.

[66]  J. Schaefer,et al.  Qualitative study of an intervention for depression among patients with diabetes: how can we optimize patient—professional interaction? , 2006 .

[67]  C. Dowrick,et al.  Qualitative study of an educational intervention for GPs in the assessment and management of depression. , 2005, The British journal of general practice : the journal of the Royal College of General Practitioners.

[68]  P. Murchie,et al.  Running nurse-led secondary prevention clinics for coronary heart disease in primary care: qualitative study of health professionals' perspectives. , 2005, The British journal of general practice : the journal of the Royal College of General Practitioners.

[69]  A. Dietrich,et al.  Going to Scale: Re-Engineering Systems for Primary Care Treatment of Depression , 2004, The Annals of Family Medicine.

[70]  L. Mynors-Wallis,et al.  Credibility of problem-solving therapy and medication for the treatment of depression among primary care patients. , 2002, Medical science monitor : international medical journal of experimental and clinical research.

[71]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[72]  J. Holmen,et al.  IMPLEMENTING CLINICAL GUIDELINES IN THE TREATMENT OF DIABETES MELLITUS IN GENERAL PRACTICE , 2000, International Journal of Technology Assessment in Health Care.

[73]  J. Grimshaw,et al.  Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651]. , 2014, Implementation science : IS.

[74]  P Tappenden,et al.  The clinical effectiveness and cost-effectiveness of home-based, nurse-led health promotion for older people: a systematic review. , 2012, Health technology assessment.

[75]  W. Katon,et al.  Impacting Late Life Depression: Integrating a Depression Intervention into Primary Care , 2004, Psychiatric Quarterly.