Combining qualitative and quantitative operational research methods to inform quality improvement in pathways that span multiple settings

Background Improving integration and continuity of care across sectors within resource constraints is a priority in many health systems. Qualitative operational research methods of problem structuring have been used to address quality improvement in services involving multiple sectors but not in combination with quantitative operational research methods that enable targeting of interventions according to patient risk. We aimed to combine these methods to augment and inform an improvement initiative concerning infants with congenital heart disease (CHD) whose complex care pathway spans multiple sectors. Methods Soft systems methodology was used to consider systematically changes to services from the perspectives of community, primary, secondary and tertiary care professionals and a patient group, incorporating relevant evidence. Classification and regression tree (CART) analysis of national audit datasets was conducted along with data visualisation designed to inform service improvement within the context of limited resources. Results A ‘Rich Picture’ was developed capturing the main features of services for infants with CHD pertinent to service improvement. This was used, along with a graphical summary of the CART analysis, to guide discussions about targeting interventions at specific patient risk groups. Agreement was reached across representatives of relevant health professions and patients on a coherent set of targeted recommendations for quality improvement. These fed into national decisions about service provision and commissioning. Conclusions When tackling complex problems in service provision across multiple settings, it is important to acknowledge and work with multiple perspectives systematically and to consider targeting service improvements in response to confined resources. Our research demonstrates that applying a combination of qualitative and quantitative operational research methods is one approach to doing so that warrants further consideration.

[1]  R. Graham PROBLEM CONSTRUCTION AND THE INFLUENCE OF O.R. , 1982 .

[2]  Colin Eden Management Science Process—Problem Construction and the Influence of O.R. , 1982 .

[3]  Richard A. Olshen,et al.  CART: Classification and Regression Trees , 1984 .

[4]  J. Mingers,et al.  Rational analysis for a problematic world revisited : problem structuring methods for complexity, uncertainty and conflict , 1989 .

[5]  Colin Eden Problem construction and the influence of OR , 1995 .

[6]  D. Spiegelhalter,et al.  Consensus development methods, and their use in clinical guideline development. , 1998, Health technology assessment.

[7]  Peter Checkland,et al.  Systems Thinking, Systems Practice: Includes a 30-Year Retrospective , 1999 .

[8]  Original Research , 2000 .

[9]  John Mingers,et al.  Variety is the spice of life: combining soft and hard OR/MS methods , 2000 .

[10]  P. Checkland Soft Systems Methodology: A Thirty Year Retrospective a , 2000 .

[11]  A. Hutchinson,et al.  Research methods used in developing and applying quality indicators in primary care , 2002, BMJ : British Medical Journal.

[12]  G. Bevan,et al.  "Systematic" , 1966, Comput. J..

[13]  Paul R. Harper,et al.  On the challenges of healthcare modelling and a proposed project life cycle for successful implementation , 2004, J. Oper. Res. Soc..

[14]  Jonathan Rosenhead,et al.  Problem structuring methods in action , 2004, Eur. J. Oper. Res..

[15]  Jesper Simonsen,et al.  Soft Systems Methodology , 2020, Systems Approaches to Making Change: A Practical Guide.

[16]  Building integrated care Lessons from the UK and elsewhere the voice of NHS leadership , 2005 .

[17]  J. Popay,et al.  Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field , 2005, Journal of health services research & policy.

[18]  Susan Michie,et al.  Developing and Evaluating Complex Interventions , 2015 .

[19]  Carlos A. Bana e Costa,et al.  Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing , 2007, Ann. Oper. Res..

[20]  Ray J. Paul,et al.  Simulation modelling in healthcare: reviewing legacies and investigating futures , 2007, J. Oper. Res. Soc..

[21]  John Quigley,et al.  Mixing methodologies to enhance the implementation of healthcare operational research , 2007, J. Oper. Res. Soc..

[22]  Peter Checkland,et al.  Learning For Action: A Short Definitive Account of Soft Systems Methodology, and its use for Practitioners, Teachers and Students , 2007 .

[23]  D. Baker,et al.  Deficits in communication and information transfer between hospital-based and primary care physicians: implications for patient safety and continuity of care. , 2007, JAMA.

[24]  A. Farmer,et al.  Designing and evaluating complex interventions to improve health care , 2007, BMJ : British Medical Journal.

[25]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[26]  R. Lilford,et al.  Evaluating service delivery interventions to enhance patient safety , 2008, BMJ : British Medical Journal.

[27]  A. O’Cathain,et al.  The Quality of Mixed Methods Studies in Health Services Research , 2008, Journal of health services research & policy.

[28]  R J Lilford,et al.  An epistemology of patient safety research: a framework for study design and interpretation. Part 1. Conceptualising and developing interventions , 2008, Quality & Safety in Health Care.

[29]  Martin Pitt,et al.  An analysis of the academic literature on simulation and modelling in health care , 2009, J. Simulation.

[30]  L. Alberto Franco,et al.  Problem structuring methods as intervention tools: Reflections from their use with multi-organisational teams , 2009 .

[31]  H. Yee,et al.  Improving the primary care-specialty care interface: getting from here to there. , 2009, Archives of internal medicine.

[32]  D. Steinberg CART: Classification and Regression Trees , 2009 .

[33]  L. Alberto Franco,et al.  Facilitated modelling in operational research , 2010, Eur. J. Oper. Res..

[34]  Colin Eden,et al.  Strategic Options Development and Analysis , 2010, Systems Approaches to Making Change: A Practical Guide.

[35]  J. Greene Planning under pressure. , 2011, Trustee : the journal for hospital governing boards.

[36]  Fran Ackermann,et al.  Mixing OR methods in practice: Past, present and future directions , 2011, Eur. J. Oper. Res..

[37]  C. Schoen,et al.  New 2011 survey of patients with complex care needs in eleven countries finds that care is often poorly coordinated. , 2011, Health affairs.

[38]  S. Shaw,et al.  What is integrated care ? An overview of integrated care in the NHS Research report , 2011 .

[39]  L. Franco,et al.  Understanding multi-methodology: Evaluating the perceived impact of mixing methods for group budgetary decisions , 2011 .

[40]  P. Williamson,et al.  Using the Delphi Technique to Determine Which Outcomes to Measure in Clinical Trials: Recommendations for the Future Based on a Systematic Review of Existing Studies , 2011, PLoS medicine.

[41]  M. Naylor,et al.  Unintended consequences of steps to cut readmissions and reform payment may threaten care of vulnerable older adults. , 2012, Health affairs.

[42]  H. Ravaghi,et al.  Clinical governance implementation in a selected teaching emergency department: a systems approach , 2012, Implementation Science.

[43]  P. Barach,et al.  Searching for the missing pieces between the hospital and primary care: mapping the patient process during care transitions , 2012, BMJ quality & safety.

[44]  R. Vize Integrated care: a story of hard won success , 2012, BMJ : British Medical Journal.

[45]  M. Dixon-Woods,et al.  Ten challenges in improving quality in healthcare: lessons from the Health Foundation's programme evaluations and relevant literature , 2012, BMJ quality & safety.

[46]  P. Barach,et al.  Stakeholder perspectives on handovers between hospital staff and general practitioners: an evaluation through the microsystems lens , 2012, BMJ quality & safety.

[47]  F. Godlee Integrated care is what we all want , 2012, BMJ : British Medical Journal.

[48]  Peter J. H. Hulshof,et al.  Taxonomic classification of planning decisions in health care: a structured review of the state of the art in OR/MS , 2012 .

[49]  D. Kansagara,et al.  “Did I Do as Best as the System Would Let Me?” Healthcare Professional Views on Hospital to Home Care Transitions , 2012, Journal of General Internal Medicine.

[50]  Katrina M. Romagnoli,et al.  Home-care nurses’ perceptions of unmet information needs and communication difficulties of older patients in the immediate post-hospital discharge period , 2013, BMJ quality & safety.

[51]  G. Hughes Reducing emergency admissions: are we on the right track? , 2013, Emergency Medicine Journal.

[52]  Lene Berge Holm,et al.  Towards a multimethodology in health care – synergies between Soft Systems Methodology and Discrete Event Simulation , 2013 .

[53]  Robert Y. Cavana,et al.  Towards a new framework for evaluating systemic problem structuring methods , 2013, Eur. J. Oper. Res..

[54]  Christos Vasilakis,et al.  A participative and facilitative conceptual modelling framework for discrete event simulation studies in healthcare , 2014, J. Oper. Res. Soc..

[55]  H. Wald,et al.  A Failure to Communicate: A Qualitative Exploration of Care Coordination Between Hospitalists and Primary Care Providers Around Patient Hospitalizations , 2015, Journal of General Internal Medicine.

[56]  K. Radford,et al.  Developing stroke-specific vocational rehabilitation: a soft systems analysis of current service provision , 2013, Disability and rehabilitation.

[57]  K. Brown,et al.  Unexpected deaths and unplanned re-admissions in infants discharged home after cardiac surgery: a systematic review of potential risk factors , 2014, Cardiology in the Young.

[58]  P. Vandenbroeck,et al.  Recommendations for the organization of mental health services for children and adolescents in Belgium: use of the soft systems methodology. , 2014, Health policy.

[59]  Kathy Kotiadis,et al.  PartiSim: A multi-methodology framework to support facilitated simulation modelling in healthcare , 2015, Eur. J. Oper. Res..

[60]  G. Iacobucci,et al.  NHS England announces 29 sites to spearhead integrated care models , 2015, BMJ : British Medical Journal.

[61]  S. Crowe,et al.  Systems modelling and simulation in health service design, delivery and decision making , 2015, BMJ Quality & Safety.

[62]  C. Pagel,et al.  Trends in 30-day mortality rate and case mix for paediatric cardiac surgery in the UK between 2000 and 2010 , 2015, Open Heart.

[63]  S. Humphrey-Murto,et al.  The use of Delphi and Nominal Group Technique in nursing education: A review. , 2016, International journal of nursing studies.

[64]  S. Crowe,et al.  Going home after infant cardiac surgery: a UK qualitative study , 2016, Archives of Disease in Childhood.

[65]  S. Crowe,et al.  Signs of deterioration in infants discharged home following congenital heart surgery in the first year of life: a qualitative study , 2015, Archives of Disease in Childhood.

[66]  N. Richardson Systems Approaches to Managing Change: A Practical Guide , 2016 .

[67]  S. Crowe,et al.  Death and Emergency Readmission of Infants Discharged After Interventions for Congenital Heart Disease: A National Study of 7643 Infants to Inform Service Improvement , 2016, Journal of the American Heart Association.

[68]  S. Crowe,et al.  Identifying improvements to complex pathways: evidence synthesis and stakeholder engagement in infant congenital heart disease , 2016, BMJ Open.

[69]  S. Crowe,et al.  “I was so worried about every drop of milk” – feeding problems at home are a significant concern for parents after major heart surgery in infancy , 2017, Maternal & child nutrition.