Innovation in Evaluating the Impact of Integrated Service-Delivery: The Integra Indexes of HIV and Reproductive Health Integration

Background The body of knowledge on evaluating complex interventions for integrated healthcare lacks both common definitions of ‘integrated service delivery’ and standard measures of impact. Using multiple data sources in combination with statistical modelling the aim of this study is to develop a measure of HIV-reproductive health (HIV-RH) service integration that can be used to assess the degree of service integration, and the degree to which integration may have health benefits to clients, or reduce service costs. Methods and Findings Data were drawn from the Integra Initiative’s client flow (8,263 clients in Swaziland and 25,539 in Kenya) and costing tools implemented between 2008–2012 in 40 clinics providing RH services in Kenya and Swaziland. We used latent variable measurement models to derive dimensions of HIV-RH integration using these data, which quantified the extent and type of integration between HIV and RH services in Kenya and Swaziland. The modelling produced two clear and uncorrelated dimensions of integration at facility level leading to the development of two sub-indexes: a Structural Integration Index (integrated physical and human resource infrastructure) and a Functional Integration Index (integrated delivery of services to clients). The findings highlight the importance of multi-dimensional assessments of integration, suggesting that structural integration is not sufficient to achieve the integrated delivery of care to clients—i.e. “functional integration”. Conclusions These Indexes are an important methodological contribution for evaluating complex multi-service interventions. They help address the need to broaden traditional evaluations of integrated HIV-RH care through the incorporation of a functional integration measure, to avoid misleading conclusions on its ‘impact’ on health outcomes. This is particularly important for decision-makers seeking to promote integration in resource constrained environments.

[1]  S. Mayhew,et al.  Does service integration improve technical quality of care in low-resource settings? An evaluation of a model integrating HIV care into family planning services in Kenya , 2017, Health policy and planning.

[2]  S. Shade,et al.  Implementation and Operational Research: Effects of Antenatal Care and HIV Treatment Integration on Elements of the PMTCT Cascade: Results From the SHAIP Cluster-Randomized Controlled Trial in Kenya. , 2015, Journal of acquired immune deficiency syndromes.

[3]  C. Watts,et al.  The Costs of Delivering Integrated HIV and Sexual Reproductive Health Services in Limited Resource Settings , 2015, PloS one.

[4]  L. Gilson,et al.  Exploring the influence of trust relationships on motivation in the health sector: a systematic review , 2015, Human Resources for Health.

[5]  C. Watts,et al.  The impact of HIV/SRH service integration on workload: analysis from the Integra Initiative in two African settings , 2014, Human Resources for Health.

[6]  A. George,et al.  People-centred science: strengthening the practice of health policy and systems research , 2014, Health Research Policy and Systems.

[7]  Weiwei Zhou,et al.  Integration of HIV and maternal healthcare in a high HIV-prevalence setting: analysis of client flow data over time in Swaziland , 2014, BMJ Open.

[8]  S. Shade,et al.  Integration of family planning services into HIV care and treatment in Kenya: a cluster-randomized trial , 2013, AIDS.

[9]  E. Wouters,et al.  Integrating HIV Care into Primary Care Services: Quantifying Progress of an Intervention in South Africa , 2013, PloS one.

[10]  C. Watts,et al.  Study protocol for the Integra Initiative to assess the benefits and costs of integrating sexual and reproductive health and HIV services in Kenya and Swaziland , 2012, BMC Public Health.

[11]  Christin Juhnke,et al.  Clinical and service integration. The route to improved outcomes , 2012, International Journal of Integrated Care.

[12]  A. Vassall,et al.  Costs and efficiency of integrating HIV/AIDS services with other health services: a systematic review of evidence and experience , 2011, Sexually Transmitted Infections.

[13]  P. Garner,et al.  Strategies for integrating primary health services in low- and middle-income countries at the point of delivery. , 2011, The Cochrane database of systematic reviews.

[14]  Max O Bachmann,et al.  Outreach education for integration of HIV/AIDS care, antiretroviral treatment, and tuberculosis care in primary care clinics in South Africa: PALSA PLUS pragmatic cluster randomised trial , 2011, BMJ : British Medical Journal.

[15]  R. Atun,et al.  Integration of targeted health interventions into health systems: a conceptual framework for analysis. , 2010, Health policy and planning.

[16]  M. Mbizvo,et al.  Linking sexual and reproductive health and HIV interventions: a systematic review , 2010, Journal of the International AIDS Society.

[17]  S. Mayhew,et al.  Integration of STI and HIV prevention, care, and treatment into family planning services: a review of the literature. , 2009, Studies in family planning.

[18]  J Thomas,et al.  Alternatives to randomisation in the evaluation of public-health interventions: statistical analysis and causal inference , 2009, Journal of Epidemiology & Community Health.

[19]  E. Yano,et al.  The Impact of Integrated HIV Care on Patient Health Outcomes , 2009, Medical care.

[20]  J. Liljestrand,et al.  Integrating health interventions for women, newborn babies, and children: a framework for action , 2008, The Lancet.

[21]  Sophia Rabe-Hesketh,et al.  Classical latent variable models for medical research , 2008, Statistical methods in medical research.

[22]  H. Bradley,et al.  HIV and family planning service integration and voluntary HIV counselling and testing client composition in Ethiopia , 2008, AIDS care.

[23]  P. Maharaj,et al.  Integration of sexual and reproductive health services in KwaZulu-Natal, South Africa. , 2005, Health policy and planning.

[24]  N. Adler,et al.  Service integration and teen friendliness in practice: a program assessment of sexual and reproductive health services for adolescents. , 2005, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[25]  Suzanne D. Pawlowski,et al.  The Delphi method as a research tool: an example, design considerations and applications , 2004, Inf. Manag..

[26]  J. Bryce,et al.  Evidence-based public health: moving beyond randomized trials. , 2004, American journal of public health.

[27]  K. Hardee,et al.  When Does It Make Sense to Consider Integrating STI And HIV Services with Family Planning Services , 2002 .

[28]  F. Hasson,et al.  Research guidelines for the Delphi survey technique. , 2000, Journal of advanced nursing.

[29]  Hugh McKenna,et al.  Research guidelines for the Delphi survey technique: Delphi survey technique , 2000 .

[30]  C. Victora,et al.  Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. , 1999, International journal of epidemiology.

[31]  Eugene G. Johnson,et al.  Scaling Procedures in NAEP , 1992 .

[32]  A. Vassall,et al.  ' s response to reviews Title : How does HIV / SRH service integration impact workload ? A descriptive analysis from the Integra Initiative in two African settings , 2014 .

[33]  R. Atun,et al.  A systematic review of the evidence on integration of targeted health interventions into health systems. , 2010, Health policy and planning.

[34]  C. Ham,et al.  Clinical and service integration The route to improved outcomes , 2010 .

[35]  R. Darlington,et al.  Factor Analysis , 2008 .

[36]  I. Askew.  Achieving synergies in prevention through linking sexual and reproductive health and HIV services , 2007 .

[37]  B. Criel,et al.  Integration of vertical programmes in multi-function health services , 1997 .