Monitoring and Evaluating the Transition of Large-Scale Programs in Global Health

Monitoring and evaluating large-scale global health program transitions can strengthen accountability, facilitate stakeholder engagement, and promote learning about the transition process and how best to manage it. We propose a conceptual framework with 4 main domains relevant to transitions—leadership, financing, programming, and service delivery—along with guiding questions and illustrative indicators to guide users through key aspects of monitoring and evaluating transition. We argue that monitoring and evaluating transitions can bring conceptual clarity to the transition process, provide a mechanism for accountability, facilitate engagement with local stakeholders, and inform the management of transition through learning. Monitoring and evaluating large-scale global health program transitions can strengthen accountability, facilitate stakeholder engagement, and promote learning about the transition process and how best to manage it. We propose a conceptual framework with 4 main domains relevant to transitions—leadership, financing, programming, and service delivery—along with guiding questions and illustrative indicators to guide users through key aspects of monitoring and evaluating transition. We argue that monitoring and evaluating transitions can bring conceptual clarity to the transition process, provide a mechanism for accountability, facilitate engagement with local stakeholders, and inform the management of transition through learning. Purpose: Donors are increasingly interested in the transition and sustainability of global health programs as priorities shift and external funding declines. Systematic and high-quality monitoring and evaluation (M&E) of such processes is rare. We propose a framework and related guiding questions to systematize the M&E of global health program transitions. Methods: We conducted stakeholder interviews, searched the peer-reviewed and gray literature, gathered feedback from key informants, and reflected on author experiences to build a framework on M&E of transition and to develop guiding questions. Findings: The conceptual framework models transition as a process spanning pre-transition and transition itself and extending into sustained services and outcomes. Key transition domains include leadership, financing, programming, and service delivery, and relevant activities that drive the transition in these domains forward include sustaining a supportive policy environment, creating financial sustainability, developing local stakeholder capacity, communicating to all stakeholders, and aligning programs. Ideally transition monitoring would begin prior to transition processes being implemented and continue for some time after transition has been completed. As no set of indicators will be applicable across all types of health program transitions, we instead propose guiding questions and illustrative quantitative and qualitative indicators to be considered and adapted based on the transition domains identified as most important to the particular health program transition. The M&E of transition faces new and unique challenges, requiring measuring constructs to which evaluators may not be accustomed. Many domains hinge on measuring “intangibles” such as the management of relationships. Monitoring these constructs may require a compromise between rigorous data collection and the involvement of key stakeholders. Conclusion: Monitoring and evaluating transitions in global health programs can bring conceptual clarity to the transition process, provide a mechanism for accountability, facilitate engagement with local stakeholders, and inform the management of transition through learning. Further investment and stronger methodological work are needed.

[1]  A Gardner,et al.  What we know about exit strategies. Practical guidance for developing exit strategies in the field. , 2005 .

[2]  M. Dybul,et al.  The United States President's Emergency Plan for AIDS Relief: A Story of Partnerships and Smart Investments to Turn the Tide of the Global AIDS Pandemic , 2012, Journal of acquired immune deficiency syndromes.

[3]  J. Goldberg,et al.  Country ownership and capacity building: the next buzzwords in health systems strengthening or a truly new approach to development? , 2012, BMC Public Health.

[4]  Taghreed Adam,et al.  Systems thinking for health systems strengthening. , 2009 .

[5]  Angela K. Shen,et al.  Applying lessons learned from the USAID family planning graduation experience to the GAVI graduation process. , 2015, Health policy and planning.

[6]  S. Ozawa,et al.  Sustainability of donor programs: evaluating and informing the transition of a large HIV prevention program in India to local ownership , 2011, Global health action.

[7]  Christopher Potter,et al.  Systemic capacity building: a hierarchy of needs. , 2004, Health policy and planning.

[8]  Jeffrey R. Harris,et al.  Framework for program evaluation in public health. , 1999, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[9]  T. Johnston Supporting a healthy transition : lessons from early World Bank experience in Eastern Europe , 2002 .

[10]  K. Buse,et al.  AIDS: Ushering in a new era of shared responsibility for global health , 2012, Globalization and Health.

[11]  S. Arscott-Mills,et al.  Measuring sustainability as a programming tool for health sector investments: report from a pilot sustainability assessment in five Nepalese health districts. , 2009, The International journal of health planning and management.

[12]  Ashley M. Fox,et al.  Measuring political commitment and opportunities to advance food and nutrition security: piloting a rapid assessment tool. , 2015, Health policy and planning.

[13]  Sara Bennett,et al.  Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience. , 2015, Evaluation and program planning.

[14]  L. Gilson,et al.  The interface between research and policy: experience from South Africa. , 2008, Social science & medicine.

[15]  Sara Bennett,et al.  Management practices to support donor transition: lessons from Avahan, the India AIDS Initiative , 2015, BMC Health Services Research.

[16]  H. Saxenian,et al.  Overcoming challenges to sustainable immunization financing: early experiences from GAVI graduating countries , 2014, Health policy and planning.

[17]  Knowlton W. Johnson,et al.  Building capacity and sustainable prevention innovations: a sustainability planning model , 2004 .

[18]  Bobby Milstein,et al.  Framework for program evaluation in public health , 1999 .

[19]  T. Bossert Can they get along without us? Sustainability of donor-supported health projects in Central America and Africa. , 1990, Social science & medicine.

[20]  Sara Bennett,et al.  How the Avahan HIV prevention program transitioned from the Gates Foundation to the government of India. , 2013, Health affairs.

[21]  P. Lawton,et al.  Sustainability science: an integrated approach for health-programme planning , 2008, The Lancet.