Quantitatively evaluating the cross-sectoral and One Health impact of interventions: A scoping review and case study of antimicrobial resistance

Background Current frameworks evaluating One Health (OH) interventions focus on intervention-design and -implementation. Cross-sectoral impact evaluations are needed to more effectively tackle OH-issues, such as antimicrobial resistance (AMR). We aimed to describe quantitative evaluation methods for interventions related to OH and cross-sectoral issues, to propose an explicit approach for evaluating such interventions, and to apply this approach to AMR. Methods A scoping review was performed using WebofScience, EconLit, PubMed and gray literature. Quantitative evaluations of interventions that had an impact across two or more of the human, animal and environment sectors were included. Information on the interventions, methods and outcome measures found was narratively summarised. The information from this review informed the construction of a new approach to OH-related intervention evaluation, which then was applied to the field of AMR. Results The review included 90 studies: 73 individual evaluations (from 72 papers) and 18 reviews, with a range of statistical modelling (n = 13 studies), mathematical modelling (n = 53) and index-creation/preference-ranking (n = 14) methods discussed. The literature highlighted the need to (I) establish stakeholder objectives, (II) establish quantifiable outcomes that feed into those objectives, (III) establish agents and compartments that affect these outcomes and (IV) select appropriate methods (described in this review) accordingly. Based on this, an evaluation model for AMR was conceptualised; a decision-tree of intervention options, a compartmental-microeconomic model across sectors and a general-equilibrium (macroeconomic) model are linked. The outcomes of this multi-level model (including cost-utility and Gross Domestic Product impact) can then feed into multi-criteria-decision analyses that weigh respective impact estimates alongside other chosen outcome estimates (for example equity or uncertainty). Conclusion In conclusion, stakeholder objectives are key in establishing which evaluation methods (and associated outcome measures) should be used for OH-related interventions. The stated multi-level approach also allows for sub-systems to be modelled in succession, where resources are constrained.

[1]  J. Coast.  Maximisation in extra-welfarism: A critique of the current position in health economics. , 2009, Social science & medicine.

[2]  J. Torgal,et al.  One Health-ness Evaluation of Cysticercosis Surveillance Design in Portugal , 2018, Front. Public Health.

[3]  Signatory Countries Aconf.  ECONOMIC COMMISSION FOR LATIN AMERICA AND THE CARIBBEAN , 2010 .

[4]  C. Mcnulty,et al.  English surveillance programme for antimicrobial utilisation and resistance (ESPAUR) 2010 to 2014: report 2015 , 2015 .

[5]  Arthur H. Essenfelder,et al.  Rationalizing Systems Analysis for the Evaluation of Adaptation Strategies in Complex Human‐Water Systems , 2018, Earth's Future.

[6]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[7]  M. Ittersum,et al.  On the development and use of farm models for policy impact assessment in the European Union – A review , 2018 .

[8]  Karl Claxton,et al.  Country-Level Cost-Effectiveness Thresholds: Initial Estimates and the Need for Further Research , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[9]  W. Mcnab,et al.  One-Health Simulation Modelling: A Case Study of Influenza Spread between Human and Swine Populations using NAADSM. , 2016, Transboundary and emerging diseases.

[10]  H. Graham,et al.  Economic Evaluations of the Health Impacts of Weather-Related Extreme Events: A Scoping Review , 2016, International journal of environmental research and public health.

[11]  B. Armstrong,et al.  Public health benefits of strategies to reduce greenhouse-gas emissions: low-carbon electricity generation , 2009, The Lancet.

[12]  M. Jit,et al.  Discounting in the evaluation of the cost-effectiveness of a vaccination programme: A critical review. , 2015, Vaccine.

[13]  T. Smieszek,et al.  Selection and co-selection of antibiotic resistances among Escherichia coli by antibiotic use in primary care: An ecological analysis , 2019, bioRxiv.

[14]  A. Goria,et al.  Economic Evaluation of Climate Change Impacts and Adaptation in Italy , 2004 .

[15]  G. Dosi,et al.  Agent-based modeling of climate policy : An introduction to the ENGAGE multi-level model framework q , 2022 .

[16]  L. Galvão,et al.  Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews. , 2016, Revista panamericana de salud publica = Pan American journal of public health.

[17]  V. Ilieski,et al.  Positioning Animal Welfare in the One Health Concept through Evaluation of an Animal Welfare Center in Skopje, Macedonia , 2018, Front. Vet. Sci..

[18]  Selection and co-selection of antibiotic resistances among Escherichia coli by antibiotic use in primary care: an ecological analysis , 2019 .

[19]  Anping Chen,et al.  The regional economic effects of a reduction in carbon emissions and an evaluation of offsetting policies in China , 2014 .

[20]  R. Goswami,et al.  Techno-economic and environmental assessment of different rice-based cropping systems in an inceptisol of West Bengal, India , 2018, Journal of Cleaner Production.

[21]  R. Evans.  European Centre for Disease Prevention and Control. , 2014, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[22]  A. Sagan,et al.  Averting the AMR crisis: What are the avenues for policy action for countries in Europe? [Internet] , 2019 .

[23]  Jean-Philippe Waaub,et al.  Multi-criteria decision analysis as an innovative approach to managing zoonoses: results from a study on Lyme disease in Canada , 2013, BMC Public Health.

[24]  M. Krol.  Productivity Costs in Economic Evaluations , 2012 .

[25]  Kimberly J. Quesnel,et al.  A case-study based framework for assessing the multi-sector performance of green infrastructure. , 2018, Journal of environmental management.

[26]  G. Carrin,et al.  Human health benefits from livestock vaccination for brucellosis: case study. , 2003, Bulletin of the World Health Organization.

[27]  S. Buttigieg,et al.  Brucellosis Control in Malta and Serbia: A One Health Evaluation , 2018, Front. Vet. Sci..

[28]  Miroslav Radeski,et al.  A Systems Approach to Evaluate One Health Initiatives , 2018, Front. Vet. Sci..

[29]  Mark Z. Jacobson,et al.  Examining the feasibility of converting New York State's all-purpose energy infrastructure to one using wind, water, and sunlight , 2013 .

[30]  Andrea M. Bassi,et al.  Quantifying cross-sectoral impacts of investments in climate change mitigation in Ecuador , 2009 .

[31]  J. Rushton,et al.  A One Health Evaluation of the University of Copenhagen Research Centre for Control of Antibiotic Resistance , 2018, Front. Vet. Sci..

[32]  S. Golder,et al.  Good Practice Guidelines for Decision-Analytic Modelling in Health Technology Assessment , 2012, PharmacoEconomics.

[33]  Michael Schwarz,et al.  American Economic Association , 1891 .

[34]  A. Galvani,et al.  One Health approach to cost-effective rabies control in India , 2016, Proceedings of the National Academy of Sciences of the United States of America.

[35]  A. Walker,et al.  The challenge of antimicrobial resistance: What economics can contribute , 2019, Science.

[36]  V. Venkataramanan,et al.  Rabies control initiative in Tamil Nadu, India: A test case for the 'One Health' approach. , 2011, International health.

[37]  Heather Ganshorn,et al.  Restricting the use of antibiotics in food-producing animals and its associations with antibiotic resistance in food-producing animals and human beings: a systematic review and meta-analysis , 2017, The Lancet. Planetary health.

[38]  Christian Lutz,et al.  Economic Evaluation of Climate Protection Measures in Germany , 2014 .

[39]  Mark E. Borsuk,et al.  Agent-based modeling of climate policy: An introduction to the ENGAGE multi-level model framework , 2013, Environ. Model. Softw..

[40]  Maria Holmberg,et al.  Integrated approaches to health , 2018 .

[41]  G. Hutton.  The economics of health and climate change: key evidence for decision making , 2011, Globalization and health.

[42]  Marc Mendelson,et al.  The World Health Organization Global Action Plan for antimicrobial resistance. , 2015, South African medical journal = Suid-Afrikaanse tydskrif vir geneeskunde.

[43]  Sergio L. Schmukler,et al.  Emerging Market Instability : Do Sovereign Ratings Affect Country Risk and Stock Returns ? , 1997 .

[44]  E. Karimuribo,et al.  A One Health Evaluation of the Southern African Centre for Infectious Disease Surveillance , 2018, Front. Vet. Sci..

[45]  R. Atun,et al.  Estimating the burden of antimicrobial resistance: a systematic literature review , 2018, Antimicrobial Resistance & Infection Control.

[46]  S. Hay,et al.  Antibiotic resistance is the quintessential One Health issue , 2016, Transactions of the Royal Society of Tropical Medicine and Hygiene.

[47]  Phoebe Koundouri,et al.  Environmental Effects on Public Health: An Economic Perspective , 2009, International journal of environmental research and public health.

[48]  E. Lingohr,et al.  An Assessment of Antimicrobial Resistant Disease Threats in Canada , 2015, PloS one.

[49]  L. Tomassone,et al.  The Degree of One Health Implementation in the West Nile Virus Integrated Surveillance in Northern Italy, 2016 , 2017, Front. Public Health.

[50]  G. Richardson,et al.  Economic Evaluation of Environmental Interventions: Reflections on Methodological Challenges and Developments , 2018, International journal of environmental research and public health.

[51]  J. Rushton,et al.  Economics of zoonoses surveillance in a ‘One Health’ context: an assessment of Campylobacter surveillance in Switzerland , 2017, Epidemiology and Infection.

[52]  Robert H. Salerno,et al.  Evaluating one health: Are we demonstrating effectiveness? , 2016, One health.

[53]  J. Coast,et al.  Assessing the macroeconomic impact of a healthcare problem: the application of computable general equilibrium analysis to antimicrobial resistance. , 2005, Journal of health economics.

[54]  David Moher,et al.  Consolidated Health Economic Evaluation Reporting Standards (CHEERS)--explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[55]  M. Hulscher,et al.  Is antimicrobial stewardship cost-effective? A narrative review of the evidence. , 2017, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[56]  S. Hellweg,et al.  Pay the farmer, or buy the land?—Cost-effectiveness of payments for ecosystem services versus land purchases or easements in Central Kenya , 2016 .

[57]  Shu-Yuan Pan,et al.  Socioeconomic costs of replacing nuclear power with fossil and renewable energy in Taiwan , 2016 .

[58]  A. Tvarijonaviciute,et al.  Application of the NEOH Framework for Self-Evaluation of One Health Elements of a Case-Study on Obesity in European Dogs and Dog-Owners , 2018, Front. Vet. Sci..

[59]  J. McGowan,et al.  PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation , 2018, Annals of Internal Medicine.

[60]  S. Savić,et al.  Control of Cattle Ticks and Tick-Borne Diseases by Acaricide in Southern Province of Zambia: A Retrospective Evaluation of Animal Health Measures According to Current One Health Concepts , 2018, Front. Public Health.

[61]  J. Coast,et al.  Strategies to contain the emergence of antimicrobial resistance: a systematic review of effectiveness and cost-effectiveness , 2002, Journal of health services research & policy.

[62]  E. Hiby,et al.  A One Health Framework for the Evaluation of Rabies Control Programmes: A Case Study from Colombo City, Sri Lanka , 2014, PLoS neglected tropical diseases.

[63]  D. Grindlay,et al.  Quantitative Outcomes of a One Health approach to Study Global Health Challenges , 2018, EcoHealth.

[64]  Christophe Le Page,et al.  Tools and methods in participatory modeling: Selecting the right tool for the job , 2018, Environ. Model. Softw..

[65]  Raheelah Ahmad,et al.  System dynamics modelling to formulate policy interventions to optimise antibiotic prescribing in hospitals , 2020, J. Oper. Res. Soc..

[66]  Henrik Lerner,et al.  The concept of health in One Health and some practical implications for research and education: what is One Health? , 2015, Infection ecology & epidemiology.

[67]  Amy C. Chiang,et al.  Emissions reduction benefits of siting an offshore wind farm: A temporal and spatial analysis of Lake Michigan , 2016 .

[68]  J. Martínez-Paz,et al.  What weight should be assigned to future environmental impacts? A probabilistic cost benefit analysis using recent advances on discounting. , 2011, The Science of the total environment.

[69]  H. Lofgren,et al.  Assessing the global poverty effects of antimicrobial resistance , 2018, World Development.

[70]  J. Coast,et al.  A macroeconomic approach to evaluating policies to contain antimicrobial resistance , 2006, Applied health economics and health policy.

[71]  Colleen McGinn.  Monitoring & evaluation for climate change adaptation and resilience : A synthesis of tools , frameworks and approaches , 2014 .

[72]  E. Fèvre,et al.  Are Food Animals Responsible for Transfer of Antimicrobial-Resistant Escherichia coli or Their Resistance Determinants to Human Populations? A Systematic Review , 2018, Foodborne pathogens and disease.

[73]  A. Pollock,et al.  How to do a systematic review , 2018, International journal of stroke : official journal of the International Stroke Society.

[74]  V. Costantini,et al.  Impact and distribution of climatic damages: a methodological proposal with a dynamic CGE model applied to global climate negotiations , 2018, Economia Politica.

[75]  B. Martínez-López,et al.  A community-based One Health education program for disease risk mitigation at the human-animal interface , 2017, One health.