A Systems Approach to Evaluate One Health Initiatives

Challenges calling for integrated approaches to health, such as the One Health (OH) approach, typically arise from the intertwined spheres of humans, animals, and ecosystems constituting their environment. Initiatives addressing such wicked problems commonly consist of complex structures and dynamics. As a result of the EU COST Action (TD 1404) “Network for Evaluation of One Health” (NEOH), we propose an evaluation framework anchored in systems theory to address the intrinsic complexity of OH initiatives and regard them as subsystems of the context within which they operate. Typically, they intend to influence a system with a view to improve human, animal, and environmental health. The NEOH evaluation framework consists of four overarching elements, namely: (1) the definition of the initiative and its context, (2) the description of the theory of change with an assessment of expected and unexpected outcomes, (3) the process evaluation of operational and supporting infrastructures (the “OH-ness”), and (4) an assessment of the association(s) between the process evaluation and the outcomes produced. It relies on a mixed methods approach by combining a descriptive and qualitative assessment with a semi-quantitative scoring for the evaluation of the degree and structural balance of “OH-ness” (summarised in an OH-index and OH-ratio, respectively) and conventional metrics for different outcomes in a multi-criteria-decision-analysis. Here, we focus on the methodology for Elements (1) and (3) including ready-to-use Microsoft Excel spreadsheets for the assessment of the “OH-ness”. We also provide an overview of Element (2), and refer to the NEOH handbook for further details, also regarding Element (4) (http://neoh.onehealthglobal.net). The presented approach helps researchers, practitioners, and evaluators to conceptualise and conduct evaluations of integrated approaches to health and facilitates comparison and learning across different OH activities thereby facilitating decisions on resource allocation. The application of the framework has been described in eight case studies in the same Frontiers research topic and provides first data on OH-index and OH-ratio, which is an important step towards their validation and the creation of a dataset for future benchmarking, and to demonstrate under which circumstances OH initiatives provide added value compared to disciplinary or conventional health initiatives.

[1]  Wendy W. Chapman,et al.  Public sharing of research datasets: A pilot study of associations , 2010, J. Informetrics.

[2]  S. Nikitina Pathways of Interdisciplinary Cognition , 2005 .

[3]  M. Tanner,et al.  One health : the theory and practice of integrated health approaches , 2015 .

[4]  Greg L. Stewart,et al.  Sharing is caring: Toward a model of proactive caring through shared leadership , 2015 .

[5]  V. Ilieski,et al.  Positioning Animal Welfare in the One Health Concept through Evaluation of an Animal Welfare Center in Skopje, Macedonia , 2018, Front. Vet. Sci..

[6]  T. Adam,et al.  Constraints to applying systems thinking concepts in health systems: A regional perspective from surveying stakeholders in Eastern Mediterranean countries. , 2014, International journal of health policy and management.

[7]  David B. Knight,et al.  AC 2012-3116: DEVELOPING A MEASURE OF INTERDISCIPLINARY COMPETENCE FOR ENGINEERS , 2012 .

[8]  D. Kwiatkowski,et al.  Data sharing and intellectual property in a genomic epidemiology network: policies for large-scale research collaboration. , 2006, Bulletin of the World Health Organization.

[9]  Henrik Lerner,et al.  The concept of health in One Health and some practical implications for research and education: what is One Health? , 2015, Infection ecology & epidemiology.

[10]  Heidi Ledford How to solve the world's biggest problems , 2015, Nature.

[11]  Petra Wächter Thinking in systems – a primer , 2011 .

[12]  R. Kock,et al.  Toward Proof of Concept of a One Health Approach to Disease Prediction and Control , 2013, Emerging infectious diseases.

[13]  Belet Weyne Food and Agriculture Organization , 1949, International Organization.

[14]  D. Grindlay,et al.  Quantitative Outcomes of a One Health approach to Study Global Health Challenges , 2018, EcoHealth.

[15]  M. Clark,et al.  Evaluating transdisciplinary science. , 2003, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[16]  Pim Martens,et al.  Transdisciplinary research in sustainability science: practice, principles, and challenges , 2012, Sustainability Science.

[17]  Heather A. Piwowar,et al.  Towards a Data Sharing Culture: Recommendations for Leadership from Academic Health Centers , 2008, PLoS medicine.

[18]  D. Pfeiffer From risk analysis to risk governance - Adapting to an ever more complex future. , 2014, Veterinaria italiana.

[19]  G. Yukl,et al.  Effective Leadership Behavior: What We Know and What Questions Need More Attention , 2012 .

[20]  C. Tenopir,et al.  Data Sharing by Scientists: Practices and Perceptions , 2011, PloS one.

[21]  C. Pohl,et al.  Handbook of transdisciplinary research , 2008 .

[22]  Jenny Fry,et al.  Scholarship in the Digital Age: Information, Infrastructure, and the Internet , 2010, J. Assoc. Inf. Sci. Technol..

[23]  David A. Garvin,et al.  Learning in Action: A Guide to Putting the Learning Organization to Work , 2000 .

[24]  Subhrendu K. Pattanayak,et al.  Safeguarding human health in the Anthropocene epoch: report of The Rockefeller Foundation–Lancet Commission on planetary health , 2015, The Lancet.

[25]  Marleen Huysman,et al.  Balancing Biases, A Critical Review of the Literature on Organizational Learning , 1998 .

[26]  J. Rushton,et al.  A review of the metrics for One Health benefits. , 2014, Revue scientifique et technique.

[27]  Kate E. Jones,et al.  Global trends in emerging infectious diseases , 2008, Nature.

[28]  W. Trochim,et al.  Practical challenges of systems thinking and modeling in public health. , 2006, American journal of public health.

[29]  E. Karimuribo,et al.  A One Health Evaluation of the Southern African Centre for Infectious Disease Surveillance , 2018, Front. Vet. Sci..

[30]  A. Caress,et al.  Shared governance and shared leadership: meeting the challenges of implementation. , 2005, Journal of nursing management.

[31]  Arnim Wiek,et al.  Measuring societal effects of transdisciplinary research projects: design and application of an evaluation method. , 2007, Evaluation and program planning.

[32]  L. Gunderson,et al.  Adaptive governance of riverine and wetland ecosystem goods and services. , 2016, Journal of environmental management.

[33]  Robert H. Salerno,et al.  Evaluating one health: Are we demonstrating effectiveness? , 2016, One health.

[34]  E. Schelling,et al.  Transdisciplinary research and one health , 2015 .

[35]  D. Canyon Insights in public health: systems thinking: basic constructs, application challenges, misuse in health, and how public health leaders can pave the way forward. , 2013, Hawai'i journal of medicine & public health : a journal of Asia Pacific Medicine & Public Health.

[36]  Marcus Thygeson,et al.  Adaptive leadership and the practice of medicine: a complexity-based approach to reframing the doctor-patient relationship. , 2010, Journal of evaluation in clinical practice.

[37]  William B. Karesh,et al.  Connecting global priorities: biodiversity and human health: a state of knowledge review. , 2015 .

[38]  George Sugihara,et al.  A General Framework for Analyzing Sustainability of Social-Ecological Systems , 2009 .

[39]  Joan Giesecke,et al.  Transitioning to the Learning Organization , 2004, Libr. Trends.

[41]  David Rooke,et al.  Seven transformations of leadership , 2005 .

[42]  A. O’Cathain,et al.  Process evaluation of complex interventions: Medical Research Council guidance , 2015, BMJ : British Medical Journal.

[43]  Elliot Stern,et al.  Introduction – Towards Systemic Approaches to Evaluation and Impact , 2015 .

[44]  Değerlendirme ve Sonuç,et al.  Glossary of Key Terms in Evaluation and Results-based Management in Sustainable Development (Second Edition) , 2023 .

[45]  Lauren Keller Johnson,et al.  Systems Thinking Basics: From Concepts to Causal Loops , 1997 .

[46]  N. Gould Becoming a learning organisation: A social work example , 2000 .

[47]  Eric W. K. Tsang Organizational Learning and the Learning Organization: A Dichotomy Between Descriptive and Prescriptive Research , 1997 .

[48]  R. Norgaard,et al.  Practicing Interdisciplinarity , 2005 .

[49]  A. Booth,et al.  Ten principles of good interdisciplinary team work , 2013, Human Resources for Health.

[50]  Heather A. Piwowar,et al.  Sharing Detailed Research Data Is Associated with Increased Citation Rate , 2007, PloS one.

[51]  Philipp Nadel,et al.  Hierarchy In Natural And Social Sciences , 2016 .

[52]  A. Nelson Bio Science , 2008, Social studies of science.

[53]  L. Nielsen,et al.  Use of information on disease diagnoses from databases for animal health economic, welfare and food safety purposes: strengths and limitations of recordings , 2011, Acta veterinaria Scandinavica.

[54]  Mijalce Santa,et al.  Learning organisation review – a “good” theory perspective , 2015 .

[55]  Brian D. Fath,et al.  Navigating the adaptive cycle: an approach to managing the resilience of social systems , 2015 .

[56]  J. Ruiz Moreno [Organizational learning]. , 2001, Revista de enfermeria.

[57]  A. Lindberg,et al.  A Blueprint to Evaluate One Health , 2017, Front. Public Health.

[58]  Ralph F. Catalanello,et al.  Strategic Readiness: The Making of the Learning Organization , 1994 .

[59]  Jeneen R. Garcia,et al.  Going Beyond Mixed Methods to Mixed Approaches: A Systems Perspective for Asking the Right Questions , 2015 .

[60]  Mijalche Santa,et al.  Framework For Multivariate Continuous Transformation Towards Learning Organization. (Un Cadre de Référence pour la Transformation Continue Multi-facettes vers une Organisation Apprenante) , 2014 .

[61]  M. Tanner,et al.  From “one medicine” to “one health” and systemic approaches to health and well-being , 2011, Preventive veterinary medicine.

[62]  William T. Scherer,et al.  Quantifying the quality of a systems approach , 2015, 2015 Annual IEEE Systems Conference (SysCon) Proceedings.

[63]  L. Tomassone,et al.  The Degree of One Health Implementation in the West Nile Virus Integrated Surveillance in Northern Italy, 2016 , 2017, Front. Public Health.

[64]  Chris Mowles,et al.  Complex, but not quite complex enough: The turn to the complexity sciences in evaluation scholarship , 2014 .

[65]  Peter Fantke,et al.  Framework to Define Structure and Boundaries of Complex Health Intervention Systems: The ALERT Project , 2017, Front. Public Health.

[66]  J. Neufeld,et al.  The State of Food and Agriculture , 1970 .

[67]  In praise of soft science , 2005, Nature.

[68]  S. Savić,et al.  Control of Cattle Ticks and Tick-Borne Diseases by Acaricide in Southern Province of Zambia: A Retrospective Evaluation of Animal Health Measures According to Current One Health Concepts , 2018, Front. Public Health.

[69]  P. Byass Systems thinking for health systems strengthening , 2011 .

[70]  William T. Scherer,et al.  Systems Thinking About Systems Thinking A Proposal for a Common Language , 2015, IEEE Systems Journal.

[71]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[72]  Anthony J. DiBella,et al.  Sculpting the learning organization: Lessons in the art and science of systemic change, by Karen E. Watkins and Victoria J. Marsick. (1993). San Francisco: Jossey-Bass. 298 pp., $29.95. , 1995 .