Validation approaches of an expert-based Bayesian Belief Network in Northern Ghana, West Africa

Abstract Model validation is a precondition for credibility and acceptance of a model. However, it appears that there is no scientific standard for validation of Bayesian Belief Networks (BBNs). In this paper, we present a novel combination of BBN validation approaches. A set of qualitative and quantitative validation approaches for the BBN structure, the Conditional Probability Tables and the BBN output is presented and discussed. The validation approaches were tested for a BBN on food provision under land use and land cover changes and different weather scenarios in rural northern Ghana. Experts played an important role in developing and validating the BBN due to data scarcity. Furthermore, selected nodes and the BBN output were compared to existing data. A sensitivity analysis was conducted. Validation approaches show that structural model uncertainties are still high and reliability of input data is low. However, the extreme-condition test shows that the BBN works according to the assumed system understanding that food provision decreases under floods, droughts, land pressure and poverty. Therefore, the BBN can provide general trends for output nodes but lacks reliability if detailed results of single system components are required.

[1]  Anders L. Madsen,et al.  Probabilistic Networks - An Introduction to Bayesian Networks and Influence Diagrams , 2005 .

[2]  David B. Lindenmayer,et al.  Assessing spatial PVA models of arboreal marsupials using significance tests and Bayesian statistics , 2001 .

[3]  F. Ayala,et al.  Complexity in Ecology and Conservation: Mathematical, Statistical, and Computational Challenges , 2005 .

[4]  Kevin B. Korb,et al.  Parameterisation and evaluation of a Bayesian network for use in an ecological risk assessment , 2007, Environ. Model. Softw..

[5]  Niels Peek,et al.  Using sensitivity analysis for efficient quantification of a belief network , 1999, Artif. Intell. Medicine.

[6]  G. Villamor,et al.  Examining Agricultural Land-Use/Cover Change Options in Rural Northern Ghana: A Participatory Scenario Exploration Exercise Approach , 2014 .

[7]  A. Chapoto,et al.  Fertilizer Intensification and Soil Fertility Impact on Maize Yield Response in Northern Ghana , 2015 .

[8]  Colin Eden,et al.  Cognitive mapping and problem structuring for system dynamics model building , 1994 .

[9]  Edward J. Rykiel,et al.  Testing ecological models: the meaning of validation , 1996 .

[10]  P. Drechsel,et al.  Farmers' perceptions and management of soil organic matter – a case study from West Africa , 2001, Nutrient Cycling in Agroecosystems.

[11]  Jan Polcher,et al.  Characterization of the rainy season in Burkina Faso and it’s representation by regional climate models , 2012, Climate Dynamics.

[12]  S. Yearley Making systematic sense of public discontents with expert knowledge: two analytical approaches and a case study , 2000 .

[13]  E. Banks Creating a knowledge culture , 1999 .

[14]  Willem-Paul Brinkman Design of a Questionnaire Instrument , 2009 .

[15]  Helen M. Regan,et al.  A TAXONOMY AND TREATMENT OF UNCERTAINTY FOR ECOLOGY AND CONSERVATION BIOLOGY , 2002 .

[16]  C. Fürst,et al.  Assessing driving forces of land use and land cover change by a mixed-method approach in north-eastern Ghana, West Africa. , 2017, Journal of environmental management.

[17]  Frederick Ato Armah,et al.  Trends in Agriculturally-Relevant Rainfall Characteristics for Small-Scale Agriculture in Northern Ghana , 2010 .

[18]  Serena H. Chen,et al.  Good practice in Bayesian network modelling , 2012, Environ. Model. Softw..

[19]  C. Caminade,et al.  ENVIRONMENTAL VARIABILITY AND VULNERABLE LIVELIHOODS: MINIMISING RISKS AND OPTIMISING OPPORTUNITIES FOR POVERTY ALLEVIATION , 2009 .

[20]  B. Marcot,et al.  Guidelines for developing and updating Bayesian belief networks applied to ecological modeling and conservation , 2006 .

[21]  Robert J. Lilieholm,et al.  Using Bayesian belief networks to identify potential compatibilities and conflicts between development and landscape conservation , 2011 .

[22]  James W. Jones,et al.  The DSSAT cropping system model , 2003 .

[23]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[24]  Lindsay C. Stringer,et al.  Mapping the vulnerability of crop production to drought in Ghana using rainfall, yield and socioeconomic data , 2012 .

[25]  Laura Uusitalo,et al.  Advantages and challenges of Bayesian networks in environmental modelling , 2007 .

[26]  Danny C. Lee,et al.  Population Viability Assessment of Salmonids by Using Probabilistic Networks , 1997 .

[27]  Paul A. Sabatier,et al.  Harnessing expert-based information for learning and the sustainable management of complex socio-ecological systems , 2010 .

[28]  François Bousquet,et al.  Adapting Science to Adaptive Managers: Spidergrams, Belief Models, and Multi-agent Systems Modeling , 2002 .

[29]  Rattan Lal,et al.  Soil Erosion Impact on Agronomic Productivity and Environment Quality , 1998 .

[30]  E. Onumah,et al.  Determinants of Income Diversification of Farm Households in the Western Region of Ghana , 2014 .

[31]  Yaman Barlas,et al.  Philosophical roots of model validation: Two paradigms , 1990 .

[32]  H. Caswell THEORY AND MODELS IN ECOLOGY: A DIFFERENT PERSPECTIVE , 1988 .

[33]  A. Oparah,et al.  Evaluation of community pharmacists involvement in primary health care. , 2002 .

[34]  F. Armah,et al.  Food security and climate change in drought-sensitive savanna zones of Ghana , 2011 .

[35]  B. Marcot,et al.  Using Bayesian belief networks in adaptive management , 2006 .

[36]  W. Quaye Food security situation in northern Ghana, coping strategies and related constraints , 2008 .

[37]  R. Hogarth,et al.  Order effects in belief updating: The belief-adjustment model , 1992, Cognitive Psychology.

[38]  Olli Varis,et al.  Bayesian decision analysis for environmental and resource management , 1997 .

[39]  David N. Barton,et al.  Bayesian belief networks as a meta-modelling tool in integrated river basin management -- Pros and cons in evaluating nutrient abatement decisions under uncertainty in a Norwegian river basin , 2008 .

[40]  Rafael Rumí,et al.  Bayesian networks in environmental modelling , 2011, Environ. Model. Softw..

[41]  Anton Vrieling,et al.  Migration and environment in Ghana: a cross-district analysis of human mobility and vegetation dynamics , 2010 .

[42]  S. Tonah State Policies, Local Prejudices and Cattle Rustling Along the Ghana-Burkina Faso Border , 2000, Africa.

[43]  David Nash,et al.  Using Monte-Carlo simulations and Bayesian Networks to quantify and demonstrate the impact of fertiliser best management practices , 2011, Environ. Model. Softw..

[44]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[45]  K. Reckhow Water quality prediction and probability network models , 1999 .

[46]  Michael Power,et al.  The predictive validation of ecological and environmental models , 1993 .

[47]  R. Cooke Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[48]  Janina Kleemann,et al.  Assessing the risk of seasonal food insecurity with an expert-based Bayesian Belief Network approach in northern Ghana, West Africa , 2017 .

[49]  Alex A. T. Bui,et al.  Disease Models, Part II: Querying & Applications , 2010 .

[50]  G. Villamor,et al.  An Approach for Simulating Soil Loss from an Agro-Ecosystem Using Multi-Agent Simulation: A Case Study for Semi-Arid Ghana , 2015 .

[51]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[52]  I. Danso Soil and water conservation technologies in the West African Sudan Savanna: Cropping system options to address variability of crop yield and impacts of climate change , 2015 .

[53]  Ioan Fazey,et al.  Integrating local and scientific knowledge for environmental management. , 2010, Journal of environmental management.

[54]  Gretchen Rossman,et al.  Numbers and Words , 1985 .

[55]  N. Leon,et al.  Breeding Maize for a Bioeconomy: A Literature Survey Examining Harvest Index and Stover Yield and Their Relationship to Grain Yield , 2010 .

[56]  D. Millar,et al.  Climate and Livelihood Change in North East Ghana , 2004 .

[57]  Steven Broekx,et al.  A review of Bayesian belief networks in ecosystem service modelling , 2013, Environ. Model. Softw..

[58]  P. Mollinga Boundary Work and the Complexity of Natural Resources Management , 2010 .

[59]  Peter Reichert,et al.  On the usefulness of overparameterized ecological models , 1997 .