Bayesian networks for spatial learning: a workflow on using limited survey data for intelligent learning in spatial agent-based models

Machine learning (ML) algorithms steer agent decisions in agent-based models (ABMs), serving as a vehicle for implementing behaviour changes during simulation runs. However, when training an ML algorithm, obtaining large sets of micro-level human behaviour data is often problematic. Information on human behaviour is often collected via surveys of relatively small sample sizes. This paper presents a methodology for training a learning algorithm to guide agent behaviour in a spatial ABM using a limited survey data sample. We apply different implementation strategies using survey data and Bayesian networks (BNs). By being grounded in probabilistic directed graphical models, BNs stand out among other learning algorithms in that they can be based on expert knowledge and/or known datasets. This paper presents four alternative implementations of data-driven BNs to support agent decisions in a spatial ABM. We differentiate between training BNs prior to, or during the simulation runs, using only survey data or a combination of survey data and expert knowledge. The four different implementations are then illustrated using a spatial ABM of cholera diffusion for Kumasi, Ghana. The results indicate that a balance between expert knowledge and survey data provides the best control over the learning process of the agents and produces the most realistic agent behaviour.

[1]  Chimay J. Anumba,et al.  Learning in multi-agent systems: a case study of construction claims negotiation , 2002, Adv. Eng. Informatics.

[2]  Ellen-Wien Augustijn,et al.  Agent-based modelling of cholera diffusion , 2016, Stochastic Environmental Research and Risk Assessment.

[3]  Harry Timmermans,et al.  Using Bayesian decision networks for knowledge representation under conditions of uncertainty in multi-agent land use simulation models , 2004 .

[4]  S. Sharma,et al.  Intelligent agents in a goal finding application for homeland security , 2012, 2012 Proceedings of IEEE Southeastcon.

[5]  Daniele Ramazzotti,et al.  Learning the Structure of Bayesian Networks: A Quantitative Assessment of the Effect of Different Algorithmic Schemes , 2017, Complex..

[6]  Benoît Iung,et al.  Overview on Bayesian networks applications for dependability, risk analysis and maintenance areas , 2012, Eng. Appl. Artif. Intell..

[7]  T. C. Edwin Cheng,et al.  Evolutionary Location and Pricing Strategies in Competitive Hierarchical Distribution Systems: A Spatial Agent-Based Model , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Tom M. Mitchell,et al.  Machine Learning and Data Mining , 2012 .

[9]  Alexandra M. Carvalho,et al.  Scoring functions for learning Bayesian networks , 2009 .

[10]  Monica Wachowicz,et al.  Learning Actors in Spatial Planning: Incorporating Bayesian Networks in an Agent Based Model , 2010 .

[11]  Verena Rieser,et al.  Evolving Urbanisation Policies - Using a Statistical Model to Accelerate Optimisation over Agent-based Simulations , 2013, ICAART.

[12]  Federico Girosi,et al.  A framework for the identification and classification of homogeneous socioeconomic areas in the analysis of health care variation , 2018, International Journal of Health Geographics.

[13]  Eduardo Araral Improving effectiveness and efficiency in the water sector: institutions, infrastructure and indicators , 2010 .

[14]  Maria Hedman Women, Water, and Perceptions of Risk : a case study made in Babati, Tanzania 2008 , 2009 .

[15]  Norman Fenton,et al.  Risk Assessment and Decision Analysis with Bayesian Networks , 2012 .

[16]  Anthony Constantinou,et al.  pi-football: A Bayesian network model for forecasting Association Football match outcomes , 2012, Knowl. Based Syst..

[17]  Laura Uusitalo,et al.  Advantages and challenges of Bayesian networks in environmental modelling , 2007 .

[18]  David Heckerman,et al.  Learning With Bayesian Networks (Abstract) , 1995, ICML.

[19]  William Marsh,et al.  Decision support system for Warfarin therapy management using Bayesian networks , 2013, Decis. Support Syst..

[20]  Osamu Matsumoto,et al.  Method for Getting Parameters of Agent-Based Modeling Using Bayesian Network: A Case of Medical Insurance Market , 2017 .

[21]  Roya Asadi,et al.  A Framework For Intelligent Multi Agent System Based Neural Network Classification Model , 2009, ArXiv.

[22]  Alta de Waal,et al.  Construction and evaluation of Bayesian networks with expert-defined latent variables , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[23]  Changhe Yuan,et al.  Empirical evaluation of scoring functions for Bayesian network model selection , 2012, BMC Bioinformatics.

[24]  Steve Redpath,et al.  Combining socio-economic and ecological modelling to inform natural resource management strategies , 2012 .

[25]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[26]  Yang Shen,et al.  Modeling and simulation of stranded passengers' transferring decision-making on the basis of herd behavior , 2011, Proceedings of 2011 IEEE International Conference on Grey Systems and Intelligent Services.

[27]  S. Driedger,et al.  Risk and the Media: A Comparison of Print and Televised News Stories of a Canadian Drinking Water Risk Event , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[28]  Danielle J. Marceau,et al.  Incorporating Bayesian learning in agent-based simulation of stakeholders' negotiation , 2014, Comput. Environ. Urban Syst..

[29]  P. I. Bidyuk,et al.  Construction and Methods of Learning of Bayesian Networks , 2005 .

[30]  William Marsh,et al.  From complex questionnaire and interviewing data to intelligent Bayesian Network models for medical decision support , 2016, Artif. Intell. Medicine.

[31]  Suzana Dragicevic,et al.  Bayesian networks and agent-based modeling approach for urban land-use and population density change: a BNAS model , 2012, Journal of Geographical Systems.

[32]  Tatiana Filatova,et al.  Intelligent judgements over health risks in a spatial agent-based model , 2018, International Journal of Health Geographics.

[33]  Henry Tirri,et al.  A Bayesian Approach to Discretization , 1997 .

[34]  Sung-Bae Cho,et al.  A modular design of Bayesian networks using expert knowledge: Context-aware home service robot , 2012, Expert Syst. Appl..

[35]  Daniele Ramazzotti,et al.  A quantitative assessment of the effect of different algorithmic schemes to the task of learning the structure of Bayesian Networks , 2017, ArXiv.

[36]  Luis M. de Campos,et al.  A Scoring Function for Learning Bayesian Networks based on Mutual Information and Conditional Independence Tests , 2006, J. Mach. Learn. Res..

[37]  Andrew J. Bulpitt,et al.  A Primer on Learning in Bayesian Networks for Computational Biology , 2007, PLoS Comput. Biol..

[38]  Francisco Javier Díez,et al.  Parameter adjustment in Bayes networks. The generalized noisy OR-gate , 1993, UAI.

[39]  Alison J. Heppenstall,et al.  Genetic Algorithm Optimisation of An Agent-Based Model for Simulating a Retail Market , 2007 .

[40]  Daniel Kudenko,et al.  Learning in multi-agent systems , 2001, The Knowledge Engineering Review.

[41]  Kevin B. Korb,et al.  Incorporating expert knowledge when learning Bayesian network structure: A medical case study , 2011, Artif. Intell. Medicine.

[42]  Alan F. Karr,et al.  Why data availability is such a hard problem , 2014 .

[43]  Steven Walczak,et al.  An Empirical Analysis of Data Requirements for Financial Forecasting with Neural Networks , 2001, J. Manag. Inf. Syst..

[44]  Ivan Bratko,et al.  Machine learning in artificial intelligence , 1993, Artif. Intell. Eng..

[45]  Ewout W Steyerberg,et al.  Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints , 2014, BMC Medical Research Methodology.

[46]  Jarosław Stepaniuk,et al.  A Medical Case Study , 2009 .

[47]  Randy Gimblett,et al.  Linking Bayesian and agent-based models to simulate complex social-ecological systems in semi-arid regions , 2015, Front. Environ. Sci..