Repeated discrete choices in geographical agent based models with an application to fisheries

Most geographical agent-based models simulate agents through custom-made decision-making algorithms. This makes it difficult to assess which results are general and which are contingent on the algorithm's details. We present a set of general algorithms, applicable in any agent-based model for choosing repeatedly from a set of alternatives. We showcase each in the same fishery agent-based model and rank their performance under various scenarios. While complicated algorithms tend to perform better, too much sophistication lowers performance. Further, while some algorithms perform well under all scenarios, others are optimal only in specific circumstances. It is therefore impossible to produce a single, unequivocal performance ranking even for simple general algorithms. We advocate then a heuristic zoo approach where multiple algorithms are implemented in the same model; this allows us to identify its best algorithm and test sensitivity to misspecifications of the decision-making component.

[1]  S. Fotheringham,et al.  Geographically Weighted Regression , 1998 .

[2]  Nicholas Mark Gotts,et al.  IMITATIVE VERSUS NONIMITATIVE STRATEGIES IN A LAND-USE SIMULATION , 2001, Cybern. Syst..

[3]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[4]  Sean Luke,et al.  MASON: A Multiagent Simulation Environment , 2005, Simul..

[5]  Carl Boettiger,et al.  Avoiding tipping points in fisheries management through Gaussian process dynamic programming , 2014, Proceedings of the Royal Society B: Biological Sciences.

[6]  Martin Cenek,et al.  An adaptable agent-based model for guiding multi-species Pacific salmon fisheries management within a SES framework , 2017 .

[7]  E. Nadaraya On Estimating Regression , 1964 .

[8]  Deepayan Chakrabarti,et al.  Multi-armed bandit problems with dependent arms , 2007, ICML '07.

[9]  Peter J. Allen,et al.  Dynamics of discovery and exploitation: the case of the Scotian Shelf groundfish fisheries. , 1986 .

[10]  Marc Lelarge,et al.  Leveraging Side Observations in Stochastic Bandits , 2012, UAI.

[11]  Sébastien Bubeck,et al.  Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems , 2012, Found. Trends Mach. Learn..

[12]  J. Sutinen,et al.  Location choice in New England trawl fisheries: old habits die hard. , 2000 .

[13]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[14]  Birgit Müller,et al.  Theoretical foundations of human decision-making in agent-based land use models - A review , 2017, Environ. Model. Softw..

[15]  Doina Precup,et al.  Algorithms for multi-armed bandit problems , 2014, ArXiv.

[16]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[17]  Michael Laver,et al.  A Tournament of Party Decision Rules , 2008 .

[18]  J. Lansing,et al.  Emergent Properties of Balinese Water Temple Networks: Coadaptation on a Rugged Fitness Landscape , 1993 .

[19]  B. Hutniczak,et al.  Fishermen's location choice under spatio-temporal update of expectations , 2018, Journal of Choice Modelling.

[20]  J. Beecham,et al.  Ideal free distribution or dynamic game? An agent-based simulation study of trawling strategies with varying information , 2007 .

[21]  Derek T. Robinson,et al.  Modular ABM development for improved dissemination and training , 2015, Environ. Model. Softw..

[22]  K. Schlag Why Imitate, and If So, How?, : A Boundedly Rational Approach to Multi-armed Bandits , 1998 .

[23]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[24]  Dawn Cassandra Parker,et al.  Spatial agent-based models for socio-ecological systems: Challenges and prospects , 2013, Environ. Model. Softw..

[25]  May T. Lim,et al.  Effect of variable fishing strategy on fisheries under changing effort and pressure: An agent-based model application , 2010 .

[26]  R. Axelrod Effective Choice in the Prisoner's Dilemma , 1980 .

[27]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[28]  Andrew Caplin,et al.  Search and Satisficing , 2011 .

[29]  Jennifer Kunz,et al.  Group-Level Exploration and Exploitation: A Computer Simulation-Based Analysis , 2011, J. Artif. Soc. Soc. Simul..

[30]  Lisa Elliston,et al.  An agent-based bioeconomic model of a fishery with input controls , 2006, Math. Comput. Model..

[31]  T. Lillicrap,et al.  Why Copy Others? Insights from the Social Learning Strategies Tournament , 2010, Science.

[32]  Philippe Marcoul,et al.  Search and Active Learning With Correlated Information: Empirical Evidence from Mid-Atlantic Clam Fishermen , 2007 .

[33]  Olivier Thébaud,et al.  Modeling fleet response in regulated fisheries: An agent-based approach , 2006, Math. Comput. Model..

[34]  L. R. Little,et al.  Simulations of agents in social networks harvesting a resource , 2007 .

[35]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[36]  James A. Wilson Fishing for Knowledge , 1990 .

[37]  Jonathan D. Nelson,et al.  Mapping the unknown: The spatially correlated multi-armed bandit , 2017, bioRxiv.

[38]  Yoh Iwasa,et al.  Coupled ecological-social dynamics in a forested landscape: spatial interactions and information flow. , 2007, Journal of theoretical biology.

[39]  Adam Krzyzak,et al.  Global convergence of the recursive kernel regression estimates with applications in classification and nonlinear system estimation , 1992, IEEE Trans. Inf. Theory.

[40]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[41]  Sara S. Metcalf,et al.  Strategic directions for agent-based modeling: avoiding the YAAWN syndrome , 2016, Journal of land use science.

[42]  Robert L. Goldstone,et al.  EPICURE: Spatial and Knowledge Limitations in Group Foraging , 2006, Adapt. Behav..

[43]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[44]  Ramsey Michael Faragher,et al.  Understanding the Basis of the Kalman Filter Via a Simple and Intuitive Derivation [Lecture Notes] , 2012, IEEE Signal Processing Magazine.

[45]  John Langford,et al.  Taming the Monster: A Fast and Simple Algorithm for Contextual Bandits , 2014, ICML.

[46]  Daniel G. Brown,et al.  Empirical characterisation of agent behaviours in socio-ecological systems , 2011, Environ. Model. Softw..

[47]  Wei Chu,et al.  A contextual-bandit approach to personalized news article recommendation , 2010, WWW '10.

[48]  M. Tim Jones Artificial Intelligence: A Systems Approach , 2007 .

[49]  Lei Gao,et al.  Evaluating the effects of area closure for recreational fishing in a coral reef ecosystem: The benefits of an integrated economic and biophysical modeling , 2011 .

[50]  W. Cleveland Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[51]  M. Dorn Fishing behavior of factory trawlers: a hierarchical model of information processing and decision-making , 2001 .

[52]  Tim Blackwell,et al.  Particle Swarm Optimization in Dynamic Environments , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[53]  Martin D. Smith,et al.  Avoiding surprises: Incorporating fisherman behavior into management models , 2002 .

[54]  J. Gittins Bandit processes and dynamic allocation indices , 1979 .

[55]  John N. Tsitsiklis,et al.  Linearly Parameterized Bandits , 2008, Math. Oper. Res..

[56]  Thomas P. Minka,et al.  From Hidden Markov Models to Linear Dynamical Systems , 1999 .

[57]  Nicholas Mark Gotts,et al.  When and How to Imitate Your Neighbours: Lessons from and for FEARLUS , 2009, J. Artif. Soc. Soc. Simul..

[58]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[59]  H. Simon,et al.  Theories of Decision-Making in Economics and Behavioural Science , 1966 .

[60]  G. S. Watson,et al.  Smooth regression analysis , 1964 .

[61]  J. Watson,et al.  The dual impact of ecology and management on social incentives in marine common-pool resource systems , 2017, Royal Society Open Science.

[62]  Run Yu,et al.  Introduction of the agent based fishery management model of Hawaii's longline fisheries , 2012, WSC '12.

[63]  Stephen Hynes,et al.  Discrete choice modelling of fisheries with nuanced spatial information , 2016 .

[64]  Gavin Fay,et al.  Fleet dynamics and fishermen behavior: lessons for fisheries managers , 2006 .