The Coconut Model with Heterogeneous Strategies and Learning

In this paper, we develop an agent-based version of the Diamond search equilibrium model - also called Coconut Model. In this model, agents are faced with production decisions that have to be evaluated based on their expectations about the future utility of the produced entity which in turn depends on the global production level via a trading mechanism. While the original dynamical systems formulation assumes an infinite number of homogeneously adapting agents obeying strong rationality conditions, the agent-based setting allows to discuss the effects of heterogeneous and adaptive expectations and enables the analysis of non-equilibrium trajectories. Starting from a baseline implementation that matches the asymptotic behavior of the original model, we show how agent heterogeneity can be accounted for in the aggregate dynamical equations. We then show that when agents adapt their strategies by a simple temporal difference learning scheme, the system converges to one of the fixed points of the original system. Systematic simulations reveal that this is the only stable equilibrium solution.

[1]  A note on the stability of endogenous cycles in Diamond's model of search and barter , 1992 .

[2]  Eckehard Olbrich.  Peter Diamond's Coconut Model (Heterogeneity and Learning) (Version 1) , 2016 .

[3]  Birgit Müller,et al.  A standard protocol for describing individual-based and agent-based models , 2006 .

[4]  Bruce Edmonds,et al.  Model-to-Model Analysis , 2003 .

[5]  Sven Banisch,et al.  Markov Chain Aggregation for Agent-Based Models , 2015 .

[6]  D. Fudenberg,et al.  Rational Expectations Business Cycles in Search Equilibrium , 1989, Journal of Political Economy.

[7]  Peter A. Diamond,et al.  Aggregate Demand Management in Search Equilibrium , 1982, Journal of Political Economy.

[8]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[9]  C. Hommes,et al.  Behavioral Rationality and Heterogeneous Expectations in Complex Economic Systems , 2013 .

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  J. Holland,et al.  Artificial Adaptive Agents in Economic Theory , 1991 .

[12]  William A. Brock,et al.  A rational route to randomness , 1997 .

[13]  H. Simon,et al.  Rationality as Process and as Product of Thought , 1978 .

[14]  Mauro Gallegati,et al.  Economies with heterogeneous interacting learning agents , 2015 .

[15]  M. Aoki,et al.  A NEW LOOK AT THE DIAMOND SEARCH MODEL: STOCHASTIC CYCLES AND EQUILIBRIUM SELECTION IN SEARCH EQUILIBRIUM , 2000, Macroeconomic Dynamics.

[16]  Robert L. Axtell,et al.  Aligning simulation models: A case study and results , 1996, Comput. Math. Organ. Theory.

[17]  William Rand,et al.  Making Models Match: Replicating an Agent-Based Model , 2007, J. Artif. Soc. Soc. Simul..

[18]  John Holland,et al.  Adaptation in Natural and Artificial Sys-tems: An Introductory Analysis with Applications to Biology , 1975 .

[19]  Nicolaas J. Vriend,et al.  An Illustration of the Essential Difference between Individual and Social Learning, and its Consequences for Computational Analyses , 1998 .