Coordination in the El Farol Bar problem: The role of social preferences and social networks

The El Farol Bar problem, introduced by [1], has over the years become the prototypical model of a system in which agents, competing for scarce resources, inductively adapt their belief-models to the aggregate environment that they jointly create. The works on the El Farol Bar problem which retained the best-reply learning of that seminal model show that, if the agents make use of global information, the aggregate attendance keeps fluctuating around the threshold level. Works where best-reply behavior has been replaced with reinforcement learning show that the system converges to an equilibrium characterized by a group of agents who always go to the bar and a group of agents who always stay at home. In this paper, we first introduce social networks: in our model, the agents take their decisions on the basis of their neighbors' past decisions. We investigate the effect of two network structures: the circular neighborhood and the von Neumann neighborhood. Simulations show, first, that the system always reaches a state of perfect coordination and, secondly, that many kinds of equilibria emerge, each of which is characterized by a certain number of classes in terms of attendance frequency. We then modify this network-based model by introducing minimum attendance thresholds. Simulations show that even with very low minimum attendance thresholds the equilibrium characterized by perfect equality is the most likely outcome. In particular, we show that it takes just one fourth of the agents with 'Keep-up-with-the Joneses' behavior to always lead the system to the perfect equality equilibrium.

[1]  Thomas Lux,et al.  Genetic learning as an explanation of stylized facts of foreign exchange markets , 2005 .

[2]  A. Coolen The mathematical theory of minority games : statistical mechanics of interacting agents , 2005 .

[3]  V. Eguíluz,et al.  Cooperation and the Emergence of Role Differentiation in the Dynamics of Social Networks1 , 2005, American Journal of Sociology.

[4]  Klaus M. Schmidt,et al.  A Theory of Fairness, Competition, and Cooperation , 1999 .

[5]  Hans-Jörg Schulz,et al.  Cooperation in the Minority Game with local information , 2000 .

[6]  David B. Fogel,et al.  Inductive reasoning and bounded rationality reconsidered , 1999, IEEE Trans. Evol. Comput..

[7]  Bruce Edmonds,et al.  Gossip, Sexual Recombination and the El Farol bar: modelling the emergence of heterogeneity , 1998, J. Artif. Soc. Soc. Simul..

[8]  Shu-Heng Chen,et al.  Software-Agent Designs in Economics: An Interdisciplinary [Research Frontier] , 2008, IEEE Computational Intelligence Magazine.

[9]  J. Galí,et al.  Keeping Up with the Joneses: Consumption Externalities, Portfolio Choice, and Asset Prices , 1994 .

[10]  E. Zambrano The Interplay between Analytics and Computation in the Study of Congestion Externalities: The Case of the El Farol Problem , 2004 .

[11]  P. Albin Approximations of cooperative equilibria in multi-person Prisoners' dilemma played by cellular automata , 1992 .

[12]  Jonathan B. Warner,et al.  Finance and the Good Society , 2014 .

[13]  Lynne Hamill,et al.  Social Circles: A Simple Structure for Agent-Based Social Network Models , 2009, J. Artif. Soc. Soc. Simul..

[14]  Hector Zenil,et al.  Irreducibility and Computational Equivalence: 10 Years After Wolfram's A New Kind of Science , 2012 .

[15]  Chung-Chih Liao,et al.  On the plausibility of sunspot equilibria , 2008 .

[16]  V. Sasidevan,et al.  Strategy switches and co-action equilibria in a minority game , 2012, 1212.6601.

[17]  Xiaofan Wang,et al.  Evolutionary minority game on complex networks , 2007 .

[18]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[19]  Paolo De Los Rios,et al.  The local minority game , 2002 .

[20]  Kristina Lerman,et al.  Adaptive Boolean networks and minority games with time-dependent capacities. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  William A. Sethares,et al.  The El Farol Problem and the Internet: Congestion and Coordination Failure , 1999 .

[22]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[23]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[24]  Paczuski,et al.  Self-organized networks of competing boolean agents , 2000, Physical review letters.

[25]  Reiner Franke,et al.  Reinforcement learning in the El Farol model , 2003 .

[26]  Hans-Theo Normann,et al.  A Within-Subject Analysis of Other-Regarding Preferences , 2010, Games Econ. Behav..

[27]  W. Arthur Complexity in economic theory: inductive reasoning and bounded rationality , 1994 .

[28]  Yi-Cheng Zhang,et al.  Emergence of cooperation and organization in an evolutionary game , 1997 .

[29]  Zoltán Toroczkai,et al.  Competition-driven network dynamics: emergence of a scale-free leadership structure and collective efficiency. , 2004, Physical review letters.

[30]  Bo Xianyu Social Preference, Incomplete Information, and the Evolution of Ultimatum Game in the Small World Networks: An Agent-Based Approach , 2010 .

[31]  B. LeBaron EVOLUTION AND TIME HORIZONS IN AN AGENT-BASED STOCK MARKET , 1999, Macroeconomic Dynamics.

[32]  M. Marsili,et al.  Shedding light on El Farol , 2003, cond-mat/0306445.

[33]  Peter S. Albin,et al.  Decentralized, dispersed exchange without an auctioneer: A simulation study , 1992 .

[34]  John Marangos,et al.  Alternative Perspectives of a Good Society , 2011 .

[35]  A. Wilhite Economic Activity on Fixed Networks , 2006 .

[36]  D. Whitehead,et al.  The El Farol Bar Problem Revisited: Reinforcement Learning in a Potential Game , 2008 .

[37]  H. Lavicka,et al.  Evolution of imitation networks in Minority Game model , 2007 .

[38]  Harald Uhlig,et al.  Tax Policy and Aggregate Demand Management under Catching Up with the Joneses , 2000 .

[39]  Ali Rana Atilgan,et al.  Collective Behavior of el Farol Attendees , 2008, Adv. Complex Syst..

[40]  Gary E. Bolton A Comparative Model of Bargaining: Theory and Evidence , 1991 .

[41]  Gary E. Bolton,et al.  ERC: A Theory of Equity, Reciprocity, and Competition , 2000 .

[42]  F. Slanina Social organization in the Minority Game model , 2000, cond-mat/0006098.

[43]  Martin Strobel,et al.  Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments , 2002 .

[44]  Donatella Casale,et al.  Finance and the Good Society by Robert Shiller, Princeton University Press: Book Review , 2012 .

[45]  John Duffy,et al.  Agent-Based Models and Human Subject Experiments , 2004 .

[46]  David G. Rand,et al.  Who Cooperates in Repeated Games: The Role of Altruism, Inequity Aversion, and Demographics , 2011 .

[47]  H. F. Chau,et al.  Minority game with peer pressure , 2004 .

[48]  Horacio Ceva,et al.  The Minority Game with interactions , 2004 .

[49]  Bikas K. Chakrabarti,et al.  Emergent cooperation amongst competing agents in minority games , 2011 .

[50]  Xianyu Bo Social Preference, Incomplete Information, and the Evolution of Ultimatum Game in the Small World Networks: An Agent-Based Approach , 2010, J. Artif. Soc. Soc. Simul..

[51]  Didier Sornette,et al.  The Co-Evolution of Fairness Preferences and Costly Punishment , 2013, PloS one.

[52]  P M Hui,et al.  Theory of networked minority games based on strategy pattern dynamics. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Yi-Cheng Zhang,et al.  Minority Games , 2008, Encyclopedia of Complexity and Systems Science.