Emergence of Distributed Coordination in the Kolkata Paise Restaurant Problem with Finite Information

In this paper, we study a large-scale distributed coordination problem and propose efficient adaptive strategies to solve the problem. The basic problem is to allocate finite number of resources to individual agents in the absence of a central planner such that there is as little congestion as possible and the fraction of unutilized resources is reduced as far as possible. In the absence of a central planner and global information, agents can employ adaptive strategies that uses only a finite knowledge about the competitors. In this paper, we show that a combination of finite information sets and reinforcement learning can increase the utilization fraction of resources substantially.

[1]  W. Arthur,et al.  Inductive Reasoning and Bounded Rationality ( The El Farol Problem ) , 1999 .

[2]  Kristina Lerman,et al.  Minority games and distributed coordination in non-stationary environments , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[3]  M. Marsili,et al.  Minority Games: Interacting agents in financial markets , 2014 .

[4]  A. Ijspeert,et al.  A Macroscopic Analytical Model of Collaboration in Distributed Robotic Systems , 2002, Artificial Life.

[5]  Emanuele Pugliese,et al.  Collaborate, compete and share , 2008, 0805.1164.

[6]  Hans-Jörg Schulz,et al.  Cooperation in the Minority Game with local information , 2000 .

[7]  W. Arthur.  Inductive Reasoning and Bounded Rationality , 1994 .

[8]  Yi-Cheng Zhang,et al.  Statistical Mechanics of Competitive Resource Allocation , 2013, 1305.2121.

[9]  Sitabhra Sinha,et al.  When Big Data Fails! Relative success of adaptive agents using coarse-grained information to compete for limited resources , 2016, Physical review. E.

[10]  Richard M. Adler,et al.  Distributed Coordination Models for Client/Server Computing , 1995, Computer.

[11]  Paczuski,et al.  Self-organized networks of competing boolean agents , 2000, Physical review letters.

[12]  David B. Fogel,et al.  Inductive reasoning and bounded rationality reconsidered , 1999, IEEE Trans. Evol. Comput..

[13]  Bikas K. Chakrabarti,et al.  The Kolkata Paise Restaurant problem and resource utilization , 2007, 0711.1639.

[14]  Olivier Buffet,et al.  Reactive Coordination Rules for Traffic Optimization in Road Sharing Problems , 2013, PAAMS.

[15]  Bikas K. Chakrabarti,et al.  Sociophysics: An Introduction , 2014 .

[16]  Arnab Chatterjee,et al.  Statistics of the Kolkata Paise Restaurant problem , 2010 .

[17]  Diptesh Ghosh,et al.  Improving Server Utilization in a Distributed Computing Set-up with Independent Clients , 2016, ArXiv.