Information Theory - The Bridge Connecting Bounded Rational Game Theory and Statistical Physics

A long-running difficulty with conventional game theory has been how to modify it to accommodate the bounded rationality of all red-world players. A recurring issue in statistical physics is how best to approximate joint probability distributions with decoupled (and therefore far more tractable) distributions. This paper shows that the same information theoretic mathematical structure, known as Product Distribution (PD) theory, addresses both issues. In this, PD theory not only provides a principle formulation of bounded rationality and a set of new types of mean field theory in statistical physics; it also shows that those topics are fundamentally one and the same.

[1]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[2]  B. Hayes.  The American Scientist , 1962, Nature.

[3]  L. Goddard.  Information Theory , 1962, Nature.

[4]  Physical Review , 1965, Nature.

[5]  David G. Stork,et al.  Pattern Classification , 1973 .

[6]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[7]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[8]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[9]  A. Neyman.  Bounded complexity justifies cooperation in the finitely repeated prisoners' dilemma , 1985 .

[10]  R. Aumann.  Correlated Equilibrium as an Expression of Bayesian Rationality Author ( s ) , 1987 .

[11]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[14]  S. Hart,et al.  Handbook of Game Theory with Economic Applications , 1992 .

[15]  David M. Kreps,et al.  Learning Mixed Equilibria , 1993 .

[16]  W. Arthur.  Complexity in economic theory: inductive reasoning and bounded rationality , 1994 .

[17]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[18]  Jeffrey S. Rosenschein,et al.  Coalition, Cryptography, and Stability: Mechanisms for Coalition Formation in Task Oriented Domains , 2018, AAAI.

[19]  Andrew G. Barto,et al.  Improving Elevator Performance Using Reinforcement Learning , 1995, NIPS.

[20]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[21]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[22]  Craig Boutilier,et al.  Economic Principles of Multi-Agent Systems , 1997, Artif. Intell..

[23]  Y. Shoham,et al.  Editorial: economic principles of multi-agent systems , 1997 .

[24]  Victor R. Lesser,et al.  Coalitions Among Computationally Bounded Agents , 1997, Artif. Intell..

[25]  M. Mesterton-Gibbons,et al.  Animal Contests as Evolutionary Games , 1998 .

[26]  Michael P. Wellman,et al.  Multiagent Reinforcement Learning: Theoretical Framework and an Algorithm , 1998, ICML.

[27]  A. Greif.  Economic History and Game Theory: A Survey , 1998 .

[28]  Kagan Tumer,et al.  Using Collective Intelligence to Route Internet Traffic , 1998, NIPS.

[29]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[30]  Steven Durlauf,et al.  How can statistical mechanics contribute to social science? , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[31]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[32]  Noam Nisan,et al.  Algorithmic Mechanism Design , 2001, Games Econ. Behav..

[33]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[34]  M. Opper,et al.  Advanced mean field methods: theory and practice , 2001 .

[35]  Kagan Tumer,et al.  Optimal Payoff Functions for Members of Collectives , 2001, Adv. Complex Syst..

[36]  Rann Smorodinsky,et al.  Large Nonanonymous Repeated Games , 2001, Games Econ. Behav..

[37]  Achim G. Hoffmann,et al.  Proceedings of the Nineteenth International Conference on Machine Learning , 2002 .

[38]  Damien Challet,et al.  Optimal combinations of imperfect objects. , 2002, Physical review letters.

[39]  Kagan Tumer,et al.  Collective Intelligence, Data Routing and Braess' Paradox , 2002, J. Artif. Intell. Res..

[40]  M. Mézard,et al.  The Cavity Method at Zero Temperature , 2002, cond-mat/0207121.

[41]  Zoltán Toroczkai,et al.  Suppressing Roughness of Virtual Times in Parallel Discrete-Event Simulations , 2003, Science.

[42]  Edwin Thompson Jaynes,et al.  Probability theory , 2003 .

[43]  E. Jaynes.  Probability theory : the logic of science , 2003 .

[44]  D. Kahneman.  A Psychological Perspective on Economics , 2003 .

[45]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[46]  D. Wolpert,et al.  Product Distribution Theory and Semi-Coordinate Transformations , 2004 .

[47]  Kagan Tumer,et al.  Collectives and Design Complex Systems , 2004 .

[48]  David H. Wolpert,et al.  Product distribution theory for control of multi-agent systems , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[49]  David H. Wolpert,et al.  Discrete, Continuous, and Constrained Optimization Using Collectives , 2004 .

[50]  David H. Wolpert,et al.  Beyond Mechanism Design , 2004 .

[51]  David H. Wolpert,et al.  Adaptive, distributed control of constrained multi-agent systems , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[52]  Ilan Kroo,et al.  Fleet Assignment Using Collective Intelligence , 2004 .

[53]  Stefan R. Bieniawski,et al.  Adaptive Multi-Agent Systems for Constrained Optimization , 2004 .

[54]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[55]  David H. Wolpert,et al.  Distributed control by Lagrangian steepest descent , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[56]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[57]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[58]  D. Wolpert,et al.  Self-dissimilarity as a High Dimensional Complexity Measure , 2005 .

[59]  Economics Letters , 2022 .