Population games with networking applications

His manuscript presents dynamic foundations of population games with variable number of players and their solutions and stability concepts. We first introduce delayed evolutionary game dynamics and study their stability. Applications to both wired and wireless networks are presented. We then introduce mobility and spatial aspects of players distribution into the network dynamics. This leads to a new class of game dynamics with multicomponent strategies and migration constraints called evolutionary game dynamics with migration. We derived such dynamics for hybrid systems such as power control in heterogenous networks, switching between technologies and migration between different classes of users. After that we focus on stochastic population games with multiple classes of players in which each player has its own state and facing to an evolving vector which represents the population profile. We use this model to analyze resource and energy constrained interactions in wireless networks. Finally, we present a class of mean field games. When taking the asymptotics of finite systems, we derive a new class of game dynamics called mean field game dynamics. This class contains the standard evolutionary game dynamics based on revision of pure actions. We apply this model to analyze spatial random access game and dynamic resource competition game with individual states. We establish a link betweenmean field games and differential population games inwhich each player optimizes its long-term objective during its sojourn time in the system subject to the constraint that the population profile evolves according to some mean field game dynamics

[1]  Quanyan Zhu,et al.  A constrained evolutionary Gaussian multiple access channel game , 2009, 2009 International Conference on Game Theory for Networks.

[2]  Larry Samuelson,et al.  Evolution and Game Theory , 2002 .

[3]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[4]  R. Aumann Correlated Equilibrium as an Expression of Bayesian Rationality Author ( s ) , 1987 .

[5]  Demetres D. Kouvatsos,et al.  Performance modelling and evaluation of heterogeneous networks , 2005, Perform. Evaluation.

[6]  Eitan Altman,et al.  Evolutionary Power Control Games in Wireless Networks , 2008, Networking.

[7]  D. M. Topkis Equilibrium Points in Nonzero-Sum n-Person Submodular Games , 1979 .

[8]  N. Vieille Stochastic Games: recent results , 2001 .

[9]  Ching-Yao Huang,et al.  Non-cooperative uplink power control in cellular radio systems , 1998, Wirel. Networks.

[10]  K. J. Ray Liu,et al.  Evolutionary Game Framework for Behavior Dynamics in Cooperative Spectrum Sensing , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[11]  M.D. Perez-Guirao,et al.  Evolutionary Game Theoretical Approach for IR-UWB Sensor Networks , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[12]  Eitan Altman,et al.  The evolution of transport protocols: An evolutionary game perspective , 2009, Comput. Networks.

[13]  K. Gopalsamy Stability and Oscillations in Delay Differential Equations of Population Dynamics , 1992 .

[14]  L. Koch,et al.  Evolution and Correlated Equilibrium , 2008 .

[15]  Eitan Altman,et al.  The Case for Non-Cooperative Multihoming of Users to Access Points in IEEE 802.11 WLANs , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[16]  David K. Y. Yau,et al.  A game theoretic approach to provide incentive and service differentiation in P2P networks , 2004, SIGMETRICS '04/Performance '04.

[17]  Cui Yun,et al.  Efficiency and fairness , 2004 .

[18]  Alexandre Proutière,et al.  Performance of random medium access control, an asymptotic approach , 2008, SIGMETRICS '08.

[19]  Hamidou Tembine,et al.  Deployment analysis of cooperative OFDM base stations , 2009, 2009 International Conference on Game Theory for Networks.

[20]  J. Neumann,et al.  SOLUTIONS OF GAMES BY DIFFERENTIAL EQUATIONS , 1950 .

[21]  Ariel Orda,et al.  Achieving network optima using Stackelberg routing strategies , 1997, TNET.

[22]  Eitan Altman,et al.  Asymmetric delay in evolutionary games , 2007, VALUETOOLS.

[23]  M. Sion On general minimax theorems , 1958 .

[24]  H. Vincent Poor,et al.  An energy-efficient approach to power control and receiver design in wireless data networks , 2005, IEEE Transactions on Communications.

[25]  J. Yu,et al.  Existence theorems of nash equilibria for non-cooperative n-person games , 1995 .

[26]  E. Altman,et al.  An evolutionary game perspective to ALOHA with power control , 2005 .

[27]  R. Selten Reexamination of the perfectness concept for equilibrium points in extensive games , 1975, Classics in Game Theory.

[28]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[29]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[30]  Jean-Yves Le Boudec,et al.  A Generic Mean Field Convergence Result for Systems of Interacting Objects , 2007, Fourth International Conference on the Quantitative Evaluation of Systems (QEST 2007).

[31]  Eitan Altman,et al.  c ○ 2005 Springer Science + Business Media, Inc. Manufactured in The Netherlands. Fairness in MIMD Congestion Control Algorithms , 2022 .

[32]  Boleslaw K. Szymanski,et al.  A Self-selection Technique for Flooding and Routing in Wireless Ad-hoc Networks , 2006, Journal of Network and Systems Management.

[33]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[34]  Eitan Altman,et al.  Fair power and transmission rate control in wireless networks , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[35]  A. M. Fink,et al.  Equilibrium in a stochastic $n$-person game , 1964 .

[36]  Ekaterina V. Shevkoplyas The Shapley Value in Cooperative Differential Games with Random Duration , 2011 .

[37]  H. Tembine,et al.  Stable networking games , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[38]  Eitan Altman,et al.  From mean field interaction to evolutionary game dynamics , 2009, 2009 7th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks.

[39]  Eitan Altman,et al.  Multiple access game in ad-hoc network , 2007, ValueTools '07.

[40]  Alan J. Hoffman,et al.  Integral Boundary Points of Convex Polyhedra , 2010, 50 Years of Integer Programming.

[41]  Yezekael Hayel,et al.  Information Dissemination using Epidemic Routing with Delayed Feedback , 2007, 2007 IEEE Internatonal Conference on Mobile Adhoc and Sensor Systems.

[42]  Abraham Neyman,et al.  Correlated equilibrium and potential games , 1997, Int. J. Game Theory.

[43]  Suresh Singh,et al.  Energy consumption of TCP Reno, Newreno, and SACK in multi-hop wireless networks , 2002, SIGMETRICS '02.

[44]  Michele Zorzi,et al.  Energy Efficiency of TCP in a Local Wireless Environment , 2001, Mob. Networks Appl..

[45]  Rachid El Azouzi,et al.  Delayed Evolutionary Game Dynamics applied to Medium Access Control , 2007, 2007 IEEE Internatonal Conference on Mobile Adhoc and Sensor Systems.

[46]  Evandro de Souza,et al.  A HighSpeed TCP Study : Characteristics and Deployment Issues , 2003 .

[47]  Anthony Ephremides,et al.  SINR-based MAC Games for Selfish and Malicious Users , 2006 .

[48]  Eitan Altman,et al.  Multihoming of Users to Access Points in WLANs: A Population Game Perspective , 2007, IEEE Journal on Selected Areas in Communications.

[49]  Josef Hofbauer,et al.  Robust Permanence and Impermanence for the Stochastic Replicator Dynamic , 2007 .

[50]  Eitan Altman,et al.  Analysis of Scalable TCP , 2004, HSNMC.

[51]  T. Başar,et al.  A Stackelberg Network Game with a Large Number of Followers , 2002 .

[52]  Bixio Rimoldi,et al.  Game theoretic considerations for the Gaussian Multiple Access Channel , 2008, 2008 IEEE International Symposium on Information Theory.

[53]  A. J. Shaiju,et al.  Evolutionarily Robust Strategies: Two Nontrivial Examples and a Theorem , 2009 .

[54]  Nicolas Vieille,et al.  Stochastic Games with a Single Controller and Incomplete Information , 2002, SIAM J. Control. Optim..

[55]  Guoqing Li,et al.  Downlink dynamic resource allocation for multi-cell OFDMA system , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[56]  Aris M. Ouksel,et al.  Opportunistic resource exchange in inter-vehicle ad-hoc networks , 2004, IEEE International Conference on Mobile Data Management, 2004. Proceedings. 2004.

[57]  Eitan Altman,et al.  Evolutionary games with random number of interacting players applied to access control , 2008, 2008 6th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks and Workshops.

[58]  Mohsen Guizani,et al.  Cognitive Radio Technology , 2006 .

[59]  Alasdair I. Houston,et al.  Fighting for food: a dynamic version of the Hawk-Dove game , 2005, Evolutionary Ecology.

[60]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[61]  J. Goodman Note on Existence and Uniqueness of Equilibrium Points for Concave N-Person Games , 1965 .

[62]  Rachid El Azouzi,et al.  Constrained Stochastic Games in Wireless Networks , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[63]  Peter E. Caines,et al.  A locality generalization of the NCE (Mean Field) principle: Agent specific cost interactions , 2008, 2008 47th IEEE Conference on Decision and Control.

[64]  Tim Roughgarden,et al.  The price of stability for network design with fair cost allocation , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[65]  Antonio Fernández,et al.  A mathematical model for the TCP Tragedy of the Commons , 2005, Theor. Comput. Sci..

[66]  H. Inaltekin,et al.  A one-shot random access game for wireless networks , 2005, 2005 International Conference on Wireless Networks, Communications and Mobile Computing.

[67]  Michael J. Smith,et al.  The Stability of a Dynamic Model of Traffic Assignment - An Application of a Method of Lyapunov , 1984, Transp. Sci..

[68]  Sergio Barbarossa,et al.  Potential Games: A Framework for Vector Power Control Problems With Coupled Constraints , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[69]  Benjamin Van Roy,et al.  Oblivious Equilibrium: A Mean Field Approximation for Large-Scale Dynamic Games , 2005, NIPS.

[70]  Eitan Altman,et al.  S-modular games and power control in wireless networks , 2003, IEEE Trans. Autom. Control..

[71]  Eitan Altman,et al.  Markov decision evolutionary games with expected average fitness , 2009 .

[72]  Jean-Yves Le Boudec,et al.  A class of mean field interaction models for computer and communication systems , 2008, WiOpt.

[73]  Eitan Altman,et al.  Markov decision evolutionary games with time average expected fitness criterion , 2008, VALUETOOLS.

[74]  A. Sznitman Topics in propagation of chaos , 1991 .

[75]  John Nachbar “Evolutionary” selection dynamics in games: Convergence and limit properties , 1990 .

[76]  Daniel Sadoc Menasché,et al.  An evolutionary game-theoretic approach to congestion control , 2005, Perform. Evaluation.

[77]  Eitan Altman,et al.  Constrained Markov games with transition probabilities controlled by a single player , 2007, ValueTools '07.

[78]  O. A. B. Space,et al.  EQUILIBRIUM POINTS OF NONATOMIC GAMES , 2010 .

[79]  U. Rieder,et al.  Markov Decision Processes , 2010 .

[80]  Eitan Altman,et al.  Evolutionary game dynamics with migration for hybrid power control in wireless communications , 2008, 2008 47th IEEE Conference on Decision and Control.

[81]  H. Vincent Poor,et al.  Energy-Efficient Resource Allocation in Wireless Networks , 2007, IEEE Signal Processing Magazine.

[82]  P. Lions,et al.  Mean field games , 2007 .

[83]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[84]  E. J. Collins,et al.  The hawk-dove game as an average cost problem , 1991 .

[85]  Hal L. Smith,et al.  Monotone Dynamical Systems: An Introduction To The Theory Of Competitive And Cooperative Systems (Mathematical Surveys And Monographs) By Hal L. Smith , 1995 .

[86]  G. Rota The Number of Partitions of a Set , 1964 .

[87]  William H. Sandholm,et al.  Potential Games with Continuous Player Sets , 2001, J. Econ. Theory.

[88]  Michael Bloem,et al.  A stackelberg game for power control and channel allocation in cognitive radio networks , 2007, VALUETOOLS.

[89]  Eitan Altman,et al.  Analysis of TCP Vegas and TCP Reno , 1997, Proceedings of ICC'97 - International Conference on Communications.

[90]  Yasuo Tanabe,et al.  The propagation of chaos for interacting individuals in a large population , 2006, Math. Soc. Sci..

[91]  Eitan Altman,et al.  A Markov Decision Evolutionary Game for Individual Energy Management , 2011 .

[92]  Bo Yang,et al.  Noncooperative random access game via pricing in ad hoc networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[93]  Michael P. Wellman,et al.  Nash Q-Learning for General-Sum Stochastic Games , 2003, J. Mach. Learn. Res..

[94]  E. Damme Refinements of the Nash Equilibrium Concept , 1983 .

[95]  Eitan Altman,et al.  A dynamic random access game with energy constraints , 2009, 2009 7th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks.

[96]  L. Imhof The long-run behavior of the stochastic replicator dynamics , 2005, math/0503529.

[97]  Masayuki Takahashi Equilibrium points of stochastic non-cooperative $n$-person games , 1964 .

[98]  J. Ponstein Existence of Equilibrium Points in Non-Product Spaces , 1966 .

[99]  Tadeusz Płatkowski,et al.  Population dynamics with a stable efficient equilibrium. , 2005, Journal of theoretical biology.

[100]  S. Vajda Some topics in two-person games , 1971 .

[101]  H. Peyton Young,et al.  Stochastic Evolutionary Game Dynamics , 1990 .

[102]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[103]  Boleslaw K. Szymanski,et al.  Local leader election, signal strength aware flooding, and routeless routing , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[104]  D. Goodman,et al.  A New Framework for Power Control in Wireless Data Networks: Games, Utility, and Pricing , 2002 .

[105]  Herbert Gintis,et al.  Game Theory Evolving: A Problem-Centered Introduction to Modeling Strategic Interaction - Second Edition , 2009 .

[106]  Eitan Altman,et al.  Information Concealing Games , 2008, IEEE Transactions on Information Theory.

[107]  Eitan Altman,et al.  Battery-state dependent power control as a dynamic game , 2008, 2008 6th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks and Workshops.

[108]  J. Robinson AN ITERATIVE METHOD OF SOLVING A GAME , 1951, Classics in Game Theory.

[109]  L. Shapley,et al.  Potential Games , 1994 .

[110]  Yannick Viossat,et al.  The replicator dynamics does not lead to correlated equilibria , 2007, Games Econ. Behav..

[111]  F. Forges Published by: The , 2022 .

[112]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[113]  S. Kakutani A generalization of Brouwer’s fixed point theorem , 1941 .

[114]  P. Taylor Evolutionarily stable strategies with two types of player , 1979, Journal of Applied Probability.

[115]  Amin Vahdat,et al.  Epidemic Routing for Partially-Connected Ad Hoc Networks , 2009 .

[116]  Yishay Mansour,et al.  Strong price of anarchy , 2007, SODA '07.

[117]  Eitan Altman,et al.  Battery State-Dependent Access Control in Solar-Powered Broadband Wireless Networks , 2008, NET-COOP.

[118]  Tim Roughgarden,et al.  Stackelberg scheduling strategies , 2001, STOC '01.

[119]  E. M. Wright A non-linear difference-differential equation. , 1946 .

[120]  K. Fan Fixed-point and Minimax Theorems in Locally Convex Topological Linear Spaces. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[121]  Eitan Altman,et al.  Bio-inspired delayed evolutionary game dynamics with networking applications , 2011, Telecommun. Syst..

[122]  Julien Arino,et al.  An alternative formulation for a delayed logistic equation. , 2006, Journal of theoretical biology.

[123]  Xiangao Li,et al.  Stability and Bifurcation in Delay–Differential Equations with Two Delays , 1999 .

[124]  W. Hamilton The Evolution of Altruistic Behavior , 1963, The American Naturalist.

[125]  Amotz Cahn,et al.  General procedures leading to correlated equilibria , 2004, Int. J. Game Theory.

[126]  M. Benaïm,et al.  Deterministic Approximation of Stochastic Evolution in Games , 2003 .

[127]  L. Berezansky,et al.  On stability of some linear and nonlinear delay differential equations , 2006 .

[128]  Nahum Shimkin,et al.  A Survey of Uniqueness Results for Selfish Routing , 2007, NET-COOP.

[129]  Valentina Corradi,et al.  Continuous Approximations of Stochastic Evolutionary Game Dynamics , 2000, J. Econ. Theory.

[130]  Ramesh Johari,et al.  End-to-end congestion control for the internet: delays and stability , 2001, TNET.

[131]  Antonio Fernández,et al.  A game theoretic analysis of protocols based on fountain codes , 2005, 10th IEEE Symposium on Computers and Communications (ISCC'05).

[132]  Kim C. Border,et al.  Fixed point theorems with applications to economics and game theory: Fixed point theorems for correspondences , 1985 .

[133]  L. Brouwer Über Abbildung von Mannigfaltigkeiten , 1911 .

[134]  Ao Tang,et al.  Equilibrium of Heterogeneous Congestion Control: Existence and Uniqueness , 2007, IEEE/ACM Transactions on Networking.

[135]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[136]  Dusit Niyato,et al.  Sleep and Wakeup Strategies in Solar-Powered Wireless Sensor/Mesh Networks: Performance Analysis and Optimization , 2007, IEEE Transactions on Mobile Computing.

[137]  R. Aumann Subjectivity and Correlation in Randomized Strategies , 1974 .

[138]  Hisao Kameda,et al.  How harmful the paradox can be in the Braess/Cohen-Kelly-Jeffries networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[139]  Takashi Hashimoto,et al.  Meta-evolutionary Game Dynamics for Mathematical Modelling of Rules Dynamics , 2003, ECAL.

[140]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[141]  Eitan Altman,et al.  Constrained cost-coupled stochastic games with independent state processes , 2007, Oper. Res. Lett..

[142]  Eitan Altman,et al.  Constrained Markov Games: Nash Equilibria , 2000 .

[143]  Takashi Ui,et al.  Correlated equilibrium and concave games , 2008, Int. J. Game Theory.

[144]  Scott Shenker,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.

[145]  Alasdair I Houston,et al.  If animals know their own fighting ability, the evolutionarily stable level of fighting is reduced. , 2005, Journal of theoretical biology.

[146]  H. Nikaidô,et al.  Note on non-cooperative convex game , 1955 .

[147]  Youngnam Han,et al.  Optimal subchannel allocation scheme in multicell OFDMA systems , 2004, 2004 IEEE 59th Vehicular Technology Conference. VTC 2004-Spring (IEEE Cat. No.04CH37514).

[148]  Bruce S. Cushing,et al.  When a hawk can damage a dove: an extension of game theory , 1995 .

[149]  Yung-Terng Wang,et al.  Designing Stable ABR Flow Control with Rate Feedback and Open Loop Control: First-Order Control Case , 1998, Perform. Evaluation.

[150]  Karl Aberer,et al.  Autonomous Gossiping: A Self-Organizing Epidemic Algorithm for Selective Information Dissemination in Wireless Mobile Ad-Hoc Networks , 2004, ICSNW.

[151]  I. Glicksberg A FURTHER GENERALIZATION OF THE KAKUTANI FIXED POINT THEOREM, WITH APPLICATION TO NASH EQUILIBRIUM POINTS , 1952 .

[152]  Daniele Miorandi,et al.  Evolutionary Epidemic Routing , 2007 .

[153]  Eitan Altman,et al.  Mean field asymptotics of Markov Decision Evolutionary Games and teams , 2009, 2009 International Conference on Game Theory for Networks.

[154]  T. Yi,et al.  Effect of time delay and evolutionarily stable strategy. , 1997, Journal of theoretical biology.

[155]  T. E. S. Raghavan,et al.  A Matrix Game Solution of the Single-Controller Stochastic Game , 1984, Math. Oper. Res..

[156]  Tansu Alpcan,et al.  A Hybrid Noncooperative Game Model for Wireless Communications , 2007 .

[157]  Eitan Altman,et al.  An evolutionary game approach for the design of congestion control protocols in wireless networks , 2008, 2008 6th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks and Workshops.

[158]  M. Blonski How Many Veiled Women Can We Expect in Cairo? Characterization of Equilibria in Large Anonymous Games , 2000 .

[159]  J. Fletcher Evolutionary Game Theory, Natural Selection, and Darwinian Dynamics , 2006, Journal of Mammalian Evolution.

[160]  E. Kalai,et al.  OTHER SOLUTIONS TO NASH'S BARGAINING PROBLEM , 1975 .

[161]  Eitan Altman,et al.  Correlated evolutionarily stable strategies in random medium access control , 2009, 2009 International Conference on Game Theory for Networks.

[162]  W. Hamilton Extraordinary Sex Ratios , 1967 .

[163]  Eitan Altman,et al.  A survey on networking games in telecommunications , 2006, Comput. Oper. Res..

[164]  Eitan Altman,et al.  Stochastic population games with individual independent states and coupled constraints , 2008, VALUETOOLS.

[165]  Eitan Altman,et al.  Zero-sum constrained stochastic games with independent state processes , 2005, Math. Methods Oper. Res..

[166]  Jörg Oechssler,et al.  On the Dynamic Foundation of Evolutionary Stability in Continuous Models , 2002, J. Econ. Theory.

[167]  Yezekael Hayel,et al.  A Stochastic Evolutionary Game of Energy Management in a Distributed Aloha Network , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[168]  T. Kurtz Solutions of ordinary differential equations as limits of pure jump markov processes , 1970, Journal of Applied Probability.

[169]  J M Smith,et al.  Evolution and the theory of games , 1976 .