Large population games in radial loss networks: Computationally tractable equilibria for distributed network admission control

The computational intractability of the dynamic programming (DP) equations associated with optimal admission and routing in stochastic loss networks of any non-trivial size (Ma et al, 2006, 2008) leads one to consider suboptimal distributed game theoretic formulations of the problem. The special class of radial networks with a central core of infinite capacity is considered, and it is shown (under adequate assumptions) that an associated distributed admission control problem becomes tractable asymptotically, as the size of radial network grows to infinity. This is achieved by following a methodology first explored by M. Huang et. al. (2003, 2006–2008) in the context of large scale dynamic games for sets of weakly coupled linear stochastic control systems. At the established Nash equilibrium, each agent reacts optimally with respect to the average trajectory of the mass of all other agents; this trajectory is approximated by a deterministic infinite population limit (associated with the mean field or ensemble statistics of the random agents) which is the solution of a particular fixed point problem. This framework has connections with the mean field models studied by Lasry and Lions (2006, 2007) and close connections with the notion of oblivious equilibrium proposed by Weintraub, Benkard, and Van Roy (2005, 2008) via a mean field approximation.

[1]  Peter E. Caines,et al.  A locality generalization of the NCE (Mean Field) principle: Agent specific cost interactions , 2008, 2008 47th IEEE Conference on Decision and Control.

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[3]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Vol. II , 1976 .

[4]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[5]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[6]  F. Kelly Routing in circuit-switched networks: optimization, shadow prices and decentralization , 1988, Advances in Applied Probability.

[7]  Peter E. Caines,et al.  Distributed control for radial loss network systems via the ash Certainty Equivalence (mean field) principle , 2008, 2008 47th IEEE Conference on Decision and Control.

[8]  F. Kelly Blocking probabilities in large circuit-switched networks , 1986, Advances in Applied Probability.

[9]  Jorma T. Virtamo,et al.  Polynomial cost approximations in markov decision theory based call admission control , 2001, TNET.

[10]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[11]  John N. Tsitsiklis,et al.  Call admission control and routing in integrated services networks using neuro-dynamic programming , 2000, IEEE Journal on Selected Areas in Communications.

[12]  Peter E. Caines,et al.  Control of Admission and Routing in Loss Networks: Hybrid Dynamic Programming Equations , 2010, IEEE Transactions on Automatic Control.

[13]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[14]  Minyi Huang,et al.  Nash Certainty Equivalence in Large Population Stochastic Dynamic Games: Connections with the Physics of Interacting Particle Systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[15]  Eitan Altman,et al.  On optimal call admission control in resource-sharing system , 2001, IEEE Trans. Commun..

[16]  E. Çinlar,et al.  On the Superposition of Point Processes , 1968 .

[17]  Zhongjing Ma,et al.  Stochastic Control of Network Systems I: NETCAD State Space Structure & Dynamics , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[18]  S. Zachary,et al.  Loss networks , 2009, 0903.0640.

[19]  P. Lions,et al.  Mean field games , 2007 .

[20]  Zhongjing Ma,et al.  Stochastic Control of Network Systems II: NETCAD Optimal Control & the HJB Equation , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[21]  Zbigniew Dziong,et al.  Call admission and routing in multi-service loss networks , 1994, IEEE Trans. Commun..

[22]  C. L. Benkard,et al.  Markov Perfect Industry Dynamics with Many Firms , 2005 .

[23]  Markov Perfect Industry Dynamics with Many Firms-Technical Appendix April , 2008 A Proofs and Mathematical , 2008 .

[24]  V. Benes,et al.  Mathematical Theory of Connecting Networks and Telephone Traffic. , 1966 .

[25]  Peter E. Caines,et al.  Distributed control of loss network systems: Independent subnetwork behaviour in infinite networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[26]  Benjamin Van Roy,et al.  Oblivious Equilibrium: A Mean Field Approximation for Large-Scale Dynamic Games , 2005, NIPS.

[27]  Christos G. Cassandras,et al.  Adaptive call admission control in circuit-switched networks , 2002, IEEE Trans. Autom. Control..

[28]  R. V. Gamkrelidze,et al.  Principles of optimal control theory , 1977 .

[29]  Peter E. Caines,et al.  Control of Loss Network Systems: Call Admission and Routing Control , 2007 .