Service rate control of closed Jackson networks from game theoretic perspective

Game theoretic analysis of queueing systems is an important research direction of queueing theory. In this paper, we study the service rate control problem of closed Jackson networks from a game theoretic perspective. The payoff function consists of a holding cost and an operating cost. Each server optimizes its service rate control strategy to maximize its own average payoff. We formulate this problem as a non-cooperative stochastic game with multiple players. By utilizing the problem structure of closed Jackson networks, we derive a difference equation which quantifies the performance difference under any two different strategies. We prove that no matter what strategies the other servers adopt, the best response of a server is to choose its service rates on the boundary. Thus, we can limit the search of equilibrium strategy profiles from a multidimensional continuous polyhedron to the set of its vertex. We further develop an iterative algorithm to find the Nash equilibrium. Moreover, we derive the social optimum of this problem, which is compared with the equilibrium using the price of anarchy. The bounds of the price of anarchy of this problem are also obtained. Finally, simulation experiments are conducted to demonstrate the main idea of this paper.

[1]  Y. Ho,et al.  Smoothed (conditional) perturbation analysis of discrete event dynamical systems , 1987 .

[2]  Asuman E. Ozdaglar,et al.  Network Games: Theory, Models, and Dynamics , 2011, Network Games: Theory, Models, and Dynamics.

[3]  Dye-Jyun Ma,et al.  A direct approach to decentralized control of service rates in a closed Jackson network , 1994 .

[4]  Li Xia,et al.  Performance optimization of queueing systems with perturbation realization , 2012, Eur. J. Oper. Res..

[5]  Christos G. Cassandras,et al.  Perturbation Analysis of Discrete Event Systems , 2015, Encyclopedia of Systems and Control.

[6]  Baris Ata,et al.  Dynamic Control of an M/M/1 Service System with Adjustable Arrival and Service Rates , 2006, Manag. Sci..

[7]  Laurens G. Debo,et al.  Signaling Quality Via Queues , 2010, Manag. Sci..

[8]  Paul Glasserman,et al.  Gradient Estimation Via Perturbation Analysis , 1990 .

[9]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[10]  Sylvain Sorin,et al.  Stochastic Games and Applications , 2003 .

[11]  Eitan Altman,et al.  A survey on networking games in telecommunications , 2006, Comput. Oper. Res..

[12]  Marcel F Neuts,et al.  The M/M/1 Queue with Randomly Varying Arrival and Service Rates. , 1977 .

[13]  D. Yao,et al.  Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization , 2001, IEEE Transactions on Automatic Control.

[14]  David D. Yao,et al.  Decentralized control of service rates in a closed Jackson network , 1989 .

[15]  Arie Hordijk,et al.  Perturbation analysis of waiting times in the G/G/1 queue , 2013, Discret. Event Dyn. Syst..

[16]  Li Xia,et al.  Max-Min Optimality of Service Rate Control in Closed Queueing Networks , 2013, IEEE Transactions on Automatic Control.

[17]  Antonis Economou,et al.  Optimal and equilibrium balking strategies in the single server Markovian queue with catastrophes , 2012, Eur. J. Oper. Res..

[18]  Christos G. Cassandras,et al.  Using infinitesimal perturbation analysis of stochastic flow models to recover performance sensitivity estimates of discrete event systems , 2012, Discret. Event Dyn. Syst..

[19]  J. Michael Harrison,et al.  Dynamic Control of a Queue with Adjustable Service Rate , 2001, Oper. Res..

[20]  Z. Artstein Discrete and Continuous Bang-Bang and Facial Spaces Or: Look for the Extreme Points , 1980 .

[21]  J. Filar,et al.  Competitive Markov Decision Processes , 1996 .

[22]  Xi-Ren Cao,et al.  Stochastic learning and optimization - A sensitivity-based approach , 2007, Annu. Rev. Control..

[23]  R. Bellman,et al.  On the “bang-bang” control problem , 1956 .

[24]  W. J. Gordon,et al.  Closed Queuing Systems with Exponential Servers , 1967, Oper. Res..

[25]  Christos H. Papadimitriou,et al.  Worst-case equilibria , 1999 .

[26]  Refael Hassin,et al.  To Queue or Not to Queue: Equilibrium Behavior in Queueing Systems , 2002 .

[27]  Xi-Ren Cao,et al.  Perturbation realization, potentials, and sensitivity analysis of Markov processes , 1997, IEEE Trans. Autom. Control..

[28]  Pradeep Dubey,et al.  Inefficiency of Nash Equilibria , 1986, Math. Oper. Res..

[29]  Xi Chen,et al.  Policy iteration for customer-average performance optimization of closed queueing systems , 2009, Autom..

[30]  Li Xia,et al.  Game theoretical control of service rates in closed jackson networks , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[31]  Y. Dimitrakopoulos,et al.  Customer equilibrium and optimal strategies in an M/M/1 queue with dynamic service control , 2016, Eur. J. Oper. Res..

[32]  R. Weber,et al.  Optimal control of service rates in networks of queues , 1987, Advances in Applied Probability.

[33]  Li Xia,et al.  Event-based optimization of admission control in open queueing networks , 2014, Discret. Event Dyn. Syst..

[34]  P. Naor The Regulation of Queue Size by Levying Tolls , 1969 .

[35]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[36]  J. Nash NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[37]  Carl M. Harris,et al.  Fundamentals of queueing theory , 1975 .

[38]  Refael Hassin,et al.  Strategic Behavior and Social Optimization in Markovian Vacation Queues , 2011, Oper. Res..