The Gittins Policy in the M/G/1 Queue

The Gittins policy is a highly general scheduling policy that minimizes a wide variety of mean holding cost metrics in the M/G/1 queue. Perhaps most famously, Gittins minimizes mean response time in the M/G/1 when jobs’ service times are unknown to the scheduler. Gittins also minimizes weighted versions of mean response time. For example, the well-known "cμ rule", which minimizes class-weighted mean response time in the multiclass M/M/1, is a special case of Gittins.However, despite the extensive literature on Gittins in the M/G/1, it contains no fully general proof of Gittins’s optimality. This is because Gittins was originally developed for the multiarmed bandit problem. Translating arguments from the multiarmed bandit to the M/G/1 is technically demanding, so it has only been done rigorously in some special cases. The extent of Gittins’s optimality in the M/G/1 is thus not entirely clear.In this work we provide the first fully general proof of Gittins’s optimality in the M/G/1. The optimality result we obtain is even more general than was previously known. For example, we show that Gittins minimizes mean slowdown in the M/G/1 with unknown or partially known service times, and we show that Gittins’s optimality holds under batch arrivals. Our proof uses a novel approach that works directly with the M/G/1, avoiding the difficulties of translating from the multi-armed bandit problem.

[1]  Optimal stopping and free boundary problems , 1974 .

[2]  Onno J. Boxma,et al.  Characterizing Policies with Optimal Response Time Tails under Heavy-Tailed Job Sizes , 2020, Proc. ACM Meas. Anal. Comput. Syst..

[3]  T. Lai,et al.  Open bandit processes and optimal scheduling of queueing networks , 1988, Advances in Applied Probability.

[4]  Dennis W. Fife Scheduling with Random Arrivals and Linear Loss Functions , 1965 .

[5]  Esa Hyytiä,et al.  Minimizing slowdown in heterogeneous size-aware dispatching systems , 2012, SIGMETRICS '12.

[6]  Gottfried Olivier Kostenminimale Prioritäten in Wartesystemen vom Typ M/G/1 / Cost-minimum priorities in queueing systems of type M/G/1 , 1972, Elektron. Rechenanlagen.

[7]  Shaler Stidham,et al.  The Relation between Customer and Time Averages in Queues , 1980, Oper. Res..

[8]  Mor Harchol-Balter,et al.  The Gittins Policy is Nearly Optimal in the M/G/k under Extremely General Conditions , 2020, Proc. ACM Meas. Anal. Comput. Syst..

[9]  Paul R. Milgrom,et al.  Envelope Theorems for Arbitrary Choice Sets , 2002 .

[10]  M. Dacre,et al.  The achievable region approach to the optimal control of stochastic systems , 1999 .

[11]  Masakiyo Miyazawa,et al.  Decomposition formulas for single server queues with vacations : a unified approach by the rate conservation law , 1994 .

[12]  Alan Scheller-Wolf,et al.  Optimal Scheduling and Exact Response Time Analysis for Multistage Jobs , 2018, ArXiv.

[13]  J. Gittins Bandit processes and dynamic allocation indices , 1979 .

[14]  P. Whittle Tax problems in the undiscounted case , 2005 .

[15]  K. C. Sevcik,et al.  USE OF SERVICE TIME DISTRIBUTIONS IN SCHEDULING. , 1971 .

[16]  Urtzi Ayesta,et al.  PROPERTIES OF THE GITTINS INDEX WITH APPLICATION TO OPTIMAL SCHEDULING , 2011, Probability in the Engineering and Informational Sciences.

[17]  Linus Schrage,et al.  Letter to the Editor - A Proof of the Optimality of the Shortest Remaining Processing Time Discipline , 1968, Oper. Res..

[18]  Alan Scheller-Wolf,et al.  SOAP: One Clean Analysis of All Age-Based Scheduling Policies , 2017, PERV.

[19]  Kenneth C. Sevcik,et al.  Scheduling for Minimum Total Loss Using Service Time Distributions , 1974, JACM.

[20]  G. Klimov Time-Sharing Service Systems. I , 1975 .

[21]  Dimitris Bertsimas,et al.  The achievable region method in the optimal control of queueing systems; formulations, bounds and policies , 1995, Queueing Syst. Theory Appl..

[22]  Christian M. Ernst,et al.  Multi-armed Bandit Allocation Indices , 1989 .

[23]  Urtzi Ayesta,et al.  On the Gittins index in the M/G/1 queue , 2009, Queueing Syst. Theory Appl..