Simple Near-Optimal Scheduling for the M/G/1

We consider the problem of preemptively scheduling jobs to minimize mean response time of an M/G/1 queue. When the scheduler knows each job's size, the shortest remaining processing time (SRPT) policy is optimal. Unfortunately, in many settings we do not have access to each job's size. Instead, we know only the job size distribution. In this setting, the Gittins policy is known to minimize mean response time, but its complex priority structure can be computationally intractable. A much simpler alternative to Gittins is the shortest expected remaining processing time (SERPT) policy. While SERPT is a natural extension of SRPT to unknown job sizes, it is unknown how close SERPT is to optimal.

[1]  Genji Yamazaki,et al.  An optimal design problem for limited processor sharing systems , 1987 .

[2]  Vishal Misra,et al.  Mixed scheduling disciplines for network flows , 2003, PERV.

[3]  Benjamin Avi-Itzhak,et al.  A resource-allocation queueing fairness measure , 2004, SIGMETRICS '04/Performance '04.

[4]  Liang Guo,et al.  Scheduling flows with unknown sizes: approximate analysis , 2002, SIGMETRICS '02.

[5]  Richard J. Boucherie,et al.  Insensitive bounds for the moments of the sojourn time distribution in the M/G/1 processor-sharing queue , 2006, Queueing Syst. Theory Appl..

[6]  Urtzi Ayesta,et al.  Two-level processor-sharing scheduling disciplines: mean delay analysis , 2004, SIGMETRICS '04/Performance '04.

[7]  Urtzi Ayesta,et al.  Mean Delay Analysis of Multi Level Processor Sharing Disciplines , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[8]  Aditya Mahajan,et al.  Multi‐Armed Bandits, Gittins Index, and its Calculation , 2014 .

[9]  N. Balakrishnan Methods and Applications of Statistics in Clinical Trials: Planning, Analysis, and Inferential Methods , 2014 .

[10]  Nikhil Bansal,et al.  Achievable Performance of Blind Policies in Heavy Traffic , 2018, Math. Oper. Res..

[11]  Adam Wierman,et al.  Tail-robust scheduling via limited processor sharing , 2010, Perform. Evaluation.

[12]  ScullyZiv,et al.  Simple Near-Optimal Scheduling for the M/G/1 , 2019 .

[13]  Sem C. Borst,et al.  Beyond processor sharing , 2007, PERV.

[14]  Adam Wierman,et al.  Nearly insensitive bounds on SMART scheduling , 2005, SIGMETRICS '05.

[15]  Urtzi Ayesta,et al.  On the Gittins index in the M/G/1 queue , 2009, Queueing Syst. Theory Appl..

[16]  Luca Becchetti,et al.  Nonclairvoyant scheduling to minimize the total flow time on single and parallel machines , 2004, JACM.

[17]  Nicole Megow,et al.  A Tight 2-Approximation for Preemptive Stochastic Scheduling , 2014, Math. Oper. Res..

[18]  J. Shanthikumar,et al.  On extremal service disciplines in single-stage queueing systems , 1990, Journal of Applied Probability.

[19]  Urtzi Ayesta,et al.  PROPERTIES OF THE GITTINS INDEX WITH APPLICATION TO OPTIMAL SCHEDULING , 2011, Probability in the Engineering and Informational Sciences.

[20]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .

[21]  Bala Kalyanasundaram,et al.  Minimizing flow time nonclairvoyantly , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[22]  Leonard Kleinrock,et al.  Time-shared Systems: a theoretical treatment , 1967, JACM.

[23]  J. George Shanthikumar,et al.  Scheduling Multiclass Single Server Queueing Systems to Stochastically Maximize the Number of Successful Departures , 1989, Probability in the Engineering and Informational Sciences.

[24]  Linus Schrage,et al.  Letter to the Editor - A Proof of the Optimality of the Shortest Remaining Processing Time Discipline , 1968, Oper. Res..

[25]  Alexandre Proutière,et al.  Insensitivity in processor-sharing networks , 2002, Perform. Evaluation.

[26]  L Kleinrock,et al.  Processor Sharing Queueing Models of Mixed Scheduling Disciplines for Time Shared System , 1972, JACM.

[27]  Adam Wierman,et al.  Fairness and classifications , 2007, PERV.

[28]  S. Aalto,et al.  On the nonoptimality of the foreground-background discipline for IMRL service times , 2006, Journal of Applied Probability.

[29]  Bert Zwart,et al.  Heavy-Traffic Analysis of Sojourn Time Under the Foreground–Background Scheduling Policy , 2017, Stochastic Systems.

[30]  Mor Harchol-Balter Performance Modeling and Design of Computer Systems: M/M/1 and PASTA , 2013 .

[31]  Alan Scheller-Wolf,et al.  SOAP: One Clean Analysis of All Age-Based Scheduling Policies , 2018, SIGMETRICS 2018.