Online Starvation Mitigation to Balance Average Flow Time and Fairness

In job scheduling, it is well known that Shortest Remaining Processing Time (SRPT) minimizes the average flow time. However, SRPT may cause starvation and unfairness. To balance fairness and average flow time, one common approach is to minimize the l2 norm of flow time. All non-trivial algorithms designed for this problem are offline algorithms based on linear programming rounding. For the online setting, all previous works consider standard scheduling algorithms under the assumptions of speed augmentation or certain input distributions. In their seminal paper, Bansal and Pruhs prove that under speed augmentation, fairness is not sacrificed much when SRPT is used [SICOMP 2010]. However, in practice, to achieve better fairness, it is not uncommon to complement SRPT with some starvation mitigation mechanism. Nonetheless, starvation mitigation inevitably destroys SRPT’s optimality in minimizing the average flow time. Thus, it is not clear whether starvation mitigation can improve SRPT’s performance on minimizing the l2 norm of flow time. In this paper, we answer this question in the affirmative. Let n be the number of jobs. We use an estimate of n to carefully mitigate the starvation caused by SRPT. Given a good estimate of n, our starvation mitigation mechanism reduces the competitive ratio of SRPT for the l2 norm of flow time from Ω(n 1 2 ) to O(n 1 3 ). Finally, we remark that all the online algorithms considered previously for this problem have competitive ratios Ω̃(n 1 2 ).

[1]  Abraham Silberschatz,et al.  Operating System Concepts , 1983 .

[2]  Giorgio Lucarelli,et al.  Primal-Dual and Dual-Fitting Analysis of Online Scheduling Algorithms for Generalized Flow Time Problems , 2015, ESA.

[3]  Kirk Pruhs,et al.  Server Scheduling to Balance Priorities, Fairness, and Average Quality of Service , 2010, SIAM J. Comput..

[4]  Kirill Kogan,et al.  SRPT-based Congestion Control for Flows with Unknown Sizes , 2021, 2021 IFIP Networking Conference (IFIP Networking).

[5]  Kirk Pruhs Competitive online scheduling for server systems , 2007, PERV.

[6]  Kirk Pruhs,et al.  The Geometry of Scheduling , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[7]  Willy Zwaenepoel,et al.  Job-aware Scheduling in Eagle: Divide and Stick to Your Probes , 2016, SoCC.

[8]  Kyle Fox,et al.  Online scheduling on identical machines using SRPT , 2010, SODA '11.

[9]  Mor Harchol-Balter,et al.  Analysis of SRPT scheduling: investigating unfairness , 2001, SIGMETRICS '01.

[10]  Benjamin Moseley,et al.  Fair Scheduling via Iterative Quasi-Uniform Sampling , 2017, SODA.

[11]  Guillaume Urvoy-Keller,et al.  Scheduling in practice , 2007, PERV.

[12]  Kirk Pruhs,et al.  Online Scheduling with General Cost Functions , 2012, SIAM J. Comput..

[13]  Janardhan Kulkarni,et al.  Temporal Fairness of Round Robin: Competitive Analysis for Lk-norms of Flow Time , 2015, SPAA.

[14]  Ashish Goel,et al.  Multi-processor scheduling to minimize flow time with ε resource augmentation , 2004, STOC '04.

[15]  Mor Harchol-Balter,et al.  Web servers under overload: How scheduling can help , 2006, TOIT.

[16]  Amit Kumar,et al.  All-Norms and All-L_p-Norms Approximation Algorithms , 2008, FSTTCS.

[17]  Pietro Michiardi,et al.  HFSP: Bringing Size-Based Scheduling To Hadoop , 2017, IEEE Transactions on Cloud Computing.

[18]  Mor Harchol-Balter,et al.  Connection Scheduling in Web Servers , 1999, USENIX Symposium on Internet Technologies and Systems.

[19]  Jacques Carlier,et al.  Handbook of Scheduling - Algorithms, Models, and Performance Analysis , 2004 .

[20]  Dong Lin,et al.  Designing Approximate and Deployable SRPT Scheduler: A Unified Framework , 2021, 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS).

[21]  Song Zhang,et al.  Efficient Online Scheduling for Coflow-aware Machine Learning Clusters , 2020 .

[22]  Uriel Feige,et al.  A Polynomial Time Constant Approximation For Minimizing Total Weighted Flow-time , 2019, SODA.

[23]  Mor Harchol-Balter,et al.  SRPT Scheduling for Web Servers , 2001, JSSPP.

[24]  Dipankar Raychaudhuri,et al.  Size matters: size-based scheduling for MPEG-4 over wireless channels , 2003, IS&T/SPIE Electronic Imaging.

[25]  PruhsKirk Competitive online scheduling for server systems , 2007 .

[26]  Michael A. Bender,et al.  Flow and stretch metrics for scheduling continuous job streams , 1998, SODA '98.