Fair Scheduling for Multiple Submissions

Today, most available parallel environments support multiple users executing their jobs in a common shared infrastructure. In such environments, when scheduling individually important jobs from different users, the problem of fairness arises. In this work, we propose a fair scheduling algorithm that handles this problem by adopting processor fair-share as a strategy for user fairness. The user’s workload follows the Campaign Scheduling model, in which each workload is characterized by the submission of successive sets (or campaigns) of sequential and independent jobs. The algorithm guarantees that the flow time of a campaign is proportional to campaign’s size and the total number of users. In contrast to the classic queuing systems, the flow time does not depend on the total system load. Internally, the algorithm maintains a virtual time-sharing schedule in which each user is assigned the same share of processors. The order of completion in the virtual schedule determines the execution order on the real processors. We analyse the performance of the algorithm by simulation on a real parallel machine workload trace. Our approach shows that a parallel machine can give a similar type of performance guarantee as a round-robin scheduler, no job preemption been required. Consequently, processors are shared in a proportionally-fair manner among users.

[1]  Dror G. Feitelson,et al.  On extracting session data from activity logs , 2012, SYSTOR '12.

[2]  Rajmohan Rajaraman,et al.  Improved algorithms for stretch scheduling , 2002, SODA '02.

[3]  Ronald L. Graham,et al.  Bounds on Multiprocessing Timing Anomalies , 1969, SIAM Journal of Applied Mathematics.

[4]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[5]  Xiaotie Deng,et al.  Preemptive Scheduling of Parallel Jobs on Multiprocessors , 1996, SIAM J. Comput..

[6]  Frédéric Vivien,et al.  Minimizing the stretch when scheduling flows of biological requests , 2006, SPAA '06.

[7]  David P. Williamson,et al.  Scheduling Parallel Machines On-Line , 1995, SIAM J. Comput..

[8]  Denis Trystram,et al.  Multi-users scheduling in parallel systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[9]  Dror G. Feitelson,et al.  On Identifying User Session Boundaries in Parallel Workload Logs , 2012, JSSPP.

[10]  Michael A. Bender,et al.  Flow and stretch metrics for scheduling continuous job streams , 1998, SODA '98.

[11]  Chung-Yee Lee,et al.  Parallel machines scheduling with nonsimultaneous machine available time , 1991, Discret. Appl. Math..

[12]  Alexandru Iosup,et al.  The Characteristics and Performance of Groups of Jobs in Grids , 2007, Euro-Par.

[13]  Edward G. Coffman,et al.  Scheduling independent tasks to reduce mean finishing time , 1974, CACM.

[14]  Mark J. Clement,et al.  Core Algorithms of the Maui Scheduler , 2001, JSSPP.

[15]  Krzysztof Rzadca,et al.  Campaign scheduling , 2012, 2012 19th International Conference on High Performance Computing.

[16]  Alessandro Agnetis,et al.  Scheduling Problems with Two Competing Agents , 2004, Oper. Res..

[17]  Dror G. Feitelson,et al.  Using Site-Level Modeling to Evaluate the Performance of Parallel System Schedulers , 2006, 14th IEEE International Symposium on Modeling, Analysis, and Simulation.

[18]  Arnaud Legrand,et al.  Non-cooperative Scheduling Considered Harmful in Collaborative Volunteer Computing Environments , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[19]  Vyas Sekar,et al.  Multi-resource fair queueing for packet processing , 2012, CCRV.

[20]  Mary K. Vernon,et al.  Production job scheduling for parallel shared memory systems , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[21]  Andy B. Yoo,et al.  Approved for Public Release; Further Dissemination Unlimited X-ray Pulse Compression Using Strained Crystals X-ray Pulse Compression Using Strained Crystals , 2002 .

[22]  Benjamin Avi-Itzhak,et al.  A resource-allocation queueing fairness measure , 2004, SIGMETRICS '04/Performance '04.

[23]  Alexandru Iosup,et al.  The performance of bags-of-tasks in large-scale distributed systems , 2008, HPDC '08.

[24]  Henri Casanova,et al.  Minimizing Stretch and Makespan of Multiple Parallel Task Graphs via Malleable Allocations , 2010, 2010 39th International Conference on Parallel Processing.