Non-clairvoyant Scheduling of Multiple Bag-of-Tasks Applications

The bag-of-tasks application model, albeit simple, arises in many application domains and has received a lot of attention in the scheduling literature. Previous works propose either theoretically sound solutions that rely on unrealistic assumptions, or ad-hoc heuristics with no guarantees on performance. This work attempts to bridge this gap through the design of non-clairvoyant heuristics based on solid theoretical foundations. The performance achieved by these heuristics is studied via simulations in a view to comparing them both to previously proposed solutions and to theoretical upper bounds on achievable performance. Also, an interesting theoretical result in this work is that a straightforward on-demand heuristic delivers asymptotically optimal performance when the communications or the computations can be neglected.

[1]  Arnaud Legrand,et al.  Non-Cooperative Scheduling of Multiple Bag-of-Task Applications , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[2]  Larry Carter,et al.  Scheduling strategies for master-slave tasking on heterogeneous processor platforms , 2004, IEEE Transactions on Parallel and Distributed Systems.

[3]  Yves Robert,et al.  Scheduling Concurrent Bag-of-Tasks Applications on Heterogeneous Platforms , 2010, IEEE Transactions on Computers.

[4]  Larry Carter,et al.  Centralized versus distributed schedulers for multiple bag-of-task applications , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[5]  Arnaud Legrand,et al.  Toward a fully decentralized algorithm for multiple bag-of-tasks application scheduling on grids , 2008, 2008 9th IEEE/ACM International Conference on Grid Computing.

[6]  Yves Robert,et al.  Steady-state scheduling on heterogeneous clusters , 2005, Int. J. Found. Comput. Sci..

[7]  Viktor K. Prasanna,et al.  Distributed adaptive task allocation in heterogeneous computing environments to maximize throughput , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[8]  Cosimo Anglano,et al.  Scheduling algorithms for multiple Bag-of-Task applications on Desktop Grids: A knowledge-free approach , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[9]  Eiji Oki,et al.  GLPK (GNU Linear Programming Kit) , 2012 .

[10]  Andrew A. Chien,et al.  Scheduling Task Parallel Applications for Rapid Turnaround on Enterprise Desktop Grids , 2007, Journal of Grid Computing.

[11]  Marco Danelutto,et al.  Euro-Par 2004 Parallel Processing , 2004, Lecture Notes in Computer Science.

[12]  Alexandru Iosup,et al.  The performance of bags-of-tasks in large-scale distributed systems , 2008, HPDC '08.

[13]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[14]  Larry Carter,et al.  Centralized versus Distributed Schedulers for Bag-of-Tasks Applications , 2008, IEEE Transactions on Parallel and Distributed Systems.

[15]  Albert Y. Zomaya,et al.  Practical Scheduling of Bag-of-Tasks Applications on Grids with Dynamic Resilience , 2007, IEEE Transactions on Computers.

[16]  Henri Casanova,et al.  Parameter Sweeps on the Grid with APST , 2003 .

[17]  Fabrício Alves Barbosa da Silva,et al.  A Scheduling Algorithm for Running Bag-of-Tasks Data Mining Applications on the Grid , 2004, Euro-Par.

[18]  Henri Casanova,et al.  SimGrid: A Generic Framework for Large-Scale Distributed Experiments , 2008, Tenth International Conference on Computer Modeling and Simulation (uksim 2008).

[19]  Rajkumar Buyya,et al.  A time optimization algorithm for scheduling bag-of-task applications in auction-based proportional share systems , 2005, 17th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD'05).