Self-adaptive skeletal task farm for computational grids

In this work, we introduce a self-adaptive task farm for computational grids which is based on a single-round scheduling algorithm called dynamic deal. In principle, the dynamic deal approach employs skeletal forecasting information to automatically instrument the task farm scheduling and determine the amount of work assigned to each worker at execution time, allowing the farm to adapt effectively to different load and network conditions in the grid. In practice, it uses self-generated predictive execution values and maps tasks onto the different nodes in a single-round. The effectiveness of this approach is illustrated with a computational biology parameter sweep in a non-dedicated departmental grid.

[1]  Torben Hagerup Allocating Independent Tasks to Parallel Processors: An Experimental Study , 1996, IRREGULAR.

[2]  Henri Casanova,et al.  Multiround algorithms for scheduling divisible loads , 2005, IEEE Transactions on Parallel and Distributed Systems.

[3]  Horacio González-Vélez,et al.  A grid-based stochastic simulation of unitary and membrane Ca/sup 2+/ currents in spherical cells , 2005, 18th IEEE Symposium on Computer-Based Medical Systems (CBMS'05).

[4]  William van Dorst The Quintessential Linux Benchmark: All about the BogoMips number displayed when Linux boots , 1996 .

[5]  P. Diehl,et al.  Least-Squares Fitting , 1972 .

[6]  Rajkumar Buyya,et al.  GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing , 2002, Concurr. Comput. Pract. Exp..

[7]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[8]  Jacek Blazewicz,et al.  Divisible task scheduling - Concept and verification , 1999, Parallel Comput..

[9]  Laurent Sallé,et al.  Ca2+ currents in cardiac myocytes: Old story, new insights. , 2006, Progress in biophysics and molecular biology.

[10]  Francine Berman,et al.  The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[11]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[12]  Jarek Nabrzyski,et al.  Grid resource management: state of the art and future trends , 2004 .

[13]  Horacio González-Vélez,et al.  An Adaptive Skeletal Task Farm for Grids , 2005, Euro-Par.

[14]  Murray Cole,et al.  Algorithmic Skeletons: Structured Management of Parallel Computation , 1989 .

[15]  Sathish S. Vadhiyar,et al.  Self adaptivity in Grid computing , 2005, Concurr. Pract. Exp..

[16]  Yves Robert,et al.  Scheduling divisible workloads on heterogeneous platforms , 2003, Parallel Comput..

[17]  Sergei Gorlatch,et al.  Program Development for Computational Grids Using Skeletons and Performance Prediction , 2002, Parallel Process. Lett..

[18]  Susanna Pelagatti Structured development of parallel programs , 1997 .

[19]  David Abramson,et al.  High performance parametric modeling with Nimrod/G: killer application for the global grid? , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[20]  Debasish Ghose,et al.  Scheduling Divisible Loads in Parallel and Distributed Systems , 1996 .

[21]  Virginia González-Vélez,et al.  Simulation of five intracellular Ca2+-regulation mechanisms in response to voltage-clamp pulses , 2004, Comput. Biol. Medicine.

[22]  Murray Cole Why Structured Parallel Programming Matters , 2004, Euro-Par.

[23]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[24]  Francine Berman,et al.  Adaptive Computing on the Grid Using AppLeS , 2003, IEEE Trans. Parallel Distributed Syst..

[25]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[26]  Matthias S. Müller,et al.  Performance Prediction in a Grid Environment , 2003, European Across Grids Conference.

[27]  Marco Danelutto,et al.  An advanced environment supporting structured parallel programming in Java , 2003, Future Gener. Comput. Syst..

[28]  Dror G. Feitelson,et al.  Pitfalls in Parallel Job Scheduling Evaluation , 2005, JSSPP.

[29]  F. Berman,et al.  Adaptive Performance Prediction for Distributed Data-Intensive Applications , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[30]  Domenico Laforenza,et al.  Grid programming: some indications where we are headed , 2002, Parallel Comput..

[31]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[32]  Stephen Gilmore,et al.  Flexible Skeletal Programming with eSkel , 2005, Euro-Par.