A Performance-Based Approach to Dynamic Workload Distribution for Master-Slave Applications on Grid Environments

Effective workload distribution techniques can significantly reduce the total completion time of a program on grid computing environments. In this paper, we propose a dynamic performance-based workload partition approach for master-slave types of applications on grids. Furthermore, we implement two types of applications and conduct the experimentations on our grid testbed. Experimental results showed that our method could execute more efficiently than traditional schemes.

[1]  BharadwajVeeravalli,et al.  Divisible Load Theory , 2003 .

[2]  Chao-Tung Yang,et al.  A parallel loop self-scheduling on grid computing environments , 2004, 7th International Symposium on Parallel Architectures, Algorithms and Networks, 2004. Proceedings..

[3]  Maciej Drozdowski,et al.  On Optimum Multi-installment Divisible Load Processing in Heterogeneous Distributed Systems , 2005, Euro-Par.

[4]  Edith Schonberg,et al.  Factoring: a method for scheduling parallel loops , 1992 .

[5]  V. Lakshmi Narasimhan,et al.  A Novel Data Distribution Technique for Host-Client Type Parallel Applications , 2002, IEEE Trans. Parallel Distributed Syst..

[6]  Larry Carter,et al.  Scheduling strategies for master-slave tasking on heterogeneous processor platforms , 2004, IEEE Transactions on Parallel and Distributed Systems.

[7]  Thomas G. Robertazzi,et al.  Ten Reasons to Use Divisible Load Theory , 2003, Computer.

[8]  Chao-Tung Yang,et al.  A Performance-Based Parallel Loop Self-scheduling on Grid Computing Environments , 2005, NPC.

[9]  Ian T. Foster,et al.  A Grid-Enabled MPI: Message Passing in Heterogeneous Distributed Computing Systems , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[10]  Hui Li,et al.  Locality and Loop Scheduling on NUMA Multiprocessors , 1993, 1993 International Conference on Parallel Processing - ICPP'93.

[11]  Mohammed J. Zaki.  Parallel and distributed association mining: a survey , 1999, IEEE Concurr..

[12]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[13]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[14]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[15]  L. Smarr,et al.  Metacomputing : Siggraph'92 Showcase , 1992 .

[16]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[17]  Henri Casanova,et al.  Scheduling divisible loads on star and tree networks: results and open problems , 2005, IEEE Transactions on Parallel and Distributed Systems.

[18]  Rakesh Agrawal,et al.  Parallel Mining of Association Rules , 1996, IEEE Trans. Knowl. Data Eng..

[19]  L.M. Ni,et al.  Trapezoid Self-Scheduling: A Practical Scheduling Scheme for Parallel Compilers , 1993, IEEE Trans. Parallel Distributed Syst..

[20]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[21]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[22]  Chao-Tung Yang,et al.  An Efficient Parallel Loop Self-scheduling on Grid Environments , 2004, NPC.

[23]  Ian Foster,et al.  The Grid: A New Infrastructure for 21st Century Science , 2002 .

[24]  Chao-Tung Yang,et al.  A performance-based parallel loop scheduling on grid environments , 2007, The Journal of Supercomputing.

[25]  Chao-Tung Yang,et al.  A Parallel Loop Self-Scheduling on Extremely Heterogeneous PC Clusters , 2004 .

[26]  Debasish Ghose,et al.  Scheduling Divisible Loads in Parallel and Distributed Systems , 1996 .

[27]  Chao-Tung Yang,et al.  A Hybrid Parallel Loop Scheduling Scheme on Grid Environments , 2005, GCC.

[28]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[29]  Jonathan Armstrong,et al.  Introduction to grid computing with globus , 2003 .

[30]  CONSTANTINE D. POLYCHRONOPOULOS,et al.  Guided Self-Scheduling: A Practical Scheduling Scheme for Parallel Supercomputers , 1987, IEEE Transactions on Computers.