A decentralized resource allocation policy in minigrid

Resource allocating is the key to enhance the concurrency ability of the heterogeneous distributed systems. The traditional resource allocating policies statically assign resources to the jobs according to the distribution schema computed by the job scheduling policy. Those policies cannot handle the DAGs with large jobs since the computing cost is intolerably huge. Decentralized resource allocating policy is inevitably generated to solve this problem by sharing the computing burden on several processors. However the existing decentralized policies cannot dynamically compute the dependent relationships of a given DAG or even schedule the data driven jobs. This paper proposes a cluster-based resource allocating policy-CDRAP, by which the large-scale distributed systems can precisely schedule the data driven jobs and the computing cost of jobs' scheduling can be controlled in an acceptable range as well. The Broker + describe/issue message mechanism is used as the underlying structure in CDRAP.

[1]  Carl Kesselman,et al.  Optimizing Grid-Based Workflow Execution , 2005, Journal of Grid Computing.

[2]  R. Sarnath,et al.  Proceedings of the International Conference on Parallel Processing , 1992 .

[3]  Jack J. Dongarra,et al.  Scheduling workflow applications on processors with different capabilities , 2006, Future Gener. Comput. Syst..

[4]  Viktor K. Prasanna,et al.  Greedy Heuristics for Resource Allocation in Dynamic Distributed Real-Time Heterogeneous Computing Systems , 2002, PDPTA.

[5]  Dai Guo-zhong,et al.  A Real-Time Scheduling Algorithm Based on Priority Table and Its Implementation , 2004 .

[6]  Hai Zhuge.  Resource space model, its design method and applications , 2004, J. Syst. Softw..

[7]  Kuldip Singh,et al.  An Improved Duplication Strategy for Scheduling Precedence Constrained Graphs in Multiprocessor Systems , 2003, IEEE Trans. Parallel Distributed Syst..

[8]  Marco Aurélio Amaral Henriques,et al.  An Adaptive Scheduler for Grids , 2006, Journal of Grid Computing.

[9]  Hai Zhuge,et al.  The knowledge grid , 2004 .

[10]  Stephen A. Jarvis,et al.  Allocating non-real-time and soft real-time jobs in multiclusters , 2006, IEEE Transactions on Parallel and Distributed Systems.

[11]  Hai Zhuge,et al.  China's E-Science Knowledge Grid Environment , 2004, IEEE Intell. Syst..

[12]  Jiannong Cao,et al.  A framework of using cooperating mobile agents to achieve load sharing in distributed Web server groups , 2002, Fifth International Conference on Algorithms and Architectures for Parallel Processing, 2002. Proceedings..

[13]  Kristina Lerman,et al.  Resource Allocation in the Grid with Learning Agents , 2005, Journal of Grid Computing.

[14]  Hai Zhuge,et al.  A knowledge grid model and platform for global knowledge sharing , 2002, Expert Syst. Appl..

[15]  Yiwei Thomas Hou,et al.  On generalized max-min rate allocation and distributed convergence algorithm for packet networks , 2004, IEEE Transactions on Parallel and Distributed Systems.

[16]  Edward A. Lee,et al.  A Compile-Time Scheduling Heuristic for Interconnection-Constrained Heterogeneous Processor Architectures , 1993, IEEE Trans. Parallel Distributed Syst..

[17]  Ishfaq Ahmad,et al.  Optimal task assignment in heterogeneous distributed computing systems , 1998, IEEE Concurr..

[18]  Larry Carter,et al.  Scheduling strategies for master-slave tasking on heterogeneous processor platforms , 2004, IEEE Transactions on Parallel and Distributed Systems.

[19]  Christos Nikolaou,et al.  A fair workload allocation policy for heterogeneous systems , 2004, J. Parallel Distributed Comput..

[20]  Hai Zhuge,et al.  Resource Space Grid: model, method and platform , 2004, Concurr. Pract. Exp..

[21]  Jameela Al-Jaroodi,et al.  A comparative study of parallel and distributed Java projects for heterogeneous systems , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[22]  Xueyan Tang,et al.  Optimizing static job scheduling in a network of heterogeneous computers , 2000, Proceedings 2000 International Conference on Parallel Processing.

[23]  Dharma P. Agrawal,et al.  A task duplication based scheduling algorithm for heterogeneous systems , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[24]  Dharma P. Agrawal,et al.  Improving scheduling of tasks in a heterogeneous environment , 2004, IEEE Transactions on Parallel and Distributed Systems.

[25]  Weidong Xiao,et al.  Decentralized Grid Resource Discovery Based on Resource Information Community , 2004, Journal of Grid Computing.

[26]  Binoy Ravindran,et al.  Proactive resource allocation for asynchronous real-time distributed systems in the presence of processor failures , 2003, J. Parallel Distributed Comput..

[27]  Tiberiu Rotaru,et al.  Dynamic load balancing by diffusion in heterogeneous systems , 2004, J. Parallel Distributed Comput..

[28]  Ladislau Bölöni,et al.  Robust scheduling of metaprograms , 2002 .