Multi-cost job routing and scheduling in Grid networks

A key problem in Grid networks is how to efficiently manage the available infrastructure, in order to satisfy user requirements and maximize resource utilization. This is in large part influenced by the algorithms responsible for the routing of data and the scheduling of tasks. In this paper, we present several multi-cost algorithms for the joint scheduling of the communication and computation resources that will be used by a Grid task. We propose a multi-cost scheme of polynomial complexity that performs immediate reservations and selects the computation resource to execute the task and determines the path to route the input data. Furthermore, we introduce multi-cost algorithms that perform advance reservations and thus also find the starting times for the data transmission and the task execution. We initially present an optimal scheme of non-polynomial complexity and by appropriately pruning the set of candidate paths we also give a heuristic algorithm of polynomial complexity. Our performance results indicate that in a Grid network in which tasks are either CPU- or data-intensive (or both), it is beneficial for the scheduling algorithm to jointly consider the computational and communication problems. A comparison between immediate and advance reservation schemes shows the trade-offs with respect to task blocking probability, end-to-end delay and the complexity of the algorithms.

[1]  Subhash Saini,et al.  GridFlow: workflow management for grid computing , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[2]  Asit Dan,et al.  Web services agreement specification (ws-agreement) , 2004 .

[3]  Jon Crowcroft,et al.  Quality-of-Service Routing for Supporting Multimedia Applications , 1996, IEEE J. Sel. Areas Commun..

[4]  Weijia Jia,et al.  A Routing Protocol for Anycast Messages , 2000, IEEE Trans. Parallel Distributed Syst..

[5]  Ian T. Foster,et al.  Resource co-allocation in computational grids , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[6]  Achim Streit,et al.  Unicore - From project results to production grids , 2005, High Performance Computing Workshop.

[7]  Miron Livny,et al.  Condor: a distributed job scheduler , 2001 .

[8]  Piet Van Mieghem,et al.  Conditions that impact the complexity of QoS routing , 2005, IEEE/ACM Transactions on Networking.

[9]  Ming Tang,et al.  The impact of data replication on job scheduling performance in the Data Grid , 2006, Future Gener. Comput. Syst..

[10]  Fernando Kuipers,et al.  Quality of Service Routing in the Internet. Theory, Complexity and Algorithms , 2004 .

[11]  Klara Nahrstedt,et al.  A distributed resource management architecture that supports advance reservations and co-allocation , 1999, 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354).

[12]  Emmanouel Varvarigos,et al.  An Efficient Reservation Connection Control Protocol for Gigabit Networks , 1998, Comput. Networks.

[13]  Christoph Barz,et al.  Timeslot-based resource management in grid environments , 2008 .

[14]  Sanjay Jha,et al.  G-QoSM: Grid Service Discovery Using QoS Properties , 2002, Comput. Artif. Intell..

[15]  Konstantinos Christodoulopoulos,et al.  Routing and scheduling connections in networks that support advance reservations , 2008, Comput. Networks.

[16]  Ariel Orda,et al.  Networks with advance reservations: the routing perspective , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[17]  Piet Van Mieghem,et al.  Hop-by-hop quality of service routing , 2001, Comput. Networks.

[18]  William E. Johnston,et al.  Computational and data Grids in large-scale science and engineering , 2002, Future Gener. Comput. Syst..

[19]  Rajkumar Buyya,et al.  A grid service broker for scheduling distributed data-oriented applications on global grids , 2004, MGC '04.

[20]  Piet Van Mieghem,et al.  Concepts of exact QoS routing algorithms , 2004, IEEE/ACM Transactions on Networking.

[21]  Rajesh Raman,et al.  Policy driven heterogeneous resource co-allocation with Gangmatching , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[22]  Rajkumar Buyya,et al.  The Gridbus toolkit for service oriented grid and utility computing: an overview and status report , 2004, 1st IEEE International Workshop on Grid Economics and Business Models, 2004. GECON 2004..

[23]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[24]  Lars-Olof Burchard,et al.  Analysis of data structures for admission control of advance reservation requests , 2005, IEEE Transactions on Knowledge and Data Engineering.

[25]  BuyyaRajkumar,et al.  A taxonomy of scientific workflow systems for grid computing , 2005 .

[26]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[27]  Klara Nahrstedt,et al.  On finding multi-constrained paths , 1998, ICC '98. 1998 IEEE International Conference on Communications. Conference Record. Affiliated with SUPERCOMM'98 (Cat. No.98CH36220).

[28]  Thomas Röblitz,et al.  Co-reservation with the concept of virtual resources , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[29]  William Gropp,et al.  Beowulf Cluster Computing with Linux , 2003 .

[30]  Bruno Volckaert,et al.  A view on enabling-consumer oriented grids through optical burst switching , 2006, IEEE Communications Magazine.

[31]  Ruay-Shiung Chang,et al.  Job scheduling and data replication on data grids , 2007, Future Gener. Comput. Syst..