Studying the Influence of Network-Aware Grid Scheduling on the Performance Received by Users

Grid computing is the key enabling technology to aggregate geographically distributed resources in the context of a particular application. As Grids are extremely distributed systems, requirements on the communication network should also be taken into account when performing usual tasks such as scheduling, migrating or monitoring of jobs. Note that users, services, and data need to communicate with each other over networks, thus the network should be used in an efficient and fault-tolerant way. There are Grid schedulers that consider the network when performing their tasks, but the way they have been implemented does not allow easy extensions. Thus, they are not suitable to be modified and try different scheduling approaches. The authors have extended the GridWay metascheduler to perform scheduling considering the network status. This is the first step in order to proceed with more complicated and efficient scheduling and reservation processes. In this work, the extension has been evaluated by means of a testbed, in which users simultaneously submit different jobs with different frequencies to GridWay. Results presented here show that the response time perceived by Grid users is reduced when data on network performance are considered in the job scheduling process.

[1]  Sanjay Jha,et al.  Bandwidth Broker Implementation : Circa-Complete and Integrable , 2007 .

[2]  Rajkumar Buyya,et al.  A Grid service broker for scheduling e‐Science applications on global data Grids , 2006, Concurr. Comput. Pract. Exp..

[3]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[4]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[5]  Chen-Hsiu Huang Video Transcoding Architectures and Techniques : An Overview , 2003 .

[6]  Ian T. Foster,et al.  A secure communications infrastructure for high-performance distributed computing , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).

[7]  Wolfgang Ziegler,et al.  A Meta-scheduling Service for Co-allocating Arbitrary Types of Resources , 2005, PPAM.

[8]  Ian T. Foster,et al.  Globus Toolkit Version 4: Software for Service-Oriented Systems , 2005, Journal of Computer Science and Technology.

[9]  Michael Thomas,et al.  Data Intensive and Network Aware (DIANA) Grid Scheduling , 2007, Journal of Grid Computing.

[10]  Ian T. Foster,et al.  End-to-end quality of service for high-end applications , 2004, Comput. Commun..

[11]  Kaizar Amin,et al.  Network QoS provision for distributed grid applications , 2004 .

[12]  David H. Bailey,et al.  The Nas Parallel Benchmarks , 1991, Int. J. High Perform. Comput. Appl..

[13]  Eduardo Huedo,et al.  A modular meta-scheduling architecture for interfacing with pre-WS and WS Grid resource management services , 2007, Future Gener. Comput. Syst..

[14]  Richard McClatchey,et al.  Scheduling in Data Intensive and Network Aware (DIANA) Grid Environments , 2007, ArXiv.

[15]  Warren Smith,et al.  A directory service for configuring high-performance distributed computations , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).

[16]  R. V. van Nieuwpoort,et al.  The Grid 2: Blueprint for a New Computing Infrastructure , 2003 .

[17]  María Blanca Caminero,et al.  An autonomic network-aware scheduling architecture for grid computing , 2007, MGC '07.

[18]  Michael A. Frumkin,et al.  NAS Grid Benchmarks: A Tool for Grid Space Exploration , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[19]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[20]  Jarek Nabrzyski,et al.  Dynamic grid scheduling with job migration and rescheduling in the GridLab resource management system , 2004, Sci. Program..

[21]  Xiaohui Wei,et al.  CSF4: A WSRF Compliant Meta-Scheduler , 2006, GCA.

[22]  Francis T. Marchese,et al.  Fostering Asynchronous Collaborative Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).