Network Bandwidth-aware job scheduling with dynamic information model for Grid resource brokers

A resource broker with a user-friendly interface for job submission developed on a platform constructed using the Globus toolkit is proposed. The broker employs a domain-based network information model and dynamic version to measure network statuses, and also monitors and collects resource statuses and network-related information as the basis of its brokerage. A network bandwidth-aware job scheduling algorithm for brokering suitable Grid resources to communication-intensive jobs based on improving and preserving the advantages of our previously developed network information model is also proposed. Using timely information, the resource broker effectively matches Grid resources and user requests, thus improving job execution efficiency.

[1]  Chao-Tung Yang,et al.  Detection workload in a dynamic grid-based intrusion detection environment , 2008, J. Parallel Distributed Comput..

[2]  Ian T. Foster,et al.  MPICH-G2: A Grid-enabled implementation of the Message Passing Interface , 2002, J. Parallel Distributed Comput..

[3]  Chien-Min Wang,et al.  The Development of a Drug Discovery Virtual Screening Application on Taiwan Unigrid , 2008, GPC.

[4]  Jarek Nabrzyski,et al.  Grid Resource Management , 2004 .

[5]  Ching-Hsien Hsu,et al.  On Utilization of the Grid Computing Technology for Video Conversion and 3D Rendering , 2005, ISPA.

[6]  Jesús Labarta,et al.  eNANOS Grid Resource Broker , 2005, EGC.

[7]  Chao-Tung Yang,et al.  Implementation of Monitoring and Information Service Using Ganglia and NWS for Grid Resource Brokers , 2007, The 2nd IEEE Asia-Pacific Service Computing Conference (APSCC 2007).

[8]  Gregor von Laszewski,et al.  Workflow Concepts of the Java CoG Kit , 2005, Journal of Grid Computing.

[9]  Chao-Tung Yang,et al.  Design and Implementation of TIGER Grid: an Integrated Metropolitan-Scale Grid Environment , 2005, Sixth International Conference on Parallel and Distributed Computing Applications and Technologies (PDCAT'05).

[10]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[11]  Chao-Tung Yang,et al.  An Efficient Network Information Model Using NWS for Grid Computing Environments , 2005, GCC.

[12]  Chao-Tung Yang,et al.  A high-performance computational resource broker for grid computing environments , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[13]  Guihai Chen,et al.  An Active Resource Management System for Computational Grid , 2004, GCC.

[14]  Chao-Tung Yang,et al.  A Workflow-based Computational Resource Broker with Information Monitoring in Grids , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing (GCC'06).

[15]  Gregor von Laszewski,et al.  A Java commodity grid kit , 2001, Concurr. Comput. Pract. Exp..

[16]  Italo Epicoco,et al.  The Grid Resource Broker portal , 2007, Concurr. Comput. Pract. Exp..

[17]  Andrew L. Wendelborn,et al.  A Data-Aware Resource Broker for Data Grids , 2004, NPC.

[18]  Rajkumar Buyya,et al.  A taxonomy and survey of grid resource management systems for distributed computing , 2002, Softw. Pract. Exp..

[19]  Chao-Tung Yang,et al.  A Resource Broker for Computing Nodes Selection in Grid Computing Environments , 2004, GCC.

[20]  Sang-Min Park,et al.  Chameleon: a resource scheduler in a data grid environment , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[21]  Ian T. Foster,et al.  A Grid-Enabled MPI: Message Passing in Heterogeneous Distributed Computing Systems , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[22]  R. V. van Nieuwpoort,et al.  The Grid 2: Blueprint for a New Computing Infrastructure , 2003 .

[23]  Italo Epicoco,et al.  The Grid Resource BrokerWorkflow Engine , 2007, Sixth International Conference on Grid and Cooperative Computing (GCC 2007).

[24]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[25]  Italo Epicoco,et al.  The Grid Resource Broker workflow engine , 2008, Concurr. Comput. Pract. Exp..

[26]  Jonathan Armstrong,et al.  Introduction to grid computing with globus , 2003 .

[27]  Ian Foster,et al.  The Grid: A New Infrastructure for 21st Century Science , 2002 .

[28]  Tao Xu,et al.  Pegasys: software for executing and integrating analyses of biological sequences , 2004, BMC Bioinformatics.

[29]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[30]  Chao-Tung Yang,et al.  Design and implementation of a workflow-based resource broker with information system on computational grids , 2008, The Journal of Supercomputing.

[31]  Massimo Cafaro,et al.  Web‐based access to the Grid using the Grid Resource Broker portal , 2002, Concurr. Comput. Pract. Exp..

[32]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[33]  Rajkumar Buyya,et al.  A Grid service broker for scheduling e‐Science applications on global data Grids , 2006, Concurr. Comput. Pract. Exp..