Resource brokering using a multi‐site resource allocation strategy for computational grids

Grid computing employs heterogeneous resources which may be installed on different platforms, hardware/software, computer architectures, and perhaps using different computer languages to solve large‐scale computational problems. As many more Grids are being developed worldwide, the number of multi‐institutional collaborations is growing rapidly. However, to realize Grid computing's full potential, it is expected that Grid participants must be able to share one another's resources. This paper presents a resource broker that employs the multi‐site resource allocation (MSRA) strategy and the dynamic domain‐based network information model that we propose to allocate Grid resources to submitted jobs, where the Grid resources may be dispersed at different sites, and owned and governed by different organizations or institutes. The jobs and resources may also belong to different clusters/sites. Resource statuses collected by the Ganglia, and network bandwidths gathered by the Network Weather Service, are both considered in the proposed scheduling approach. A dynamic domain‐based model for network information measurement is also proposed to choose the most appropriate resources that meet the jobs' execution requirements. Experimental results show that MSRA outperformed the other tested strategies. Copyright © 2010 John Wiley & Sons, Ltd.

[1]  Abraham Silberschatz,et al.  Operating System Concepts , 1983 .

[2]  Sang-Min Park,et al.  Chameleon: a resource scheduler in a data grid environment , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[3]  Morris Riedel,et al.  DEISA—Distributed European Infrastructure for Supercomputing Applications , 2011, Journal of Grid Computing.

[4]  Massimo Cafaro,et al.  Web‐based access to the Grid using the Grid Resource Broker portal , 2002, Concurr. Comput. Pract. Exp..

[5]  Toru Sugiyama,et al.  The Earth Simulator Center , 2009 .

[6]  Ian T. Foster,et al.  A Grid-Enabled MPI: Message Passing in Heterogeneous Distributed Computing Systems , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[7]  Dick H. J. Epema,et al.  KOALA: a co‐allocating grid scheduler , 2008, Concurr. Comput. Pract. Exp..

[8]  Gregor von Laszewski,et al.  A Java commodity grid kit , 2001, Concurr. Comput. Pract. Exp..

[9]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[10]  Dick Epema,et al.  KOALA: a co-allocating grid scheduler , 2008 .

[11]  Carl M. Harris,et al.  Fundamentals of Queueing Theory: Gross/Fundamentals of Queueing Theory , 2008 .

[12]  Erwin Laure,et al.  Enabling Grids for e-Science : The EGEE Project , 2008, Grid 2008.

[13]  Ian T. Foster,et al.  MPICH-G2: A Grid-enabled implementation of the Message Passing Interface , 2002, J. Parallel Distributed Comput..

[14]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[15]  Jarek Nabrzyski,et al.  Grid Resource Management , 2004 .

[16]  Jonathan Armstrong,et al.  Introduction to grid computing with globus , 2003 .

[17]  Chao-Tung Yang,et al.  Network Bandwidth-aware job scheduling with dynamic information model for Grid resource brokers , 2008, 2008 IEEE Asia-Pacific Services Computing Conference.

[18]  Chao-Tung Yang,et al.  A Domain-Based Model for Efficient Measurement of Network Information on Grid Computing Environments , 2006, IEICE Trans. Inf. Syst..

[19]  Jesús Labarta,et al.  eNANOS Grid Resource Broker , 2005, EGC.

[20]  Chao-Tung Yang,et al.  An Efficient Network Information Model Using NWS for Grid Computing Environments , 2005, GCC.

[21]  Chao-Tung Yang,et al.  A high-performance computational resource broker for grid computing environments , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[22]  Ivan Rodero,et al.  Data Model for Describing Grid Resource Broker Capabilities , 2008 .

[23]  Johan Tordsson,et al.  Grid resource brokering algorithms enabling advance reservations and resource selection based on performance predictions , 2008, Future Gener. Comput. Syst..

[24]  Péter Kacsuk,et al.  Multi-Grid, Multi-User Workflows in the P-GRADE Grid Portal , 2005, Journal of Grid Computing.

[25]  Chao-Tung Yang,et al.  A Workflow-based Computational Resource Broker with Information Monitoring in Grids , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing (GCC'06).

[26]  Anca I. D. Bucur,et al.  Trace-based simulations of processor co-allocation policies in multiclusters , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[27]  Elisa Heymann,et al.  Supporting Efficient Execution of MPI Applications Across Multiple Sites , 2006, Euro-Par.

[28]  Rajkumar Buyya,et al.  A taxonomy and survey of grid resource management systems for distributed computing , 2002, Softw. Pract. Exp..

[29]  Chao-Tung Yang,et al.  A Resource Broker for Computing Nodes Selection in Grid Computing Environments , 2004, GCC.

[30]  Anca I. D. Bucur,et al.  Scheduling Policies for Processor Coallocation in Multicluster Systems , 2007, IEEE Transactions on Parallel and Distributed Systems.

[31]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[32]  David E. Culler,et al.  Wide area cluster monitoring with Ganglia , 2003, 2003 Proceedings IEEE International Conference on Cluster Computing.

[33]  Rajkumar Buyya,et al.  A Grid service broker for scheduling e‐Science applications on global data Grids , 2006, Concurr. Comput. Pract. Exp..

[34]  Chao-Tung Yang,et al.  A resource broker with an efficient network information model on grid environments , 2007, The Journal of Supercomputing.

[35]  Chao-Tung Yang,et al.  Design and Implementation of TIGER Grid: an Integrated Metropolitan-Scale Grid Environment , 2005, Sixth International Conference on Parallel and Distributed Computing Applications and Technologies (PDCAT'05).

[36]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[37]  Chao-Tung Yang,et al.  Implementation of Monitoring and Information Service Using Ganglia and NWS for Grid Resource Brokers , 2007, The 2nd IEEE Asia-Pacific Service Computing Conference (APSCC 2007).

[38]  Peter B. Galvin,et al.  Operating System Concepts, 4th Ed. , 1993 .

[39]  K. Aki,et al.  What is the Southern California Earthquake Center , 1991 .

[40]  Chao-Tung Yang,et al.  Detection workload in a dynamic grid-based intrusion detection environment , 2008, J. Parallel Distributed Comput..

[41]  Chao-Tung Yang,et al.  A Multi-site Resource Allocation Strategy in Computational Grids , 2008, GPC.