A Workflow-based Computational Resource Broker with Information Monitoring in Grids

As grid computing becomes a reality, a resource broker is needed to manage and monitor available resources. This work presents a workflow-based computational resource broker whose main function is to match available resources with user requests and consider network information status during matchmaking. The resource broker provides a uniform interface for accessing available and the appropriate resources via user credentials. We utilize the NWS tool to monitor the network-related information and resources status. Also, we constructed a grid platform using Globus Toolkit that integrates the distributed resources of five universities in Taichung, Taiwan, where the resource broker is developed. As a result, the proposed broker provides secure and updated information about available resources and serves as a link to the diverse systems available in the grid

[1]  Rajkumar Buyya,et al.  KidneyGrid: a grid platform for integration of distributed kidney models and resources , 2006, MCG '06.

[2]  Ching-Hsien Hsu,et al.  On Utilization of the Grid Computing Technology for Video Conversion and 3D Rendering , 2005, ISPA.

[3]  Sang-Min Park,et al.  Chameleon: a resource scheduler in a data grid environment , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[5]  Geoffrey C. Fox,et al.  Proceedings of the 4th international conference on Grid and Cooperative Computing , 2005 .

[6]  Rajkumar Buyya,et al.  A Deadline and Budget Constrained Scheduling Algorithm for eScience Applications on Data Grids , 2005, ICA3PP.

[7]  John F. Karpovich,et al.  The Legion Resource Management System , 1999, JSSPP.

[8]  Wei Liu,et al.  A platform for distributed analysis of neuroimaging data on global grids , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[9]  Ian T. Foster,et al.  Resource co-allocation in computational grids , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[10]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[11]  G. Allen,et al.  The Cactus Code: a problem solving environment for the grid , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[12]  David Abramson,et al.  Executing Large Parameter Sweep Applications on a Multi-VO Testbed , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[13]  Francine Berman,et al.  The AppLeS Project: A Status Report , 1997 .

[14]  Rajkumar Buyya,et al.  An Integration of Global and Enterprise Grid Computing: Gridbus Broker and Xgrid Perspective , 2005, GCC.

[15]  Rajkumar Buyya,et al.  Grids and Grid technologies for wide‐area distributed computing , 2002, Softw. Pract. Exp..

[16]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[17]  Rajkumar Buyya,et al.  GridBank: a Grid Accounting Services Architecture (GASA) for distributed systems sharing and integration , 2002, Proceedings International Parallel and Distributed Processing Symposium.

[18]  Henri Casanova,et al.  UMR: a multi-round algorithm for scheduling divisible workloads , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[19]  Cris Kobryn,et al.  Architecting Systems with UML 2.0 , 2003, IEEE Softw..

[20]  Rajkumar Buyya,et al.  A novel architecture for realizing grid workflow using tuple spaces , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[21]  Wolfgang Gentzsch,et al.  Sun Grid Engine: towards creating a compute power grid , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[22]  Rajesh Raman,et al.  Matchmaking: distributed resource management for high throughput computing , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[23]  Chao-Tung Yang,et al.  Design and Implementation of TIGER Grid: an Integrated Metropolitan-Scale Grid Environment , 2005, Sixth International Conference on Parallel and Distributed Computing Applications and Technologies (PDCAT'05).

[24]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[25]  Chao-Tung Yang,et al.  An Efficient Network Information Model Using NWS for Grid Computing Environments , 2005, GCC.

[26]  Chao-Tung Yang,et al.  A high-performance computational resource broker for grid computing environments , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[27]  Massimo Lamanna,et al.  Experiences with the gLite Grid Middleware , 2005 .

[28]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[29]  Francine Berman,et al.  The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[30]  Warren Smith,et al.  A Resource Management Architecture for Metacomputing Systems , 1998, JSSPP.

[31]  Rajkumar Buyya,et al.  A Grid service broker for scheduling e‐Science applications on global data Grids , 2006, Concurr. Comput. Pract. Exp..

[32]  Rajkumar Buyya,et al.  The Australian BioGrid Portal: Empowering the Molecular Docking Research Community , 2005 .

[33]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[34]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[35]  Rajkumar Buyya,et al.  GTPE: A thread programming environment for the grid , 2005 .

[36]  Rajkumar Buyya,et al.  Grid-based indexing of a newswire corpus , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[37]  Jonathan Armstrong,et al.  Introduction to grid computing with globus , 2003 .

[38]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[39]  Chao-Tung Yang,et al.  A Resource Broker for Computing Nodes Selection in Grid Computing Environments , 2004, GCC.

[40]  Donald F. Ferguson,et al.  The WS-Resource Framework , 2004 .

[41]  Eduardo Huedo,et al.  A framework for adaptive execution in grids , 2004, Softw. Pract. Exp..

[42]  David Abramson,et al.  High performance parametric modeling with Nimrod/G: killer application for the global grid? , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[43]  Jarek Nabrzyski,et al.  GridLab--a grid application toolkit and testbed , 2002, Future Gener. Comput. Syst..

[44]  Ian T. Foster,et al.  A Grid-Enabled MPI: Message Passing in Heterogeneous Distributed Computing Systems , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[45]  David Abramson,et al.  Economic models for resource management and scheduling in Grid computing , 2002, Concurr. Comput. Pract. Exp..

[46]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[47]  Ian T. Foster,et al.  The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets , 2000, J. Netw. Comput. Appl..

[48]  David Abramson,et al.  An Evaluation of Economy-based Resource Trading and Scheduling on Computational Power Grids for Parameter Sweep Applications , 2000 .

[49]  Francine Berman,et al.  The GrADS Project: Software Support for High-Level Grid Application Development , 2001, Int. J. High Perform. Comput. Appl..

[50]  Ian T. Foster,et al.  DI-GRUBER: A Distributed Approach to Grid Resource Brokering , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[51]  Gregor von Laszewski,et al.  A Java commodity grid kit , 2001, Concurr. Comput. Pract. Exp..

[52]  Daniel A. Reed,et al.  Performance Contracts: Predicting and Monitoring Grid Application Behavior , 2001, GRID.

[53]  Minyi Guo,et al.  High-Performance Computing : Paradigm and Infrastructure , 2005 .

[54]  Rajkumar Buyya,et al.  Peer-to-Peer Grid Computing and a .NET-Based Alchemi Framework , 2006 .

[55]  Hans Eriksson,et al.  Business Modeling With UML: Business Patterns at Work , 2000 .

[56]  W. Allcock,et al.  GridFTP protocol specification , 2002 .

[57]  Douglas Thain,et al.  The Kangaroo approach to data movement on the Grid , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[58]  Andrew L. Wendelborn,et al.  A Data-Aware Resource Broker for Data Grids , 2004, NPC.

[59]  David F. Snelling,et al.  UNICORE—a Grid computing environment , 2002, Concurr. Comput. Pract. Exp..

[60]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[61]  Larry Rudolph,et al.  Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing , 1995 .

[62]  Mitsuhisa Sato,et al.  Design and implementations of Ninf: towards a global computing infrastructure , 1999, Future Gener. Comput. Syst..

[63]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[64]  Ian T. Foster,et al.  Data management and transfer in high-performance computational grid environments , 2002, Parallel Comput..

[65]  Ian Foster,et al.  The Grid: A New Infrastructure for 21st Century Science , 2002 .

[66]  David Abramson,et al.  Nimrod: a tool for performing parametrised simulations using distributed workstations , 1995, Proceedings of the Fourth IEEE International Symposium on High Performance Distributed Computing.

[67]  David A. Kramer,et al.  Utilization of a local grid of Mac OS X-based computers using Xgrid , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[68]  Miron Livny,et al.  Stork: making data placement a first class citizen in the grid , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[69]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[70]  Rajkumar Buyya,et al.  A Market-Oriented Grid Directory Service for Publication and Discovery of Grid Service Providers and their Services , 2006, The Journal of Supercomputing.

[71]  Henri Casanova,et al.  NetSovle: A Network Server for Solving Computational Science Problems , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[72]  Steven Tuecke,et al.  Protocols and services for distributed data-intensive science , 2002 .