Architectural Elements of Resource Sharing Networks

This chapter first presents taxonomies on approaches for resource allocation across resource sharing networks such as Grids. It then examines existing systems and classifies them under their architectures, operational models, support for the life-cycle of virtual organisations, and resource control techniques. Resource sharing networks have been established and used for various scientific applications over the last decade. The early ideas of Grid computing have foreseen a global and scalable network that would provide users with resources on demand. In spite of the extensive literature on resource allocation and scheduling across organisational boundaries, these resource sharing networks mostly work in isolation, thus contrasting with the original idea of Grid computing. Several efforts have been made towards providing architectures, mechanisms, policies and standards that may enable resource allocation across Grids. A survey and classification of these systems are relevant for the understanding of different approaches utilised for connecting resources across organisations and virtualisation techniques. In addition, a classification also sets the ground for future work on inter-operation of Grids.

[1]  Ian T. Foster,et al.  DI-GRUBER: A Distributed Approach to Grid Resource Brokering , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[2]  A. Shoykhet,et al.  Virtuoso: A System For VirtualMachineMarketplaces , 2004 .

[3]  Andrew A. Chien,et al.  Using virtual grids to simplify application scheduling , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[4]  Kang G. Shin,et al.  Adaptive control of virtualized resources in utility computing environments , 2007, EuroSys '07.

[5]  David E. Irwin,et al.  Sharing Networked Resources with Brokered Leases , 2006, USENIX Annual Technical Conference, General Track.

[6]  Yao-Ming Yeh,et al.  Dynamic Rightsizing with Quality-Controlled Algorithms in Virtualization Environments , 2011, Int. J. Grid High Perform. Comput..

[7]  Ian T. Foster,et al.  A model for usage policy-based resource allocation in grids , 2005, Sixth IEEE International Workshop on Policies for Distributed Systems and Networks (POLICY'05).

[8]  Thomas Rauber,et al.  Mixed Parallel Programming Models Using Parallel Tasks , 2010 .

[9]  Viet Dung Dang Coalition formation and operation in virtual organisations , 2004 .

[10]  José Luis Vázquez-Poletti,et al.  A comparison between two grid scheduling philosophies: EGEE WMS and Grid Way , 2007, Multiagent Grid Syst..

[11]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[12]  Rajkumar Buyya,et al.  InterGrid: a case for internetworking islands of Grids , 2008 .

[13]  Rajkumar Buyya,et al.  Fair resource sharing in hierarchical virtual organizations for global grids , 2007, 2007 8th IEEE/ACM International Conference on Grid Computing.

[14]  Alan A. Bertossi,et al.  Scalable Algorithms for Server Allocation in Infostations , 2008 .

[15]  Miron Livny,et al.  A worldwide flock of Condors: Load sharing among workstation clusters , 1996, Future Gener. Comput. Syst..

[16]  Axel Keller,et al.  Managing Clusters of Geographically Distributed High-Performance Computers , 1999 .

[17]  Dongyan Xu,et al.  VioCluster: Virtualization for Dynamic Computational Domains , 2005, 2005 IEEE International Conference on Cluster Computing.

[18]  Hamideh Afsarmanesh,et al.  Virtual Organizations: Systems and Practices , 2004 .

[19]  Y. Charlie Hu,et al.  A Self-Organizing Flock of Condors , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[20]  Amin Vahdat,et al.  SHARP: an architecture for secure resource peering , 2003, SOSP '03.

[21]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[22]  L. Smarr,et al.  Metacomputing : Siggraph'92 Showcase , 1992 .

[23]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[24]  Xuxian Jiang,et al.  Virtual distributed environments in a shared infrastructure , 2005, Computer.

[25]  Rajkumar Buyya,et al.  A Case for Cooperative and Incentive-Based Coupling of Distributed Clusters , 2005, 2005 IEEE International Conference on Cluster Computing.

[26]  Rajkumar Buyya,et al.  A Decentralized and Cooperative Workflow Scheduling Algorithm , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[27]  Eduardo Huedo,et al.  A framework for adaptive execution in grids , 2004, Softw. Pract. Exp..

[28]  Rajkumar Buyya,et al.  Performance analysis of multiple site resource provisioning: effects of the precision of availability information , 2008, HiPC'08.

[29]  Denis Caromel,et al.  Peer-to-peer for computational grids: mixing clusters and desktop machines , 2007, Parallel Comput..

[30]  Arvind Krishnamurthy,et al.  Tit-for-Tat Distributed Resource Allocation , 2006 .

[31]  Ian T. Foster,et al.  Virtual workspaces: Achieving quality of service and quality of life in the Grid , 2005, Sci. Program..

[32]  Christian Grimme,et al.  Prospects of Collaboration between Compute Providers by Means of Job Interchange , 2007, JSSPP.

[33]  Erik Elmroth,et al.  Design and evaluation of a decentralized system for grid-wide fairshare scheduling , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[34]  Ian T. Foster,et al.  GRUBER: A Grid Resource Usage SLA Broker , 2005, Euro-Par.

[35]  Péter Kacsuk,et al.  Grid interoperability by multiple broker utilization and meta-brokering , 2009 .

[36]  Xiaomin Zhu,et al.  From virtualized resources to virtual computing grids: the In-VIGO system , 2005, Future Gener. Comput. Syst..

[37]  Uwe Schwiegelshohn,et al.  Resource Allocation and Scheduling in Metasystems , 1999, HPCN Europe.

[38]  Dongyan Xu,et al.  Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure , 2006, 2006 IEEE International Conference on Autonomic Computing.

[39]  Ian T. Foster,et al.  Usage policy-based CPU sharing in virtual organizations , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[40]  Rajkumar Buyya,et al.  Performance analysis of allocation policies for interGrid resource provisioning , 2009, Inf. Softw. Technol..

[41]  Borja Sotomayor,et al.  Virtual Clusters for Grid Communities , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[42]  Yongjian Wang,et al.  Interconnect EGEE and CNGRID e-Infrastructures through Interoperability between gLite and GOS Middlewares , 2007, Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007).

[43]  David E. Irwin,et al.  Dynamic virtual clusters in a grid site manager , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[44]  Bang Wang,et al.  Distributed Scheduling Protocols for Energy Efficient Large-Scale Wireless Sensor Networks , 2009 .

[45]  E. Huedo,et al.  Dynamic Deployment of Custom Execution Environments in Grids , 2008, 2008 The Second International Conference on Advanced Engineering Computing and Applications in Sciences.

[46]  Dick Epema,et al.  KOALA: a co-allocating grid scheduler , 2008 .

[47]  Nazareno Andrade,et al.  Automatic grid assembly by promoting collaboration in peer-to-peer grids , 2007, J. Parallel Distributed Comput..

[48]  Robert Ricci,et al.  Lessons from resource allocators for large-scale multiuser testbeds , 2006, OPSR.

[49]  Alexandros Stamatakis,et al.  Large-Scale Co-Phylogenetic Analysis on the Grid , 2009, Int. J. Grid High Perform. Comput..

[50]  Karim Djemame,et al.  A SNAP-Based Community Resource Broker Using a Three-Phase Commit Protocol: A Performance Study , 2005, Comput. J..

[51]  Marty Humphrey,et al.  Policy and enforcement in virtual organizations , 2003, Proceedings. First Latin American Web Congress.

[52]  Alexandru Iosup,et al.  Inter-operating grids through delegated matchmaking , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[53]  Jeffrey S. Chase,et al.  Extensible resource management for networked virtual computing , 2007 .

[54]  Nazareno Andrade,et al.  OurGrid: An Approach to Easily Assemble Grids with Equitable Resource Sharing , 2003, JSSPP.

[55]  Sandro Zappatore,et al.  Grid Enabled Remote Instrumentation , 2008 .

[56]  Nik Bessis,et al.  Defining Minimum Requirements of Inter-collaborated Nodes by Measuring the Weight of Node Interactions , 2010, 2010 International Conference on Complex, Intelligent and Software Intensive Systems.

[57]  Ciprian Dobre,et al.  A Failure Detection System for Large Scale Distributed Systems , 2010, 2010 International Conference on Complex, Intelligent and Software Intensive Systems.

[58]  Lien Fu Lai,et al.  Efficient Management of Fragmented Replica in Data Grids , 2012, Int. J. Grid High Perform. Comput..

[59]  Alun D. Preece,et al.  Agent-based virtual organisations for the Grid , 2005, AAMAS '05.

[60]  David Abramson,et al.  Persistence and communication state transfer in an asynchronous pipe mechanism , 2007, 2007 International Conference on Parallel and Distributed Systems.

[61]  Alun D. Preece,et al.  Agent-based formation of virtual organisations , 2004, Knowl. Based Syst..

[62]  David Abramson,et al.  An Economy Driven Resource Management Architecture for Global Computational Power Grids , 2000, PDPTA.

[63]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[64]  Andrew Warfield,et al.  Xen and the art of virtualization , 2003, SOSP '03.

[65]  Michael Stonebraker,et al.  Contract-Based Load Management in Federated Distributed Systems , 2004, NSDI.

[66]  M. Siddiqui,et al.  Grid Capacity Planning with Negotiation-based Advance Reservation for Optimized QoS , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[67]  L. Ramakrishnan,et al.  Toward a Doctrine of Containment: Grid Hosting with Adaptive Resource Control , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[68]  Christopher Metz On the Wire: Interconnecting ISP Networks , 2001, IEEE Internet Comput..

[69]  Rajkumar Buyya,et al.  SLA-Based Coordinated Superscheduling Scheme for Computational Grids , 2006, 2006 IEEE International Conference on Cluster Computing.

[70]  Eduardo Huedo,et al.  Management of Virtual Machines on Globus Grids Using GridWay , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[71]  Jack Dongarra,et al.  Handbook of Research on Scalable Computing Technologies , 2009 .

[72]  Shantenu Jha,et al.  NEKTAR, SPICE and Vortonics: using federated grids for large scale scientific applications , 2006, 2006 IEEE Challenges of Large Applications in Distributed Environments.

[73]  Theo Dimitrakos,et al.  Towards a Trust and Contract Management Framework for Dynamic Virtual Organisations , 2004 .

[74]  Anne E. Trefethen,et al.  The UK e-Science Core Programme and the Grid , 2002, Future Gener. Comput. Syst..