Trade-offs in matching jobs and balancing load for distributed desktop grids

Desktop grids can achieve tremendous computing power at low cost through opportunistic sharing of resources. However, traditional client-server Grid architectures do not deal with all types of failures, and do not always cope well with very dynamic environments. This paper describes the design of a desktop grid implemented over a modified Peer-to-Peer (P2P) architecture. The underlying P2P system is decentralized and inherently adaptable, giving the Grid robustness, scalability, and the ability to cope with dynamic environments, while still efficiently mapping application instances to available resources throughout the system. We use simulation to compare three different types of matching algorithms under differing workloads. Overall, the P2P approach produces significantly lower wait times than prior approaches, while adapting efficiently to the dynamic environment.

[1]  Indranil Gupta,et al.  Peer-to-peer discovery of computational resources for Grid applications , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[2]  Artur Andrzejak,et al.  Scalable, efficient range queries for grid information services , 2002, Proceedings. Second International Conference on Peer-to-Peer Computing,.

[3]  John A. Miller,et al.  Java , 1977, Itinerario.

[4]  Bobby Bhattacharjee,et al.  Using content-addressable networks for load balancing in desktop grids , 2007, HPDC '07.

[5]  Amin Vahdat,et al.  Design and implementation tradeoffs for wide-area resource discovery , 2005, HPDC.

[6]  Virginia Mary Lo,et al.  WaveGrid: a scalable fast-turnaround heterogeneous peer-based desktop grid system , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[7]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[8]  Domenico Talia,et al.  P2P computing and interaction with grids , 2005, Future Gener. Comput. Syst..

[9]  B. Allen,et al.  Designing a Runtime System for Volunteer Computing , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[10]  Srinivasan Seshan,et al.  Mercury: supporting scalable multi-attribute range queries , 2004, SIGCOMM '04.

[11]  Arun K. Somani,et al.  CompuP2P: An Architecture for Internet Computing Using Peer-to-Peer Networks , 2006, IEEE Transactions on Parallel and Distributed Systems.

[12]  Miron Livny,et al.  A worldwide flock of Condors: Load sharing among workstation clusters , 1996, Future Gener. Comput. Syst..

[13]  Bobby Bhattacharjee,et al.  Resource Discovery Techniques in Distributed Desktop Grid Environments , 2006, GRID.

[14]  Virginia Mary Lo,et al.  2004 Ieee International Symposium on Cluster Computing and the Grid Cluster Computing on the Fly: Resource Discovery in a Cycle Sharing Peer-to-peer System , 2022 .

[15]  Bobby Bhattacharjee,et al.  Matching Jobs to Resources in Distributed Desktop Grid Environments , 2006 .

[16]  Bobby Bhattacharjee,et al.  Creating a Robust Desktop Grid using Peer-to-Peer Services , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[17]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[18]  Ian Foster,et al.  A peer-to-peer approach to resource location in grid environments , 2002 .

[19]  Thomas Hérault,et al.  Computing on large-scale distributed systems: XtremWeb architecture, programming models, security, tests and convergence with grid , 2005, Future Gener. Comput. Syst..

[20]  Samuel P. Midkiff,et al.  Java, Peer-to-Peer, and Accountability: Building Blocks for Distributed Cycle Sharing , 2004, Virtual Machine Research and Technology Symposium.

[21]  Gary Carpenter.  동적 사용자를 위한 Scalable 인증 그룹 키 교환 프로토콜 , 2005 .

[22]  Domenico Talia,et al.  Peer-to-Peer resource discovery in Grids: Models and systems , 2007, Future Gener. Comput. Syst..

[23]  Jarek Nabrzyski,et al.  Grid resource management: state of the art and future trends , 2004 .

[24]  Sandhya Dwarkadas,et al.  Peer-to-peer information retrieval using self-organizing semantic overlay networks , 2003, SIGCOMM '03.

[25]  Daniel Zappala,et al.  Cluster Computing on the Fly : P 2 P Scheduling of Idle Cycles in the Internet , 2004 .

[26]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[27]  Andrew A. Chien,et al.  Entropia: architecture and performance of an enterprise desktop grid system , 2003, J. Parallel Distributed Comput..

[28]  Pedro A. Szekely,et al.  MAAN: A Multi-Attribute Addressable Network for Grid Information Services , 2003, Proceedings. First Latin American Web Congress.

[29]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.