The ShareGrid Peer-to-Peer Desktop Grid: Infrastructure, Applications, and Performance Evaluation

Peer-to-Peer (P2P) Desktop Grids are computing infrastructures that aggregate a set of desktop-class machines in which all the participating entities have the same roles, responsibilities, and rights. In this paper, we present ShareGrid, a P2P Desktop Grid infrastructure based on the OurGrid middleware, that federates the resources provided by a set of small research laboratories to easily share and use their computing resources. We discuss the techniques and tools we employed to ensure scalability, efficiency, and usability, and describe the various applications used on it. We also demonstrate the ability of ShareGrid of providing good performance and scalability by reporting the results of experimental evaluations carried out by running various applications with different resource requirements. Our experience with ShareGrid indicates that P2P Desktop Grids can represent an effective answer to the computing needs of small research laboratories, as long as they provide both ease of management and use, and good scalability and performance.

[1]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[2]  Joel R. Stiles,et al.  Monte Carlo simulation of neuro-transmitter release using MCell, a general simulator of cellular physiological processes , 1998 .

[3]  Gage Js,et al.  The great Internet Mersenne prime search. , 1998 .

[4]  David Abramson,et al.  High performance parametric modeling with Nimrod/G: killer application for the global grid? , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[5]  Francine Berman,et al.  The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[6]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[7]  Gilles Fedak,et al.  XtremWeb: a generic global computing system , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[8]  Gregor von Laszewski,et al.  A Java commodity grid kit , 2001, Concurr. Comput. Pract. Exp..

[9]  Geoffrey C. Fox,et al.  Special Issue: ACM 2000 Java Grande Conference , 2001, Concurr. Comput. Pract. Exp..

[10]  Francine Berman,et al.  Applying scheduling and tuning to on-line parallel tomography , 2001, SC '01.

[11]  Greg Ruetsch,et al.  Framework for Peer-to-Peer Distributed Computing in a Heterogeneous, Decentralized Environment , 2002, GRID.

[12]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[13]  Mathilde Romberg,et al.  The UNICORE Grid infrastructure , 2002, Sci. Program..

[14]  Hein Meling,et al.  Messor: Load-Balancing through a Swarm of Autonomous Agents , 2002, AP2PC.

[15]  Nazareno Andrade,et al.  OurGrid: An Approach to Easily Assemble Grids with Equitable Resource Sharing , 2003, JSSPP.

[16]  Francisco Vilar Brasileiro,et al.  Trading Cycles for Information: Using Replication to Schedule Bag-of-Tasks Applications on Computational Grids , 2003, Euro-Par.

[17]  HarrisTim,et al.  Xen and the art of virtualization , 2003 .

[18]  B. Cohen,et al.  Incentives Build Robustness in Bit-Torrent , 2003 .

[19]  Christian Damsgaard Jensen,et al.  P2P with JXTA-Java pipes , 2003, PPPJ.

[20]  Francisco Vilar Brasileiro,et al.  Running Bag-of-Tasks applications on computational grids: the MyGrid approach , 2003, 2003 International Conference on Parallel Processing, 2003. Proceedings..

[21]  J. Seigneur,et al.  P 2 P with JXTA-Java pipes , 2003 .

[22]  David E. Culler,et al.  PlanetLab: an overlay testbed for broad-coverage services , 2003, CCRV.

[23]  Mario Lauria,et al.  The organic grid: self-organizing computation on a peer-to-peer network , 2004 .

[24]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[25]  Jason Novotny,et al.  GridSphere: a portal framework for building collaborations , 2004, Concurr. Pract. Exp..

[26]  Douglas Thain,et al.  Building Reliable Clients and Services , 2004, The Grid 2, 2nd Edition.

[27]  Andrew A. Chien,et al.  Resource Management for Rapid Application Turnaround on Enterprise Desktop Grids , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[28]  Fabrizio Gagliardi,et al.  The EGEE European Grid Infrastructure Project , 2004, VECPAR.

[29]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[30]  David Walling,et al.  Grid Portal Toolkit 3.0 (GridPort) , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[31]  Andrew A. Chien,et al.  Henri Casanova , 2022 .

[32]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[33]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[34]  Erwin Laure,et al.  Middleware for the next generation Grid infrastructure , 2004 .

[35]  Douglas Thain,et al.  Distributed computing in practice: the Condor experience , 2005, Concurr. Pract. Exp..

[36]  Cosimo Anglano,et al.  Fault-Tolerant Scheduling for Bag-of-Tasks Grid Applications , 2005, EGC.

[37]  Mathieu Jan,et al.  JuxMem: An Adaptive Supportive Platform for Data Sharing on the Grid , 2001, Scalable Comput. Pract. Exp..

[38]  Marcel Kunze,et al.  Grid Computing in Europe: From Research to Deployment , 2005, ACSW.

[39]  Mario Lauria,et al.  The Organic Grid: Self‐organizing Computational Biology on Desktop Grids , 2005 .

[40]  Péter Kacsuk,et al.  Multi-Grid, Multi-User Workflows in the P-GRADE Grid Portal , 2005, Journal of Grid Computing.

[41]  Kazuyuki Shudo,et al.  P3: P2P-based middleware enabling transfer and aggregation of computational resources , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[42]  Stephen L. Scott,et al.  FreeLoader: Scavenging Desktop Storage Resources for Scientific Data , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[43]  Francisco Vilar Brasileiro,et al.  Sandboxing for a free-to-join grid with support for secure site-wide storage area , 2006, First International Workshop on Virtualization Technology in Distributed Computing (VTDC 2006).

[44]  Wolfgang Blochinger,et al.  Aspect-Oriented Parallel Discrete Optimization on the Cohesion Desktop Grid Platform , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[45]  K. Doka,et al.  GridTorrent : Optimizing data transfers in the Grid with collaborative sharing , 2006 .

[46]  Gilles Fedak,et al.  The Computational and Storage Potential of Volunteer Computing , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[47]  Nazareno Andrade,et al.  Labs of the World, Unite!!! , 2006, Journal of Grid Computing.

[48]  Chong-Sun Hwang,et al.  Characterizing and Classifying Desktop Grid , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[49]  Geoffrey C. Fox,et al.  The Open Grid Computing Environments collaboration: portlets and services for science gateways , 2007, Concurr. Comput. Pract. Exp..

[50]  Daniel S. Myers,et al.  Expanding the Reach of Grid Computing: Combining Globus- and BOINC-Based Systems , 2007, Grid Computing for Bioinformatics and Computational Biology.

[51]  Henri E. Bal,et al.  User-friendly and reliable grid computing based on imperfect middleware , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[52]  Ian J. Taylor,et al.  Peer-To-Peer Techniques for Data Distribution in Desktop Grid Computing Platforms , 2007, CoreGRID Workshop - Making Grids Work.

[53]  Albert Y. Zomaya,et al.  Grid Computing for Bioinformatics and Computational Biology , 2007, Wiley series on bioinformatics.

[54]  Gilles Fedak,et al.  Towards efficient data distribution on computational desktop grids with BitTorrent , 2007, Future Gener. Comput. Syst..

[55]  Nazareno Andrade,et al.  Relative autonomous accounting for peer‐to‐peer Grids , 2007, Concurr. Comput. Pract. Exp..

[56]  Nazareno Andrade,et al.  Automatic grid assembly by promoting collaboration in peer-to-peer grids , 2007, J. Parallel Distributed Comput..

[57]  Bobby Bhattacharjee,et al.  Creating a Robust Desktop Grid using Peer-to-Peer Services , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[58]  P. Carrupt,et al.  Structure–Antioxidant Activity Relationships in a Series of NO‐Donor Phenols , 2008, ChemMedChem.

[59]  Cosimo Anglano,et al.  Scheduling algorithms for multiple Bag-of-Task applications on Desktop Grids: A knowledge-free approach , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[60]  Péter Kacsuk,et al.  Solving the grid interoperability problem by P-GRADE portal at workflow level , 2008, Future Gener. Comput. Syst..

[61]  Cosimo Anglano,et al.  The File Mover: high-performance data transfer for the grid: Research Articles , 2008 .

[62]  Anglano Cosimo,et al.  The ShareGrid Portal: an easy way to submit jobs on computational Grids. , 2008 .

[63]  F. Cappello,et al.  BitDew: A programmable environment for large-scale data management and distribution , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[64]  Cosimo Anglano,et al.  Peer-to-Peer Desktop Grids in the Real World: The ShareGrid Project , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[65]  Cosimo Anglano,et al.  The File Mover: high‐performance data transfer for the grid , 2008, Concurr. Comput. Pract. Exp..

[66]  Gilles Fedak,et al.  EDGeS: bridging desktop and service grids , 2008 .

[67]  Péter Kacsuk,et al.  SZTAKI Desktop Grid (SZDG): A Flexible and Scalable Desktop Grid System , 2009, Journal of Grid Computing.

[68]  Gilles Fedak,et al.  EDGeS: Bridging EGEE to BOINC and XtremWeb , 2009, Journal of Grid Computing.