"Must-Work": A Scalable Model for Parallel Recursive Problems on P2P Networks

Most of real world problems are cpu-time intensive; their solutions take too much time to compute using a single machine. The grid and cloud computing offer a potential solution to this problem. However, such solutions are in general expensive. An alternative solution uses P2P networks, a set of machines in the Internet which collaborate to perform the same task. Branch-and-Bound is a model of such solution, but most of parallel applications developed on P2P networks are based on the Master Worker paradigm, particularly for divide and conquer problems (D&C), where the Master divides the tasks and sends them to Workers, while the Workers execute received tasks as in the client server model. This solution suffers from the scalability problem, and, as a consequence, hierarchical Master Worker model was introduced. Scalability is improved, but it still remains a critical issue. In this paper, we propose a new generic and scalable model for parallelizing the resolution of the recursive problem (a type of divide and conquer problems) on an existing P2P architecture. As opposed to the existing hierarchical Master-Worker models, in our solution, each network node is both a Master and Worker called "Must-Work". The proposed solution uses a dynamic tree for tasks distribution; it is constructed according to a node requestor. We have evaluated our solution using The Quicksort method under the MPI platform. The results are globally satisfactory in term of time execution compared to the sequential solution.

[1]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[3]  Mario Lauria,et al.  The organic grid: self-organizing computation on a peer-to-peer network , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Wallace Wadge Distributed application reliability on unstable, dynamic, P2P-based platforms , 2004 .

[5]  Jeff Linderoth,et al.  Metacomputing and the Master-Worker Paradigm , 2000 .

[6]  Weiguo Liu,et al.  A collaborative virtual geographic environment based on P2P and Grid technologies , 2007, Inf. Sci..

[7]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[8]  Magne Haveraaen Efficient Parallelisation of Recursive Problems Using Constructive Recursion (Research Note) , 2000, Euro-Par.

[9]  Gade Krishna,et al.  A scalable peer-to-peer lookup protocol for Internet applications , 2012 .

[10]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[11]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[12]  Greg Ruetsch,et al.  Framework for Peer-to-Peer Distributed Computing in a Heterogeneous, Decentralized Environment , 2002, GRID.

[13]  Karl Aberer,et al.  Beyond Term Indexing: A P2P Framework for Web Information Retrieval , 2006, Informatica.

[14]  Demetris G. Galatopoullos,et al.  JavaPorts: An Environment to Facilitate Parallel Computing on a Heterogeneous Cluster of Workstations , 1999, Informatica.

[15]  Denis Caromel,et al.  A Task-Based Fault-Tolerance Mechanism to Hierarchical Master/Worker with Divisible Tasks , 2009, 2009 11th IEEE International Conference on High Performance Computing and Communications.

[16]  Jeff T. Linderoth,et al.  Master–Worker: An Enabling Framework for Applications on the Computational Grid , 2001, Cluster Computing.

[17]  Julien Bourgeois,et al.  Adding new features in a peer-to-peer distributed computing framework , 2005, 13th Euromicro Conference on Parallel, Distributed and Network-Based Processing.

[18]  Kento Aida,et al.  Distributed computing with hierarchical master-worker paradigm for parallel branch and bound algorithm , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[19]  Jeff T. Linderoth,et al.  An enabling framework for master-worker applications on the Computational Grid , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[20]  Manish Gupta,et al.  Automatic Parallelization of Recursive Procedures , 2004, International Journal of Parallel Programming.

[21]  Hossein Deldari,et al.  A Linda-based Hierarchical Master-Worker Model , 2009 .

[22]  William John Teahan,et al.  ParCop: a decentralized peer-to-peer computing system , 2004, Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks.

[23]  Michael J. Flynn,et al.  Some Computer Organizations and Their Effectiveness , 1972, IEEE Transactions on Computers.