A self-similar super-peer overlay construction scheme for super large-scale P2P applications

Unstructured peer-to-peer (P2P) overlay networks with two-layer hierarchy, comprising an upper layer of super-peers and an underlying layer of ordinary peers, are used to improve the performance of large-scale P2P applications like content distribution and storage. In order to deal with continuous growth of participating peers, a scalable and efficient super-peer overlay topology is essential. However, there is relatively little research conducted on constructing such super-peer overlay topology. In the existed solutions, the number of connections required to be maintained by a super-peer is in direct proportion to the total number of super-peers. For super large-scale P2P applications, i.e. the number of participating peer is over 1,000,000, these solutions are not scalable and impractical. Therefore, in this paper, we propose a scalable hierarchical unstructured P2P system in which a self-similar square network graph (SSNG) is proposed to construct and maintain the super-peer overlay topology adaptively. The SSNG topology is a constant-degree topology in which each node maintains a constant number of neighbor nodes. Moreover, a simple and efficient message forwarding algorithm is presented to ensure each super-peer to receive just one flooding message. The analytical results showed that the proposed SSNG-based overlay is more scalable and efficient than the perfect difference graph (PDG)-based overlay proposed in the literature.

[1]  Márk Jelasity,et al.  T-Man: Gossip-based fast overlay topology construction , 2009, Comput. Networks.

[2]  An Efficient Merge Technology for Constant Degree P2P Systems , 2012, 2012 International Conference on Computer Science and Service System.

[3]  Guihai Chen,et al.  Cycloid: a constant-degree and lookup-efficient P2P overlay network , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[4]  Gian Paolo Jesi,et al.  Proximity-Aware Superpeer Overlay Topologies , 2006, IEEE Transactions on Network and Service Management.

[5]  Nei Kato,et al.  THUP: A P2P Network Robust to Churn and DoS Attack Based on Bimodal Degree Distribution , 2013, IEEE Journal on Selected Areas in Communications.

[6]  Jie Wu,et al.  Moore: An Extendable Peer-to-Peer Network Based on Incomplete Kautz Digraph with Constant Degree , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[7]  Jie Wu,et al.  FISSIONE: a scalable constant degree and low congestion DHT scheme based on Kautz graphs , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[8]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM 2001.

[9]  Henning Schulzrinne,et al.  An Analysis of the Skype Peer-to-Peer Internet Telephony Protocol , 2004, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[10]  Minglu Li,et al.  CBT: A proximity-aware peer clustering system in large-scale BitTorrent-like peer-to-peer networks , 2008, Comput. Commun..

[11]  Dick H. J. Epema,et al.  The Design and Evaluation of a Self-Organizing Superpeer Network , 2010, IEEE Transactions on Computers.

[12]  Douglas S. Reeves,et al.  Constructing a balanced, (log(N)/1oglog(N))-diameter super-peer topology for scalable P2P systems , 2004 .

[13]  Li Xiao,et al.  Dynamic Layer Management in Superpeer Architectures , 2005, IEEE Trans. Parallel Distributed Syst..

[14]  Chih-Hung Chao,et al.  An Efficient Superpeer Overlay Construction and Broadcasting Scheme Based on Perfect Difference Graph , 2010, IEEE Transactions on Parallel and Distributed Systems.

[15]  Gade Krishna,et al.  A scalable peer-to-peer lookup protocol for Internet applications , 2012 .

[16]  Feng Wang,et al.  Stable Peers: Existence, Importance, and Application in Peer-to-Peer Live Video Streaming , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[17]  DongSheng Li,et al.  An efficient load balancing method for constant degree P2P systems , 2010, 2010 International Conference On Computer Design and Applications.