A Load Balanced Two-Tier DHT with Improved Lookup Performance of Non-popular Data Items

We have earlier proposed a two-tier hierarchical DHT architecture where nodes with higher uptime and more resources dynamically form the upper tier DHT ring. Each node of this ring acts as a super node for a DHT ring of lower tier nodes. The performance of lookups for non popular data items in this type of self organizing two-tier DHT is not as good as that of flat DHT due to the uneven distribution of ring sizes at lower tier. Also, this uneven distribution leads to unbalanced load at super nodes. In this paper, we propose a dynamic node migration algorithm for forming two-tier DHT which ensures even distribution of ring sizes at lower tier. Our proposed migration algorithm includes mechanisms for merging smaller rings and splitting bigger rings. Further, this even distribution of lower tier ring sizes leads to improved load balancing among super nodes. Simulation results indicate that this modified two-tier DHT architecture performs better than flat DHTs in terms of mean hop count to lookup non popular data items.

[1]  Geoffrey C. Fox,et al.  Grid and Cooperative Computing - GCC 2005, 4th International Conference, Beijing, China, November 30 - December 3, 2005, Proceedings , 2005, GCC.

[2]  Futai Zou,et al.  Building Efficient Super-Peer Overlay Network for DHT Systems , 2005, GCC.

[3]  Mayank Pandey,et al.  2T-DHT: A Two Tier DHT for Implementing Publish/Subscribe , 2009, 2009 International Conference on Computational Science and Engineering.

[4]  Ben Y. Zhao,et al.  Brocade: Landmark Routing on Overlay Networks , 2002, IPTPS.

[5]  Wolfgang Kellerer,et al.  Cost-Based Analysis of Hierarchical DHT Design , 2006, Sixth IEEE International Conference on Peer-to-Peer Computing (P2P'06).

[6]  Jon Crowcroft,et al.  Networked Group Communication , 2001, Lecture Notes in Computer Science.

[7]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[8]  Mohamed Ould-Khaoua,et al.  Improving Probabilistic Route Discovery in Mobile Ad Hoc Networks , 2007 .

[9]  Miguel Castro,et al.  SCRIBE: The Design of a Large-Scale Event Notification Infrastructure , 2001, Networked Group Communication.

[10]  Yang Cao,et al.  HP2P: A Hybrid Hierarchical P2P Network , 2007, First International Conference on the Digital Society (ICDS'07).

[11]  Peter Druschel,et al.  Peer-to-peer systems , 2010, Commun. ACM.

[12]  Krishna P. Gummadi,et al.  Canon in G major: designing DHTs with hierarchical structure , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..