Using the small-world model to improve Freenet performance

Efficient data retrieval in an unstructured peer-to-peer system like Freenet is a challenging problem. In this paper, we study the impact of workload on the performance of Freenet. We find that there is a steep reduction in the hit ratio of document requests with increasing load in Freenet. We show that a slight modification of Freenet's routing table cache replacement scheme (from LRU to a replacement scheme that enforces clustering in the key space) can significantly improve performance. Our modification is based on intuition from the small-world models and theoretical results by Kleinberg; our replacement scheme forces the routing tables to resemble neighbor relationships in a small-world acquaintance graph--clustering with light randomness. Our simulations show that this new scheme improves the request hit ratio dramatically while keeping the small average hops per successful request comparable to LRU. A simple, highly idealized model of Freenet under clustering with light randomness proves that the expected message delivery time in Freenet is O(log n) if the routing tables satisfy the small-world model and have the size θ(log2n).

[1]  Ian Clarke,et al.  Freenet: A Distributed Anonymous Information Storage and Retrieval System , 2000, Workshop on Design Issues in Anonymity and Unobservability.

[2]  Béla Bollobás,et al.  Random Graphs , 1985 .

[3]  Andy Oram,et al.  Peer-to-Peer: Harnessing the Power of Disruptive Technologies , 2001 .

[4]  Jon M. Kleinberg,et al.  The small-world phenomenon: an algorithmic perspective , 2000, STOC '00.

[5]  Ben Y. Zhao,et al.  An Infrastructure for Fault-tolerant Wide-area Location and Routing , 2001 .

[6]  Jie Wu,et al.  Small Worlds: The Dynamics of Networks between Order and Randomness , 2003 .

[7]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[8]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[9]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[10]  Ben Y. Zhao,et al.  Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and , 2001 .

[11]  Rajeev Motwani,et al.  Randomized algorithms , 1996, CSUR.

[12]  Jon M. Kleinberg,et al.  Navigation in a small world , 2000, Nature.

[13]  Ben Y. Zhao,et al.  OceanStore: an architecture for global-scale persistent storage , 2000, SIGP.

[14]  Michalis Faloutsos,et al.  On power-law relationships of the Internet topology , 1999, SIGCOMM '99.

[15]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM 2001.

[16]  Hui Zhang,et al.  A case for end system multicast (keynote address) , 2000, SIGMETRICS '00.

[17]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[18]  Kamesh Munagala,et al.  Extending Greedy Multicast Routing to Delay Sensitive Applications , 2002, Algorithmica.

[19]  Rajmohan Rajaraman,et al.  Accessing Nearby Copies of Replicated Objects in a Distributed Environment , 1997, SPAA '97.

[20]  Rajmohan Rajaraman,et al.  A data tracking scheme for general networks , 2001, SPAA '01.