Proxy ecology - cooperative proxies with artificial life

In this paper, we propose a novel P2P cooperative proxy cache system using an individual-based model. We borrow the idea from an ecological system as well as economic systems to manage the cooperative proxies through data and information exchange among individual proxies. The data flow among proxy nodes creates artificial life for the cooperative proxies. The proxy servers with artificial life can automatically configure themselves into a virtual proxy graph. The aggregate effect of caching actions by individual peer proxies automatically distributes the Web document closer to the clients and balances the workload. Our simulation results show that the proposed proxy caching scheme tremendously improves the system performance. In addition, the individual-based design model ensures the simplicity and scalability of the cache system.

[1]  Edward A. Fox,et al.  Removal Policies in Network Caches for World-Wide Web Documents , 1996, SIGCOMM.

[2]  Jacob R. Lorch,et al.  Making World Wide Web Caching Servers Cooperate , 1996, World Wide Web J..

[3]  Kern Koh,et al.  Periodic Polling for Web Cache Consistency , 1999, WebNet.

[4]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[5]  Sape Mullender,et al.  Distributed systems , 1989 .

[6]  Leonard Kleinrock.  Distributed Systems , 1985, Computer.

[7]  Peter Druschel,et al.  Pastry: Scalable, distributed object location and routing for large-scale peer-to- , 2001 .

[8]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[9]  Konstantinos Psounis,et al.  A randomized Web-cache replacement scheme , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[10]  Edward A. Fox,et al.  Caching Proxies: Limitations and Potentials , 1995, WWW.

[11]  Jiming Liu,et al.  Self-organized autonomous web proxies , 2002, AAMAS '02.

[12]  Li Xiao,et al.  On reliable and scalable peer-to-peer Web document sharing , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[13]  Duane Wessels,et al.  Cache Digests , 1998, Comput. Networks.

[14]  Stefan Saroiu,et al.  A Measurement Study of Peer-to-Peer File Sharing Systems , 2001 .

[15]  Balachander Krishnamurthy,et al.  Study of Piggyback Cache Validation for Proxy Caches in the World Wide Web , 1997, USENIX Symposium on Internet Technologies and Systems.

[16]  David R. Karger,et al.  Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web , 1997, STOC '97.

[17]  Anja Feldmann,et al.  Performance of Web proxy caching in heterogeneous bandwidth environments , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[18]  ChaseJeff,et al.  Not all hits are created equal , 1998 .

[19]  Richard S. Hall,et al.  A case for caching file objects inside internetworks , 1993, SIGCOMM 1993.

[20]  Richard S. Hall,et al.  A case for caching file objects inside internetworks , 1993, SIGCOMM '93.

[21]  James Z. Wang,et al.  Data allocation algorithms for distributed video servers , 2000, MM 2000.

[22]  Jia Wang,et al.  A survey of web caching schemes for the Internet , 1999, CCRV.

[23]  W ReynoldsCraig.  Flocks, herds and schools: A distributed behavioral model , 1987 .

[24]  Terence Kelly,et al.  Biased Replacement Policies for Web Caches: Differential Quality-of-Service and Aggregate User Value , 1999 .

[25]  Mary Baker,et al.  Measurements of a distributed file system , 1991, SOSP '91.

[26]  David R. Karger,et al.  Web Caching with Consistent Hashing , 1999, Comput. Networks.

[27]  Li Fan,et al.  Summary cache: a scalable wide-area web cache sharing protocol , 2000, TNET.

[28]  Keith Ross,et al.  Cache Array Routing Protocol v1.1 , 1998 .

[29]  Joseph D. Touch,et al.  LSAM Proxy Cache: A Multicast Distributed Virtual Cache , 1998, Comput. Networks.

[30]  Antony I. T. Rowstron,et al.  Squirrel: a decentralized peer-to-peer web cache , 2002, PODC '02.

[31]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[32]  Ratan K. Guha,et al.  Data allocation algorithms for distributed video servers , 2000, ACM Multimedia.

[33]  Azer Bestavros,et al.  Application-level document caching in the Internet , 1995, Second International Workshop on Services in Distributed and Networked Environments.

[34]  Van Jacobson,et al.  Adaptive web caching: towards a new global caching architecture , 1998, Comput. Networks.

[35]  Michael Dahlin,et al.  Engineering server-driven consistency for large scale dynamic Web services , 2001, WWW '01.

[36]  Darrell D. E. Long,et al.  Exploring the Bounds of Web Latency Reduction from Caching and Prefetching , 1997, USENIX Symposium on Internet Technologies and Systems.

[37]  Edward A. Fox,et al.  Removal policies in network caches for World-Wide Web documents , 1996, SIGCOMM '96.

[38]  Ari Luotonen,et al.  World-Wide Web Proxies , 1994, Comput. Networks ISDN Syst..

[39]  Ian Clarke,et al.  Freenet: A Distributed Anonymous Information Storage and Retrieval System , 2000, Workshop on Design Issues in Anonymity and Unobservability.

[40]  Alec Wolman,et al.  On the scale and performance of cooperative Web proxy caching , 1999, SOSP.

[41]  Hector Garcia-Molina,et al.  Comparing Hybrid Peer-to-Peer Systems , 2001, VLDB.

[42]  John Harrison,et al.  A Distributed Internet Cache , 1997 .

[43]  Hu Yuqi,et al.  Caching on the World Wide Web , 2003 .

[44]  Sandy Irani,et al.  Cost-Aware WWW Proxy Caching Algorithms , 1997, USENIX Symposium on Internet Technologies and Systems.

[45]  Syam Gadde,et al.  Reduce, reuse, recycle: an approach to building large Internet caches , 1997, Proceedings. The Sixth Workshop on Hot Topics in Operating Systems (Cat. No.97TB100133).

[46]  Peter Scheuermann,et al.  A Case for Delay-Conscious Caching of Web Documents , 1997, Comput. Networks.

[47]  Flaviu Cristian.  Automatic reconfiguration in the presence of failures , 1992, Softw. Eng. J..

[48]  Anja Feldmann,et al.  Web proxy caching: the devil is in the details , 1998, PERV.

[49]  Margo I. Seltzer,et al.  World Wide Web Cache Consistency , 1996, USENIX Annual Technical Conference.

[50]  Peter B. Danzig,et al.  A Hierarchical Internet Object Cache , 1996, USENIX ATC.

[51]  Duane Wessels,et al.  ICP and the Squid web cache , 1998, IEEE J. Sel. Areas Commun..

[52]  Luigi Rizzo,et al.  Replacement policies for a proxy cache , 2000, TNET.

[53]  Chengjie Liu,et al.  Maintaining strong cache consistency in the World-Wide Web , 1997, Proceedings of 17th International Conference on Distributed Computing Systems.

[54]  Eytan Adar,et al.  Free Riding on Gnutella , 2000, First Monday.

[55]  James E. Pitkow,et al.  Yet Robust Caching Algorithm Based on Dynamic Access Patterns , 1994, WWW Spring 1994.

[56]  James Zijun Wang,et al.  Improving Web Access Efficiency Using P2P Proxies , 2002, IWDC.

[57]  David Tse,et al.  Probabilistic methods for web caching , 2001, Perform. Evaluation.

[58]  Michael Dahlin,et al.  Design considerations for distributed caching on the Internet , 1999, Proceedings. 19th IEEE International Conference on Distributed Computing Systems (Cat. No.99CB37003).

[59]  Syam Gadde,et al.  Not all Hits are Created Equal: Cooperative Proxy Caching Over a Wide-Area Network , 1998, Comput. Networks.