Self-Organized Load Balancing in Proxy Servers: Algorithms and Performance

Proxy servers are common solutions to relieve organizational networks from heavy traffic by storing the most frequently referenced web objects in their local cache. These proxies are commonly known as cooperative proxy systems and are usually organized in such a way as to optimize the utilization of their storage capacity. However, the design of the organizational structure of such proxy system depends heavily on the designer's knowledge of the network's performance. This article describes three methods to tackle this load balancing problem. They allow the self-organization of proxy servers by modeling each server as an autonomous entity that can make local decisions based on the traffic pattern it has served.

[1]  Haakon Bryhni,et al.  A comparison of load balancing techniques for scalable Web servers , 2000, IEEE Netw..

[2]  Philip S. Yu,et al.  Load balancing and hot spot relief for hash routing among a collection of proxy caches , 1999, Proceedings. 19th IEEE International Conference on Distributed Computing Systems (Cat. No.99CB37003).

[3]  Jiming Liu,et al.  Self-organized autonomous web proxies , 2002, AAMAS '02.

[4]  Carey Williamson,et al.  Achieving Load Balance and Efiective Caching in Clustered Web Servers , 1999 .

[5]  Samuel Kaski,et al.  Self organization of a massive document collection , 2000, IEEE Trans. Neural Networks Learn. Syst..

[6]  Pablo Rodriguez.  Web caching architectures: hierarchical and distributed caching , 1999 .

[7]  Jiming Liu,et al.  Autonomy Oriented Load Balancing in Proxy Cache Servers , 2001, Web Intelligence.

[8]  Jia Wang,et al.  A survey of web caching schemes for the Internet , 1999, CCRV.

[9]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[10]  Edward A. Fox,et al.  Analysis and modeling of world wide web traffic , 1998 .

[11]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[12]  G. Barish,et al.  World Wide Web caching: trends and techniques , 2000, IEEE Commun. Mag..

[13]  Michael J. Feeley,et al.  The Measured Access Characteristics of World-Wide-Web Client Proxy Caches , 1997, USENIX Symposium on Internet Technologies and Systems.

[14]  Van Jacobson,et al.  Adaptive web caching: towards a new global caching architecture , 1998, Comput. Networks.

[15]  Philip S. Yu,et al.  Dynamic Load Balancing on Web-Server Systems , 1999, IEEE Internet Comput..

[16]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[17]  David R. Karger,et al.  Web Caching with Consistent Hashing , 1999, Comput. Networks.

[18]  Clinton L. Jeffery,et al.  Taxonomy and design analysis for distributed Web caching , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[19]  Ellen W. Zegura,et al.  How to model an internetwork , 1996, Proceedings of IEEE INFOCOM '96. Conference on Computer Communications.

[20]  Keith Ross,et al.  Cache Array Routing Protocol v1.1 , 1998 .

[21]  Quinn Jacobson,et al.  Potential and Limits of Web Prefetching Between Low-Bandwidth Clients and Proxies , 1998 .

[22]  Anja Feldmann,et al.  Web proxy caching: the devil is in the details , 1998, PERV.

[23]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[24]  Jiming Liu,et al.  Adaptive distributed caching , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).