Adaptive web caching: towards a new global caching architecture

Abstract An adaptive, highly scalable, and robust web caching system is needed to effectively handle the exponential growth and extreme dynamic environment of the World Wide Web. Our work presented last year sketched out the basic design of such a system. This sequel paper reports our progress over the past year. To assist caches making web query forwarding decisions, we sketch out the basic design of a URL routing framework. To assist fast searching within each cache group, we let neighbor caches share content information. Equipped with the URL routing table and neighbor cache contents, a cache in the revised design can now search the local group, and forward all missing queries quickly and efficiently, thus eliminating both the waiting delay and the overhead associated with multicast queries. The paper also presents a proposal for incremental deployment that provides a smooth transition from the currently deployed cache infrastructure to the new design.

[1]  Ellen W. Zegura,et al.  Self-organizing wide-area network caches , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[2]  Marc Abrams,et al.  Proxy Caching That Estimates Page Load Delays , 1997, Comput. Networks.

[3]  Michael Dahlin,et al.  Design considerations for distributed caching on the Internet , 1999, Proceedings. 19th IEEE International Conference on Distributed Computing Systems (Cat. No.99CB37003).

[4]  V. Jacobson,et al.  Adaptive Web Caching , 1997 .

[5]  James E. Pitkow,et al.  Yet Robust Caching Algorithm Based on Dynamic Access Patterns , 1994, WWW Spring 1994.

[6]  A. Lauer,et al.  Quantifying the Overall Impact of Caching and Replication in the Web , 1997 .

[7]  Van Jacobson,et al.  The synchronization of periodic routing messages , 1993, SIGCOMM '93.

[8]  Abrams Marc,et al.  WWW Proxy Traffic Characterization with Application to Caching , 1997 .

[9]  Roland Peter Wooster,et al.  Optimizing Response Time, Rather than Hit Rates, of WWW Proxy Caches , 1996 .

[10]  Eric A. Brewer,et al.  System Design Issues for Internet Middleware Services: Deductions from a Large Client Trace , 1997, USENIX Symposium on Internet Technologies and Systems.

[11]  Ingrid Melve.  Building a web cache system - Architectural Considerations , 1997 .

[12]  Jonathan D. Cohen,et al.  Recursive hashing functions for n-grams , 1997, TOIS.

[13]  ZhangLixia,et al.  Adaptive web caching , 1998 .

[14]  Jacob R. Lorch,et al.  Making World Wide Web Caching Servers Cooperate , 1996, World Wide Web J..

[15]  John Harrison,et al.  A Distributed Internet Cache , 1997 .

[16]  Keith W. Ross,et al.  Hash routing for collections of shared Web caches , 1997, IEEE Netw..

[17]  Asit Dan,et al.  Resource-based caching for Web servers , 1997, Electronic Imaging.

[18]  Li Fan,et al.  Summary cache: a scalable wide-area web cache sharing protocol , 2000, TNET.

[19]  Syam Gadde,et al.  Reduce, reuse, recycle: an approach to building large Internet caches , 1997, Proceedings. The Sixth Workshop on Hot Topics in Operating Systems (Cat. No.97TB100133).

[20]  Steffen Rothkugel,et al.  World Wide Web caching: the application-level view of the Internet , 1997, IEEE Commun. Mag..

[21]  Mark Crovella,et al.  Characteristics of WWW Client-based Traces , 1995 .

[22]  Kinji Ono,et al.  A study of caching proxy mechanisms realized on wide area distributed networks , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[23]  Masaaki Nabeshima,et al.  The Japan Cache Project: An Experiment on Domain Cache , 1997, Comput. Networks.