Selective Update Approach to Maintain Strong Web Consistency in Dynamic Content Delivery

Content delivery network improves end-user performance by replicating Web contents on a group of geographically distributed sites interconnected over the Internet. However, with the development whereby content distribution systems can manage dynamically changing files, an important issue to be resolved is consistency management, which means the cached replicas on different sites must be updated if the originals change. In this paper, based on the analytical formulation of object freshness, web access distribution and network topology, we derive a novel algorithm as follows: (I) For a given content which has been changed on its original server, only a limited number of its replicas instead of all replicas are updated. (2) After a replica has been selected for update, the latest version will be sent from an algorithm-decided site instead of from its original server. Simulation results verify that the proposed algorithm provides better consistency management than conventional methods with the reduced the old hit ratio and network traffic.

[1]  Edith Cohen,et al.  Search and replication in unstructured peer-to-peer networks , 2002 .

[2]  Rauf Izmailov,et al.  Fast replication in content distribution overlays , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[3]  James E. Pitkow,et al.  Yet Robust Caching Algorithm Based on Dynamic Access Patterns , 1994, WWW Spring 1994.

[4]  Weisong Shi,et al.  Modeling object characteristics of dynamic Web content , 2003, J. Parallel Distributed Comput..

[5]  CachingLee,et al.  On the Implications of Zipf ' s Law for Web , 1998 .

[6]  Lili Qiu,et al.  On the placement of Web server replicas , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[7]  Jiro Katto,et al.  Stream Caching Using Hierarchically Distributed Proxies with Adaptive Segments Assignment(Proxy Caching)(Special Issue on Content Delivery Networks) , 2003 .

[8]  Giuliano Antoniol,et al.  Predicting Web site access: an application of time series , 2001, Proceedings 3rd International Workshop on Web Site Evolution. WSE 2001.

[9]  Craig E. Wills,et al.  Evaluating a new approach to strong web cache consistency with snapshots of collected content , 2003, WWW '03.

[10]  Prashant J. Shenoy,et al.  Scalable Consistency Maintenance in Content Distribution Networks Using Cooperative Leases , 2003, IEEE Trans. Knowl. Data Eng..

[11]  Srinivasan Keshav,et al.  A control-theoretic approach to flow control , 1991, SIGCOMM '91.

[12]  Bo Li,et al.  On the optimal placement of web proxies in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[13]  Manish Jain,et al.  End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput , 2003, TNET.

[14]  Markus Hofmann,et al.  Enabling the Internet to Deliver Content-Oriented Services , 2001 .

[15]  Shay Kutten,et al.  Optimal allocation of electronic content , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[16]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[17]  Chengjie Liu,et al.  Maintaining Strong Cache Consistency in the World Wide Web , 1998, IEEE Trans. Computers.

[18]  Naoki Wakamiya,et al.  Proxy caching mechanisms with video quality adjustment , 2001, SPIE ITCom.

[19]  Wei-Ying Ma,et al.  An interactive video delivery and caching system using video summarization , 2002, Comput. Commun..

[20]  Lada A. Adamic,et al.  Search in Power-Law Networks , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Jussi Kangasharju,et al.  Performance evaluation of redirection schemes in content distribution networks , 2001, Comput. Commun..

[22]  Chengjie Liu,et al.  Maintaining strong cache consistency in the World-Wide Web , 1997, Proceedings of 17th International Conference on Distributed Computing Systems.

[23]  Mihaela van der Schaar,et al.  The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP , 2001, IEEE Trans. Multim..

[24]  Zongming Fei,et al.  A Novel Approach to Managing Consistency in Content Distribution Networks , 2001 .

[25]  Peter Parnes,et al.  Characterizing user access to videos on the World Wide Web , 1999, Electronic Imaging.