On content delivery network implementation

Replication of information among multiple servers is mandatory to support high request volume and to prevent flash-crowds. Content Distribution Networks (CDN) are overlay networks aiming at reducing response time experienced by users through locating multiple servers in the edge of the network. There are currently several CDN solutions offered by different vendors, but many aspects of deployment and implementation remain proprietary or unclear. There are some projects related with the open implementation and modelling of CDN but all of them are focused to a certain scope and application. We propose a general model and architecture for an open CDN implementation using COTS technology. We have deployed and tested the CDN in a controlled environment and also in an operational environment in the Technical University of Valencia. The main contribution of this paper is to provide an open general model for a CDN and the performance evaluation of our implementation.

[1]  Jussi Kangasharju,et al.  Performance evaluation of redirection schemes in content distribution networks , 2001, Comput. Commun..

[2]  Balachander Krishnamurthy,et al.  Flash crowds and denial of service attacks: characterization and implications for CDNs and web sites , 2002, WWW.

[3]  David R. Karger,et al.  Analysis of the evolution of peer-to-peer systems , 2002, PODC '02.

[4]  M. Masa,et al.  Impact of request routing algorithms on the delivery performance of content delivery networks , 2003, Conference Proceedings of the 2003 IEEE International Performance, Computing, and Communications Conference, 2003..

[5]  George Pallis,et al.  Content Delivery Networks: Status and Trends , 2003, IEEE Internet Comput..

[6]  Lili Qiu,et al.  On the placement of Web server replicas , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[7]  Scott Hull Content Delivery Networks: Web Switching for Security, Availability, and Speed , 2002 .

[8]  Steven H. Low,et al.  High-density model for server allocation and placement , 2002, SIGMETRICS '02.

[9]  Matthew Green,et al.  Enhanced Streaming Services in a Content Distribution Network , 2001, IEEE Internet Comput..

[10]  M. Rumsewicz,et al.  Load balancing and control for distributed World Wide Web servers , 1999, Proceedings of the 1999 IEEE International Conference on Control Applications (Cat. No.99CH36328).

[11]  Jussi Kangasharju,et al.  Object replication strategies in content distribution networks , 2002, Comput. Commun..

[12]  Syam Gadde,et al.  Web caching and content distribution: a view from the interior , 2001, Comput. Commun..

[13]  Dinesh C. Verma,et al.  Content Distribution Networks: An Engineering Approach , 2001 .

[14]  Kirk L. Johnson,et al.  The measured performance of content distribution networks , 2001, Comput. Commun..

[15]  Dinesh C. Verma,et al.  Content Distribution Networks , 2002 .

[16]  Jia Wang,et al.  Proceedings of the 2002 Usenix Annual Technical Conference a Precise and Efficient Evaluation of the Proximity between Web Clients and Their Local Dns Servers , 2022 .

[17]  Cormac J. Sreenan,et al.  An Efficient CDN Placement Algorithm for High-Quality TV Content , 2005, EuroIMSA.

[18]  Peter Scheuermann,et al.  Selection algorithms for replicated Web servers , 1998, PERV.

[19]  Wai-tian Tan,et al.  Research and design of a mobile streaming media content delivery network , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[20]  Pablo Rodriguez,et al.  SPREAD: Scalable platform for reliable and efficient automated distribution , 2000, Comput. Networks.

[21]  Jianping Pan,et al.  An overview of DNS-based server selections in content distribution networks , 2003, Comput. Networks.

[22]  Takeshi Yoshimura,et al.  A system architecture for managing mobile streaming media services , 2003, 23rd International Conference on Distributed Computing Systems Workshops, 2003. Proceedings..

[23]  Request-Routing Trends and Techniques in Content Distribution Network , 2002 .

[24]  Guillaume Pierre,et al.  Design and Implementation of a User-Centered Content Delivery Network , 2003 .

[25]  Michael Luby,et al.  A digital fountain approach to reliable distribution of bulk data , 1998, SIGCOMM '98.

[26]  Bo Li,et al.  On the Optimal Placement of Web Proxies in the Internet: The Linear Topology , 1998, HPN.

[27]  Carlos E. Palau,et al.  Modeling content delivery networks and their performance , 2004, Comput. Commun..

[28]  Helmut Hlavacs,et al.  The CODIS Content Delivery Network , 2005, Comput. Networks.

[29]  Philip S. Yu,et al.  Request Redirection Algorithms for Distributed Web Systems , 2003, IEEE Trans. Parallel Distributed Syst..

[30]  M. van Steen,et al.  Design and implementation of a user-centered content distribution network , 2003, Proceedings the Third IEEE Workshop on Internet Applications. WIAPP 2003.

[31]  Zhe Wang,et al.  CoDNS: Improving DNS Performance and Reliability via Cooperative Lookups , 2004, OSDI.

[32]  Henning Schulzrinne,et al.  MarconiNet – An Architecture for Internet Radio and TV Networks , 1999 .

[33]  Krishna P. Gummadi,et al.  An analysis of Internet content delivery systems , 2002, OPSR.

[34]  Zhen Xiao,et al.  ACDN: a content delivery network for applications , 2002, SIGMOD '02.

[36]  Balachander Krishnamurthy,et al.  On the use and performance of content distribution networks , 2001, IMW '01.

[37]  Mihaela van der Schaar,et al.  Enterprise multimedia streaming: issues, background and new developments , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[38]  Gang Peng,et al.  CDN: Content Distribution Network , 2004, ArXiv.

[39]  Syam Gadde,et al.  The Trickle-Down Effect: Web Caching and Server Request Distribution , 2002, Comput. Commun..

[40]  Anees Shaikh,et al.  On the effectiveness of DNS-based server selection , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[41]  Michal Szymaniak,et al.  Latency-Driven Replica Placement , 2006 .