From content distribution networks to content networks - issues and challenges

Due to the technical developments in electronics the amount of digital content is continuously increasing. In order to make digital content respectively multimedia content available to potentially large and geographically distributed consumer populations, Content Distribution Networks (CDNs) are used. The main task of current CDNs is the efficient delivery and increased availability of content to the consumer. This area has been subject to research for several years. Modern CDN solutions aim to additionally automate the CDN management. Furthermore, modern applications do not just perform retrieval or access operations on content, but also create content, modify content, actively place content at appropriate locations of the infrastructure, etc. If these operations are also supported by the distribution infrastructure, we call the infrastructure Content Networks (CN) instead of CDN. In order to solve the major challenges of future CNs, researchers from different communities have to collaborate, based on a common terminology. It is the aim of this paper, to contribute to such a terminology, to summarize the state-of-the-art, and to highlight and discuss some grand challenges for CNs that we have identified. Our conception of these challenges is supported by the answers to a questionnaire we received from many leading European research groups in the field.

[1]  Ludmila Cherkasova,et al.  FastReplica: Efficient Large File Distribution Within Content Delivery Networks , 2003, USENIX Symposium on Internet Technologies and Systems.

[2]  Henning Schulzrinne,et al.  MarconiNet: overlay mobile content distribution network , 2004, IEEE Communications Magazine.

[3]  Mary K. Vernon,et al.  Abstract--this Paper Develops Simple Cost Models for Provisioning Content Distribution Networks That Use the Simple and Highly Scalable Bandwidth Skimming Protocol for Streaming. New Insight , 2002 .

[4]  Jon M. Peha,et al.  Streaming video over the Internet: approaches and directions , 2001, IEEE Trans. Circuits Syst. Video Technol..

[5]  Luigi Rizzo,et al.  pgmcc: a TCP-friendly single-rate multicast congestion control scheme , 2000, SIGCOMM.

[6]  Donald F. Towsley,et al.  Proxy prefix caching for multimedia streams , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[7]  Christopher Edwards,et al.  The Internet: a global telecommunications solution? , 2000, IEEE Netw..

[8]  I. Lazar,et al.  Exploring content delivery networking , 2001 .

[9]  Bruce M. Maggs,et al.  Globally Distributed Content Delivery , 2002, IEEE Internet Comput..

[10]  Bobby Bhattacharjee,et al.  Scalable application layer multicast , 2002, SIGCOMM 2002.

[11]  Soam Acharya,et al.  MiddleMan: A Video Caching Proxy Server , 2000 .

[12]  Christophe Diot,et al.  Impact of Network Delay Variation on Multicast Session Performance With TCP-like Congestion Control. , 2001, INFOCOM 2001.

[13]  Ellen W. Zegura,et al.  Application-layer anycasting: a server selection architecture and use in a replicated Web service , 2000, TNET.

[14]  J. De Clercq,et al.  Content distribution networks , 2003 .

[15]  Vincent Roca,et al.  A survey of proposals for an alternative group communication service , 2003, IEEE Netw..

[16]  Rob Sherwood,et al.  Slurpie: a cooperative bulk data transfer protocol , 2004, IEEE INFOCOM 2004.

[17]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[18]  Bill Yeager,et al.  Project JXTA 2.0 Super-Peer Virtual Network , 2003 .

[19]  Klara Nahrstedt,et al.  Layered peer-to-peer streaming , 2003, NOSSDAV '03.

[20]  Qian Zhang,et al.  Selecting path-diversified servers in content distribution networks , 2003, GLOBECOM '03. IEEE Global Telecommunications Conference (IEEE Cat. No.03CH37489).

[21]  Brad Cain,et al.  A Model for Content Internetworking (CDI) , 2003, RFC.

[22]  Ferran Marqués,et al.  The MPEG-4 Book , 2003, J. Electronic Imaging.

[23]  Ailan Hu,et al.  Video-on-demand broadcasting protocols: a comprehensive study , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[24]  Christopher Edwards,et al.  A caching architecture for content delivery to mobile devices , 2003, 2003 Proceedings 29th Euromicro Conference.

[25]  Banu Özden,et al.  Buffer replacement algorithms for multimedia storage systems , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[26]  Helen J. Wang,et al.  Resilient peer-to-peer streaming , 2003, 11th IEEE International Conference on Network Protocols, 2003. Proceedings..

[27]  kc claffy,et al.  Bandwidth estimation: metrics, measurement techniques, and tools , 2003, IEEE Netw..

[28]  Robert Cole,et al.  Computer Communications , 1982, Springer New York.

[29]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[30]  Helen J. Wang,et al.  Distributing streaming media content using cooperative networking , 2002, NOSSDAV '02.

[31]  Hui Zhang,et al.  Caching Techniques for Streaming Multimedia over the Internet , 1999 .

[32]  Ben Y. Zhao,et al.  OceanStore: an architecture for global-scale persistent storage , 2000, SIGP.

[33]  Deborah Estrin,et al.  Proxy Caching Mechanism for Multimedia Playback Streams in the Internet , 1999 .

[34]  Lisa Amini.  Distribution Requirements for Content Internetworking , 2001 .

[35]  Kiyoshi Ueda,et al.  A DRM system suitable for P2P content delivery and the study on its implementation , 2003, 9th Asia-Pacific Conference on Communications (IEEE Cat. No.03EX732).

[36]  G. Agarwal,et al.  Content distribution architecture using network layer anycast , 2001, Proceedings. The Second IEEE Workshop on Internet Applications. WIAPP 2001.

[37]  Nicholas J. P. Race,et al.  A Dynamic RAM Cache for High Quality Distributed Video , 2000, IDMS.

[38]  Asit Dan,et al.  Generalized interval caching policy for mixed interactive and long video workloads , 1996, Electronic Imaging.

[39]  Xuxian Jiang,et al.  GnuStream: a P2P media streaming system prototype , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[40]  Mostafa Ammar,et al.  Security issues and solutions in multicast content distribution: a survey , 2003 .

[41]  Bharat K. Bhargava,et al.  PROMISE: peer-to-peer media streaming using CollectCast , 2003, MULTIMEDIA '03.

[42]  Kien A. Hua,et al.  A peer-to-peer architecture for media streaming , 2004, IEEE Journal on Selected Areas in Communications.

[43]  Raj Nair,et al.  Content Internetworking (CDI)Authentication,Authorization, and Accounting Requirements , 2001 .

[44]  Mikel Izal,et al.  Dissecting BitTorrent: Five Months in a Torrent's Lifetime , 2004, PAM.

[45]  Marcel Waldvogel,et al.  Efficient topology-aware overlay network , 2003, CCRV.

[46]  Jun Gao,et al.  Design and evaluation of a distributed scalable content discovery system , 2004, IEEE Journal on Selected Areas in Communications.

[47]  George Pallis,et al.  Content Delivery Networks: Status and Trends , 2003, IEEE Internet Comput..

[48]  Don Towsley,et al.  Proxy-Based Distribution of Streaming Video Over Unicast/Multicast Connections TITLE2: , 2001 .

[49]  Christophe Diot,et al.  Deployment issues for the IP multicast service and architecture , 2000, IEEE Netw..

[50]  Bruce M. Maggs,et al.  An analysis of live streaming workloads on the internet , 2004, IMC '04.

[51]  TECH 3285-s.  SPECIFICATION OF THE BROADCAST WAVE FORMAT - A FORMAT FOR AUDIO DATA FILES IN BROADCASTING , 2000 .

[52]  Mark Green.  Content Internetworking Architectural Overview , 2002 .

[53]  Richard M. Karp,et al.  Load Balancing in Structured P2P Systems , 2003, IPTPS.

[54]  Pablo Rodriguez,et al.  Performance Analysis of Peer-to-Peer Networks for File Distribution , 2004, QofIS.

[55]  Rayadurgam Srikant,et al.  Modeling and performance analysis of BitTorrent-like peer-to-peer networks , 2004, SIGCOMM 2004.

[56]  Joshua Lubell,et al.  Professional Xml Meta Data , 2001 .

[57]  Michael Zink,et al.  P2P streaming using multiple description coded video , 2004, Proceedings. 30th Euromicro Conference, 2004..

[58]  Ralf Steinmetz,et al.  Overlay Design Mechanisms for Heterogeneous, Large-Scale, Dynamic P2P Systems , 2004, Journal of Network and Systems Management.

[59]  Peter Thomas,et al.  Professional content management systems - handling digital media assets , 2004 .

[60]  David Mazières,et al.  Rateless Codes and Big Downloads , 2003, IPTPS.

[61]  Jeffrey Considine,et al.  Simple Load Balancing for Distributed Hash Tables , 2003, IPTPS.

[62]  Angelos D. Keromytis,et al.  SOS: an architecture for mitigating DDoS attacks , 2004, IEEE Journal on Selected Areas in Communications.

[63]  Michael Zink,et al.  P2P streaming using multiple description coded video , 2004 .

[64]  Amin Vahdat,et al.  Bullet: high bandwidth data dissemination using an overlay mesh , 2003, SOSP '03.

[65]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[66]  Harry W. Agius.  MPEG-7: Multimedia Content Description Interface , 2008, Encyclopedia of Multimedia.

[67]  Kurt Tutschku,et al.  A Measurement-Based Traffic Profile of the eDonkey Filesharing Service , 2004, PAM.

[68]  Antonio Ortega,et al.  PALS: peer-to-peer adaptive layered streaming , 2003, NOSSDAV '03.

[69]  Bruce M. Maggs,et al.  Globally distribued content delivery , 2002 .

[70]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[71]  Mark S. Day,et al.  Content Internetworking (CDI) Scenarios , 2003, RFC.

[72]  Leandros Tassiulas,et al.  Market-Based Resource Allocation for Content Delivery in the Internet , 2003, IEEE Trans. Computers.

[73]  Jibin Zhan,et al.  Early Experience with an Internet Broadcast System Based on Overlay Multicast , 2004, USENIX Annual Technical Conference, General Track.

[74]  Peter Stanchev,et al.  MPEG-7: The Multimedia Content Description Interface , 2004 .

[75]  Antonio Ortega,et al.  Proxy caching for efficient video services over the Internet , 1999 .

[76]  Siddhartha Annapureddy,et al.  P2PCast: A Peer-to-Peer Multicast Scheme for Streaming Data , 2003 .

[77]  Kien A. Hua,et al.  ZIGZAG: an efficient peer-to-peer scheme for media streaming , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[78]  Andreas Mauthe,et al.  Quality of future internet services COST action 263 final report , 2003 .

[79]  Donald F. Towsley,et al.  Supplying instantaneous video-on-demand services using controlled multicast , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[80]  I. Rhee,et al.  Multicast with cache (Mcache): an adaptive zero-delay video-on-demand service , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[81]  Bharat K. Bhargava,et al.  On peer-to-peer media streaming , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[82]  Doug Shepherd,et al.  The Design of a Storage Server for Continuous Media , 1993, Comput. J..

[83]  Stephen J. Wright,et al.  Minimizing delivery cost in scalable streaming content distribution systems , 2004, IEEE Transactions on Multimedia.

[84]  Dritan Kaleshi,et al.  Securing the delivery of digital content over the Internet , 2002 .

[85]  Pål Halvorsen,et al.  Operating system support for multimedia systems , 2000, Comput. Commun..

[86]  Hector Garcia-Molina,et al.  Streaming Live Media over a Peer-to-Peer Network , 2001 .

[87]  Reuven Cohen,et al.  Scheduling algorithms for a cache pre-filling content distribution network , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[88]  Zongming Fei,et al.  A model for replica placement in content distribution networks for multimedia applications , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[89]  Zhi-Li Zhang,et al.  A network-conscious approach to end-to-end video delivery over wide area networks using proxy servers , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[90]  George Varghese,et al.  Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications , 2001, SIGCOMM 2001.

[91]  Dan Rubenstein,et al.  A lightweight, robust P2P system to handle flash crowds , 2002, IEEE Journal on Selected Areas in Communications.