Network Coding Meets Multimedia: A Review

While every network node only relays messages in a traditional communication system, the recent network coding (NC) paradigm proposes to implement simple in-network processing with packet combinations in the nodes. NC extends the concept of “encoding” a message beyond source coding (for compression) and channel coding (for protection against errors and losses). It has been shown to increase network throughput compared to traditional networks implementation, to reduce delay and to provide robustness to transmission errors and network dynamics. These features are so appealing for multimedia applications that they have spurred a large research effort towards the development of multimedia-specific NC techniques. This paper reviews the recent work in NC for multimedia applications and focuses on the techniques that fill the gap between NC theory and practical applications. It outlines the benefits of NC and presents the open challenges in this area. The paper initially focuses on multimedia-specific aspects of network coding, in particular delay, in-network error control, and media-specific error control. These aspects permit to handle varying network conditions as well as client heterogeneity, which are critical to the design and deployment of multimedia systems. After introducing these general concepts, the paper reviews in detail two applications that lend themselves naturally to NC via the cooperation and broadcast models, namely peer-to-peer multimedia streaming and wireless networking.

[1]  Jörg Widmer,et al.  Network coding: an instant primer , 2006, CCRV.

[2]  Reza Rejaie,et al.  PRIME: Peer-to-Peer Receiver-drIven MEsh-Based Streaming , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[3]  Chuan Wu,et al.  UUSee: Large-Scale Operational On-Demand Streaming with Random Network Coding , 2010, 2010 Proceedings IEEE INFOCOM.

[4]  Devavrat Shah,et al.  Network Coding Meets TCP: Theory and Implementation , 2011, Proceedings of the IEEE.

[5]  Ioannis Stavrakakis,et al.  Joint interest- and locality-aware content dissemination in social networks , 2009, 2009 Sixth International Conference on Wireless On-Demand Network Systems and Services.

[6]  R. Yeung,et al.  NETWORK ERROR CORRECTION , PART I : BASIC CONCEPTS AND UPPER BOUNDS , 2006 .

[7]  Athina Markopoulou,et al.  Network coding-aware rate control and scheduling in wireless networks , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[8]  Bo Li,et al.  CoolStreaming/DONet: a data-driven overlay network for peer-to-peer live media streaming , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[9]  Pascal Frossard,et al.  Network Coding of Rateless Video in Streaming Overlays , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Sae-Young Chung,et al.  Network coding , 2008, Journal of Communications and Networks.

[11]  Pascal Frossard,et al.  Raptor network video coding , 2007, MV '07.

[12]  Athina Markopoulou,et al.  Video-aware opportunistic network coding over wireless networks , 2009, IEEE Journal on Selected Areas in Communications.

[13]  Ahmed K. Elhakeem,et al.  Performance of an Efficient Scheduling Approach to Network Coding For Wireless Local Repair , 2011 .

[14]  Muriel Médard,et al.  Network Coding for Multiple Unicasts: An Approach based on Linear Optimization , 2006, 2006 IEEE International Symposium on Information Theory.

[15]  Morten Videbæk Pedersen,et al.  On-the-Fly Packet Error Recovery in a Cooperative Cluster of Mobile Devices , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[16]  Baochun Li,et al.  Network Coding in Live Peer-to-Peer Streaming , 2007, IEEE Transactions on Multimedia.

[17]  Christina Fragouli,et al.  MicroCast: cooperative video streaming on smartphones , 2013, MOCO.

[18]  Sen-Ching S. Cheung,et al.  Peer-to-Peer Streaming with Hierarchical Network Coding , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[19]  Christina Fragouli,et al.  MicroCast: cooperative video streaming on smartphones , 2012, MobiSys '12.

[20]  Pan Hui,et al.  A socio-aware overlay for publish/subscribe communication in delay tolerant networks , 2007, MSWiM '07.

[21]  Madhu Sudan,et al.  Priority encoding transmission , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[22]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[23]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[24]  Joao Barros,et al.  A Layered Network Coding Solution for Incentives in Peer-to-Peer Live Streaming , 2011, 2011 International Symposium on Networking Coding.

[25]  Pascal Frossard,et al.  Degree distribution optimization in Raptor network coding , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[26]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[27]  Michael Gastpar,et al.  Computing over Multiple-Access Channels with Connections to Wireless Network Coding , 2006, 2006 IEEE International Symposium on Information Theory.

[28]  Hayder Radha,et al.  Network Coding with Multi-Generation Mixing: A Generalized Framework for Practical Network Coding , 2011, IEEE Transactions on Wireless Communications.

[29]  Tracey Ho,et al.  Network Coding: An Introduction , 2008 .

[30]  Soung Chang Liew,et al.  Hot topic: physical-layer network coding , 2006, MobiCom '06.

[31]  Lorenzo Keller,et al.  Cooperative video streaming on smartphones , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[32]  Morten Videbæk Pedersen,et al.  Kodo: An Open and Research Oriented Network Coding Library , 2011, Networking Workshops.

[33]  Dong Nguyen,et al.  Multimedia wireless transmission with network coding , 2007, Packet Video 2007.

[34]  Pascal Frossard,et al.  An overview of network coding for multimedia streaming , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[35]  Shueng-Han Gary Chan,et al.  BOPPER: Wireless Video Broadcasting with Peer-to-Peer Error Recovery , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[36]  Marco Conti,et al.  ContentPlace: social-aware data dissemination in opportunistic networks , 2008, MSWiM '08.

[37]  Muriel Medard,et al.  XORs in the air: practical wireless network coding , 2006, SIGCOMM 2006.

[38]  Paul Francis,et al.  Chunkyspread: Heterogeneous Unstructured Tree-Based Peer-to-Peer Multicast , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.

[39]  Tracey Ho,et al.  A Tiling Approach to Network Code Design for Wireless Networks , 2006, 2006 IEEE Information Theory Workshop - ITW '06 Punta del Este.

[40]  Pascal Frossard,et al.  Selection of Network Coding Nodes for Minimal Playback Delay in Streaming Overlays , 2011, IEEE Transactions on Multimedia.

[41]  Helen J. Wang,et al.  Resilient peer-to-peer streaming , 2003, 11th IEEE International Conference on Network Protocols, 2003. Proceedings..

[42]  Vladimir Stankovic,et al.  Unequal error protection random linear coding for multimedia communications , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[43]  Raymond W. Yeung,et al.  Network coding theory: An introduction , 2010 .

[44]  Muriel Médard,et al.  On coding for reliable communication over packet networks , 2005, Phys. Commun..

[45]  Pascal Frossard,et al.  Prioritized Distributed Video Delivery With Randomized Network Coding , 2011, IEEE Transactions on Multimedia.

[46]  Yuan Feng,et al.  GestureFlow: Streaming gestures to an audience , 2011, 2011 Proceedings IEEE INFOCOM.

[47]  Cecilia Mascolo,et al.  Distance Matters: Geo-social Metrics for Online Social Networks , 2010, WOSN.

[48]  Shuo-Yen Robert Li,et al.  Linear Network Coding: Theory and Algorithms , 2011, Proceedings of the IEEE.

[49]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[50]  Alexander Sprintson,et al.  Opportunistic network coding: Competitive analysis , 2012, 2012 International Symposium on Network Coding (NetCod).

[51]  Srinivas Shakkottai,et al.  Opportunities for Network Coding: To Wait or Not to Wait , 2011, IEEE/ACM Transactions on Networking.

[52]  Tracey Ho,et al.  A Random Linear Network Coding Approach to Multicast , 2006, IEEE Transactions on Information Theory.

[53]  Christos Gkantsidis,et al.  Network coding for large scale content distribution , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[54]  Xiaojun Lin,et al.  Optimal immediately-decodable inter-session network coding (IDNC) schemes for two unicast sessions with hard deadline constraints , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[55]  Donald F. Towsley,et al.  TCP Performance in Coded Wireless Mesh Networks , 2008, 2008 5th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[56]  Xiaojun Lin,et al.  On The Capacity of Immediately-Decodable Coding Schemes for Wireless Stored-Video Broadcast with Hard Deadline Constraints , 2011, IEEE Journal on Selected Areas in Communications.

[57]  Baochun Li,et al.  How Practical is Network Coding? , 2006, 200614th IEEE International Workshop on Quality of Service.

[58]  Guoqiang Zhang,et al.  LANC: Locality-aware network coding for better P2P traffic localization , 2010, Comput. Networks.

[59]  A. Markopoulou,et al.  Distributed rate control for video streaming over wireless networks with intersession network coding , 2009, 2009 17th International Packet Video Workshop.

[60]  Hayder Radha,et al.  Network-embedded FEC for optimum throughput of multicast packet video , 2005, Signal Process. Image Commun..

[61]  Hulya,et al.  Distributed rate control for video streaming over wireless networks with intersession network coding , 2009 .

[62]  Klara Nahrstedt,et al.  MIS: Malicious Nodes Identification Scheme in Network-Coding-Based Peer-to-Peer Streaming , 2010, 2010 Proceedings IEEE INFOCOM.

[63]  Muriel Medard,et al.  Video-Centric Network Coding Strategies for 4G Wireless Networks: An Overview , 2010, 2010 7th IEEE Consumer Communications and Networking Conference.

[64]  John W. Woods,et al.  Video multicast using network coding , 2009, Electronic Imaging.

[65]  Muriel Médard,et al.  An algebraic approach to network coding , 2003, TNET.

[66]  Xin Wang,et al.  SonicVoD: A VCR-supported P2P-VoD system with network coding , 2009, IEEE Transactions on Consumer Electronics.

[67]  Shabnam Mirshokraie,et al.  Live peer-to-peer streaming with scalable video coding and networking coding , 2010, MMSys '10.

[68]  Licia Capra,et al.  Habit: Leveraging human mobility and social network for efficient content dissemination in Delay Tolerant Networks , 2009, 2009 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks & Workshops.

[69]  Siddhartha Annapureddy,et al.  Is high-quality vod feasible using P2P swarming? , 2007, WWW '07.

[70]  Baochun Li,et al.  Random network coding on the iPhone: fact or fiction? , 2009, NOSSDAV '09.

[71]  Peter Sanders,et al.  Polynomial time algorithms for multicast network code construction , 2005, IEEE Transactions on Information Theory.

[72]  Klara Nahrstedt,et al.  Identifying malicious nodes in network-coding-based peer-to-peer streaming networks , 2009 .

[73]  Ning Cai,et al.  Network Error Correction, I: Basic Concepts and Upper Bounds , 2006, Commun. Inf. Syst..

[74]  Christina Fragouli,et al.  Network Coding: Beyond Throughput Benefits , 2011, Proceedings of the IEEE.

[75]  Xiaojun Lin,et al.  Throughput and Delay Analysis on Uncoded and Coded Wireless Broadcast with Hard Deadline Constraints , 2010, 2010 Proceedings IEEE INFOCOM.

[76]  Morten Videbæk Pedersen,et al.  Synchronized multimedia streaming on the iPhone platform with network coding , 2011, 2011 IEEE Consumer Communications and Networking Conference (CCNC).

[77]  T. Ho,et al.  On Linear Network Coding , 2010 .

[78]  Baochun Li,et al.  Lava: A Reality Check of Network Coding in Peer-to-Peer Live Streaming , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[79]  C.-C. Jay Kuo,et al.  Robust video multicast with joint network coding and video interleaving , 2010, J. Vis. Commun. Image Represent..

[80]  Amin Vahdat,et al.  Bullet: high bandwidth data dissemination using an overlay mesh , 2003, SOSP '03.

[81]  Pan Hui,et al.  BUBBLE Rap: Social-Based Forwarding in Delay-Tolerant Networks , 2008, IEEE Transactions on Mobile Computing.

[82]  Erika Renata Kovacs,et al.  A Network Coding Algorithm for Multi-Layered Video Streaming , 2011, 2011 International Symposium on Networking Coding.

[83]  Morten Videbæk Pedersen,et al.  Multimedia distribution using network coding on the iphone platform , 2010, MCMC '10.

[84]  Multirate Media Streaming Using Network Coding , 2005 .

[85]  Athina Markopoulou,et al.  Defense against pollution attacks in network coding , 2012 .

[86]  Shenghao Yang,et al.  Coding for a network coded fountain , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[87]  Zunnun Narmawala,et al.  Survey on multimedia transmission using Network Coding over Wireless Networks , 2011, 2011 Nirma University International Conference on Engineering.

[88]  Michael Luby,et al.  LT codes , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[89]  R. Yeung,et al.  NETWORK ERROR CORRECTION, PART II: LOWER BOUNDS , 2006 .

[90]  Suhas N. Diggavi,et al.  Wireless Network Information Flow: A Deterministic Approach , 2009, IEEE Transactions on Information Theory.

[91]  Helen J. Wang,et al.  Distributing streaming media content using cooperative networking , 2002, NOSSDAV '02.

[92]  Baochun Li,et al.  On large-scale peer-to-peer streaming systems with network coding , 2008, ACM Multimedia.

[93]  Baochun Li,et al.  R2: Random Push with Random Network Coding in Live Peer-to-Peer Streaming , 2007, IEEE Journal on Selected Areas in Communications.

[94]  Petar Popovski,et al.  The Anti-Packets Can Increase the Achievable Throughput of a Wireless Multi-Hop Network , 2006, 2006 IEEE International Conference on Communications.

[95]  Frank H.P. Fitzek,et al.  PictureViewer - A mobile application using network coding , 2009, 2009 European Wireless Conference.

[96]  K. Jain,et al.  Practical Network Coding , 2003 .

[97]  Frank Eliassen,et al.  Chameleon: Adaptive Peer-to-Peer Streaming with Network Coding , 2010, 2010 Proceedings IEEE INFOCOM.

[98]  Jin Li,et al.  Mutualcast: An Efficient Mechanism for One-To-Many Content Distribution , 2005 .

[99]  Alexander Sprintson,et al.  Multipath Wireless Network Coding: A Population Game Perspective , 2009, 2010 Proceedings IEEE INFOCOM.

[100]  J. MacLaren Walsh,et al.  A Concatenated Network Coding Scheme for Multimedia Transmission , 2008, 2008 Fourth Workshop on Network Coding, Theory and Applications.

[101]  Enrico Magli,et al.  Band Codes: Controlled Complexity Network Coding for Peer-to-Peer Video Streaming , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[102]  Li Zhao,et al.  A peer-to-peer network for live media streaming using a push-pull approach , 2005, MULTIMEDIA '05.

[103]  April Rasala Lehman Network coding , 2005 .

[104]  Enrico Magli,et al.  Complexity-adaptive Random Network Coding for Peer-to-Peer video streaming , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[105]  Paul Francis,et al.  Chunkyspread: Multi-tree Unstructured Peer-to-Peer Multicast , 2006, IPTPS.

[106]  Frank R. Kschischang,et al.  A Rank-Metric Approach to Error Control in Random Network Coding , 2007, IEEE Transactions on Information Theory.

[107]  Christina Fragouli,et al.  Combinatiorial algorithms for wireless information flow , 2012, TALG.

[108]  Minas Gjoka,et al.  Kangaroo: video seeking in P2P systems , 2009, IPTPS.

[109]  Siddhartha Annapureddy,et al.  Providing Video-on-Demand using Peer-to-Peer Networks , 2006 .

[110]  Sangki Yun,et al.  Multi-Room IPTV Delivery through Pseudo-Broadcast over IEEE 802.11 Links , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[111]  Baochun Li,et al.  Tenor: making coding practical from servers to smartphones , 2010, ACM Multimedia.

[112]  John S. Thompson,et al.  Random Network Coding for Multimedia Delivery over LTE-Advanced , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[113]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[114]  Yang Guo,et al.  Scalable Video Multicast in Hybrid 3G/Ad-Hoc Networks , 2011, IEEE Transactions on Multimedia.

[115]  Ron M. Roth,et al.  Author's Reply to Comments on 'Maximum-rank array codes and their application to crisscross error correction' , 1991, IEEE Trans. Inf. Theory.

[116]  Athina Markopoulou,et al.  I2NC: Intra- and inter-session network coding for unicast flows in wireless networks , 2010, 2011 Proceedings IEEE INFOCOM.

[117]  Muriel Medard,et al.  Efficient Operation of Wireless Packet Networks Using Network Coding , 2005 .

[118]  Christina Fragouli,et al.  MicroPlay: a networking framework for local multiplayer games , 2012, MobileGames '12.