Joint source-channel coding and optimization for mobile video streaming in heterogeneous wireless networks

This paper investigates mobile video delivery in a heterogeneous wireless network from a video server to a multi-homed client. Joint source-channel coding (JSCC) has proven to be an effective solution for video transmission over bandwidth-limited, error-prone wireless networks. However, one major problem with the existing JSCC approaches is that they consider the network between the server and the client as a single transport link. The situation becomes more complicated in the context of multiple available links because involving a low-bandwidth, highly lossy, or long-delay wireless network in the transmission will only degrade the video quality. To address the critical problem, we propose a novel flow rate allocation-based JSCC (FRA-JSCC) approach that includes three key phases: (1) forward error correction redundancy estimation under loss requirement, (2) source rate adaption under delay constraint, and (3) dynamic rate allocation to minimize end-to-end video distortion. We present a mathematical formulation of JSCC to optimize video quality over multiple wireless channels and provide comprehensive analysis for channel distortion. We evaluate the performance of FRA-JSCC through emulations in Exata and compare it with the existing schemes. Experimental results show that FRA-JSCC outperforms the competing models in improving the video peak signal-to-noise ratio as well as in reducing the end-to-end delay.

[1]  Mitchell D. Trott,et al.  Path diversity for enhanced media streaming , 2004, IEEE Communications Magazine.

[2]  Kameswari Chebrolu,et al.  Bandwidth aggregation for real-time applications in heterogeneous wireless networks , 2006 .

[3]  Richard G. Baraniuk,et al.  pathChirp: Efficient available bandwidth estimation for network paths , 2003 .

[4]  Y.T. Hou,et al.  On Path Selection and Rate Allocation for Video in Wireless Mesh Networks , 2009, IEEE/ACM Transactions on Networking.

[5]  Wei Song,et al.  Performance Analysis of Probabilistic Multipath Transmission of Video Streaming Traffic over Multi-Radio Wireless Devices , 2012, IEEE Transactions on Wireless Communications.

[6]  Douglas L. Jones,et al.  A general joint source-channel matching method for wireless video transmission , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[7]  Dharma P. Agrawal,et al.  Handling network uncertainty in heterogeneous wireless networks , 2011, 2011 Proceedings IEEE INFOCOM.

[8]  Weihua Zhuang,et al.  Improving Voice and Data Services in Cellular/WLAN Integrated Networks by Admission Control , 2007, IEEE Transactions on Wireless Communications.

[9]  F. Richard Yu,et al.  Optimal network selection in heterogeneous wireless multimedia networks , 2010, Wirel. Networks.

[10]  Koushik Kar,et al.  A Transport Protocol to Exploit Multipath Diversity in Wireless Networks , 2012, IEEE/ACM Transactions on Networking.

[11]  Michael G. Strintzis,et al.  Robust Transmission of H.264/AVC Video using Adaptive Slice Grouping and Unequal Error Protection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[12]  Aggelos K. Katsaggelos,et al.  Rate-distortion optimized hybrid error control for real-time packetized video transmission , 2006, IEEE Transactions on Image Processing.

[13]  Sampath Rangarajan,et al.  MuVi: a multicast video delivery scheme for 4g cellular networks , 2012, Mobicom '12.

[14]  Luc Vandendorpe,et al.  Joint Source-Channel Turbo Techniques for Discrete-Valued Sources: From Theory to Practice By efficiently combining source codes and channel codes, turbo techniques can improve the overall performance of practical communication systems. , 2007 .

[15]  Wei Wei,et al.  Multipath live streaming via TCP: scheme, performance and benefits , 2007, CoNEXT '07.

[16]  Tansu Alpcan,et al.  Distributed Rate Allocation Policies for Multihomed Video Streaming Over Heterogeneous Access Networks , 2009, IEEE Transactions on Multimedia.

[17]  Pascal Frossard,et al.  Joint source/FEC rate selection for quality-optimal MPEG-2 video delivery , 2001, IEEE Trans. Image Process..

[18]  Shakeel Ahmad,et al.  Adaptive Unicast Video Streaming With Rateless Codes and Feedback , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Pascal Frossard,et al.  Media Flow Rate Allocation in Multipath Networks , 2007, IEEE Transactions on Multimedia.

[20]  Hwangjun Song,et al.  An End-to-End Virtual Path Construction System for Stable Live Video Streaming over Heterogeneous Wireless Networks , 2011, IEEE Journal on Selected Areas in Communications.

[21]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[22]  Vern Paxson,et al.  Framework for IP Performance Metrics , 1998, RFC.

[23]  Pascal Frossard,et al.  Video Packet Selection and Scheduling for Multipath Streaming , 2007, IEEE Transactions on Multimedia.

[24]  Zixiang Xiong,et al.  Distributed joint source-channel coding of video using Raptor codes , 2005, Data Compression Conference.

[25]  Robert W. Heath,et al.  A Cross-Layer Design for Perceptual Optimization Of H.264/SVC with Unequal Error Protection , 2012, IEEE Journal on Selected Areas in Communications.

[26]  H. Anthony Chan,et al.  Bandwidth aggregation in heterogeneous wireless networks: A survey of current approaches and issues , 2012, J. Netw. Comput. Appl..

[27]  Hui Deng,et al.  A New Method for End-to-End Available Bandwidth Estimation , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[28]  Gabriella Olmo,et al.  Slice Sorting for Unequal Loss Protection of Video Streams , 2008, IEEE Signal Processing Letters.

[29]  Hao Yang,et al.  EMS: Encoded Multipath Streaming for real-time live streaming applications , 2009, 2009 17th IEEE International Conference on Network Protocols.

[30]  Wen Gao,et al.  Joint Source-Channel Rate-Distortion Optimization for H.264 Video Coding Over Error-Prone Networks , 2007, IEEE Transactions on Multimedia.

[31]  Maja Bystrom,et al.  Combined source-channel coding schemes for video transmission over an additive white Gaussian noise channel , 2000, IEEE Journal on Selected Areas in Communications.

[32]  Pascal Frossard,et al.  Forward Error Correction for Multipath Media Streaming , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Eleni M. Kalokairinou,et al.  7. From Theory to Practice 195 , 2012 .

[34]  Luc Vandendorpe,et al.  Joint Source–Channel Turbo Techniques for Discrete-Valued Sources: From Theory to Practice , 2007, Proceedings of the IEEE.

[35]  Yao Zhao,et al.  Dynamic Sub-GOP Forward Error Correction Code for Real-Time Video Applications , 2012, IEEE Transactions on Multimedia.

[36]  Manish Jain,et al.  Pathload: A Measurement Tool for End-to-End Available Bandwidth , 2002 .

[37]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[38]  Ming-Ting Sun,et al.  Compressed Video Over Networks , 2000 .

[39]  Marc Moeneclaey,et al.  Analysis and Construction of Full-Diversity Joint Network-LDPC Codes for Cooperative Communications , 2010, EURASIP J. Wirel. Commun. Netw..

[40]  Peter Schelkens,et al.  Scalable Joint Source and Channel Coding of Meshes , 2008, IEEE Transactions on Multimedia.

[41]  Yiqiang Chen,et al.  Joint Source-Channel Coding and Optimization for Layered Video Broadcasting to Heterogeneous Devices , 2012, IEEE Transactions on Multimedia.