Fairness-oriented multi-stream rate adaptation using scalable video coding

In the delivery of video services like video on-demand, IP-TV, sport broadcasting, as well as real-time streaming, the end-user expectation is to receive the best feasible quality independently of the particular video complexity, even in the presence of packet losses. In this scenario, rate adaptation is required to optimize the overall quality, whereas fairness is an important issue that has to be addressed. In this paper we propose a multi-stream rate adaptation framework with reference to the scalable video coding (SVC) extension of the H.264/AVC standard with medium grain scalability (MGS). We first define a general discrete multi-objective problem with the aim to maximize the sum of assigned rates, while minimizing the differences among the expected distortions, under a total bit-rate constraint. A single-objective problem formulation is then derived by applying a continuous relaxation. Finally, a simplified continuous semi-analytical model that accurately estimates the rate-distortion relationship for both error-free channel and packet-erasure channel is also proposed, which allows us to derive an optimal and low-complexity procedure to solve the relaxed problem. Unequal erasure protection (UXP) is also considered and designed to suitably shape the rate-distortion relationship for different values of RTP packet-loss rate. The numerical results show the goodness of our framework in terms of error gap between the relaxed and its related discrete solution, and the significant performance improvement achieved with respect to an equal-rate adaptation scheme.

[1]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[2]  Thomas Wiegand,et al.  Scalable Video Coding for IPTV Services , 2009, IEEE Transactions on Broadcasting.

[3]  Lorenzo Favalli,et al.  Quality modeling for the medium grain scalability option of H.264/SVC , 2009, Mobimedia 2009.

[4]  Stéphane Pateux,et al.  Optimized Rate-Distortion Extraction with Quality Layers , 2006, 2006 International Conference on Image Processing.

[5]  Yun Q. Shi,et al.  Constant quality constrained rate allocation for FGS-coded video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Zhengguo Li,et al.  Rate Control of H.264/AVC Scalable Extension , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Hassan Mansour,et al.  Channel Aware Multiuser Scalable Video Streaming Over Lossy Under-Provisioned Channels: Modeling and Analysis , 2008, IEEE Transactions on Multimedia.

[8]  Truong Cong Thang,et al.  SVC adaptation: Standard tools and supporting methods , 2009, Signal Process. Image Commun..

[9]  Do-Kyoung Kwon,et al.  Rate Control for H.264 Video With Enhanced Rate and Distortion Models , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Heiko Schwarz,et al.  Wireless Broadcasting Using the Scalable Extension of H. 264/AVC , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[11]  Thomas Wiegand,et al.  Using H.264/AVC-based Scalable Video Coding (SVC) for Real Time Streaming in Wireless IP Networks , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[12]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Lap-Pui Chau,et al.  Joint Rate Allocation for Multiprogram Video Coding Using FGS , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Velio Tralli,et al.  Multi-stream Rate Adaptation Using Scalable Video Coding with Medium Grain Scalability , 2011, MobiMedia.

[15]  Hassan Mansour,et al.  Rate and distortion modeling of medium grain scalable video coding , 2008, 2008 15th IEEE International Conference on Image Processing.

[16]  Jörg Widmer,et al.  A Fast Rate-Adaptation Algorithm for Robust Wireless Scalable Streaming Applications , 2009, 2009 IEEE International Conference on Wireless and Mobile Computing, Networking and Communications.

[17]  Thomas Wiegand,et al.  Improved caching for HTTP-based Video on Demand using Scalable Video Coding , 2011, 2011 IEEE Consumer Communications and Networking Conference (CCNC).

[18]  R. Van de Walle,et al.  Statistical multiplexing using SVC , 2008, 2008 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[19]  A. Murat Tekalp,et al.  Effects of MGS fragmentation, slice mode and extraction strategies on the performance of SVC with medium-grained scalability , 2010, 2010 IEEE International Conference on Image Processing.

[20]  Stéphane Pateux,et al.  Optimized Rate-Distortion Extraction With Quality Layers in the Scalable Extension of H.264/AVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Aggelos K. Katsaggelos,et al.  Unequal Error Protection for Robust Streaming of Scalable Video Over Packet Lossy Networks , 2010, IEEE Transactions on Circuits and Systems for Video Technology.