Optimal bit allocation for fine-grained scalable video sequences in distributed streaming environments

We present optimal schemes for allocating bits of fine-grained scalable video sequences among multiple senders streaming to a single receiver. This allocation problem is critical in optimizing the perceived quality in peer-to-peer and distributed multi-server streaming environments. Senders in such environments are heterogeneous in their outgoing bandwidth and they hold different portions of the video stream. We formulate the allocation problem as an optimization problem, which is nonlinear in general. We use rate-distortion models in the formulation to achieve the minimum distortion in the rendered video, constrained by the outgoing bandwidth of senders, availability of video data at senders, and incoming bandwidth of receiver. We show how the adopted rate-distortion models transform the nonlinear problem to an integer linear programming (ILP) problem. We then design a simple rounding scheme that transforms the ILP problem to a linear programming (LP) one, which can be solved efficiently using common optimization techniques such as the Simplex method. We prove that our rounding scheme always produces a feasible solution, and the solution is within a negligible margin from the optimal solution. We also propose a new algorithm (FGSAssign) for the allocation problem that runs in O(n log n) steps, where n is the number of senders. We prove that FGSAssign is optimal. Because of its short running time, FGSAssign can be used in real time during the streaming session. Our experimental study validates our analytical analysis and shows the effectiveness of our allocation algorithm in improving the video quality.

[1]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[2]  Bharat K. Bhargava,et al.  CollectCast: A peer-to-peer service for media streaming , 2005, Multimedia Systems.

[3]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[4]  Yuval Rabani,et al.  Linear Programming , 2007, Handbook of Approximation Algorithms and Metaheuristics.

[5]  Yun Q. Shi,et al.  Constant quality constrained rate allocation for FGS-coded video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Dmitri Loguinov,et al.  Analysis of rate-distortion functions and congestion control in scalable internet video streaming , 2003, NOSSDAV '03.

[7]  Ali C. Begen,et al.  Rate-distortion optimized on-demand media streaming with server diversity , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Reza Rejaie,et al.  Adaptive receiver-driven streaming from multiple senders , 2006, Multimedia Systems.

[9]  Klara Nahrstedt,et al.  Layered peer-to-peer streaming , 2003, NOSSDAV '03.

[10]  Wen Gao,et al.  Statistical model, analysis and approximation of rate-distortion function in MPEG-4 FGS videos , 2005, Visual Communications and Image Processing.

[11]  Hayder Radha,et al.  Rate-distortion modeling of scalable video coders , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  HsuCheng-Hsin,et al.  On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences , 2008 .

[13]  Cheng-Hsin Hsu,et al.  Rate-Distortion Models for FGS-encoded Video Sequences , 2006 .

[14]  Ralf Steinmetz,et al.  Subjective impression of variations in layer encoded videos , 2003, IWQoS'03.

[15]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[16]  Jun Sun,et al.  Statistical model, analysis and approximation of rate-distortion function in MPEG-4 FGS videos , 2006, IEEE Trans. Circuits Syst. Video Technol..

[17]  Cheng-Hsin Hsu,et al.  On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences , 2008, TOMCCAP.

[18]  Xiao Su,et al.  Sequence of linear programming for transmission of fine-scalable coded content in bandwidth-limited environments , 2006, Multimedia Systems.

[19]  Avideh Zakhor,et al.  Distributed video streaming over Internet , 2001, IS&T/SPIE Electronic Imaging.

[20]  Mihaela van der Schaar,et al.  The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP , 2001, IEEE Trans. Multim..

[21]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[22]  Iso/iec 14496-2 Information Technology — Coding of Audio-visual Objects — Part 2: Visual , .

[23]  Bernd Girod,et al.  Rate-distortion optimized packet scheduling and routing for media streaming with path diversity , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[24]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..