Real-time smoothing for network adaptive video streaming

Real-time streaming delivery over the Internet with bandwidth variation is a very challenging task. It is important to smooth the quality variability and improve the utilization of the available network bandwidth. In this paper, we propose a real-time optimal smoothing scheduling algorithm for network adaptive video streaming with the variable network bandwidth and packet loss. The algorithm adopts a rate-distortion optimized framework and real-time scheduling scheme to select and schedule the packets according to the network status. It attempts to minimize the quality variability at the client end while at the same time maximizing the utilization of the variable network bandwidth. Experiments show that, compared with frame-based scheduling algorithm, our proposed real-time smoothing algorithm improves and smoothes the quality in decoded video frames.

[1]  Antonio Ortega,et al.  Expected Run-time Distortion Based Scheduling for Delivery of Sealable Media , 2002 .

[2]  Mostafa H. Ammar,et al.  Optimal quality adaptation for MPEG-4 fine-grained scalable video , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[3]  Khaled Shuaib,et al.  Robust compression and transmission of MPEG-4 video , 1999, MULTIMEDIA '99.

[4]  Zixiang Xiong,et al.  An optimal packetization scheme for fine granularity scalable bitstream , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[5]  Xuemin Chen,et al.  Fine granularity scalability in MPEG-4 for streaming video , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[6]  Yao Wang,et al.  Error control and concealment for video communications , 1999 .

[7]  Mihaela van der Schaar,et al.  The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP , 2001, IEEE Trans. Multim..

[8]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[9]  E. J. Weldon,et al.  Evaluation of the performance of error-correcting codes on a Gilbert channel , 1995, IEEE Trans. Commun..

[10]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Hayder Radha,et al.  Statistical analysis and distortion modeling of MPEG-4 FGS , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[12]  J. Walrand,et al.  RCBR: A Simple and Efficient Service for Multiple Time-Scale Traffic , 1995 .

[13]  Srihari Nelakuditi,et al.  Providing Smoother Quality Layered Video Stream , 2000 .

[14]  Sanjoy Paul,et al.  Layered video multicast with retransmissions (LVMR): evaluation of hierarchical rate control , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[15]  Steven McCanne,et al.  Soft ARQ for Layered Streaming Media , 2001, J. VLSI Signal Process..

[16]  Donald F. Towsley,et al.  Supporting stored video: reducing rate variability and end-to-end resource requirements through optimal smoothing , 1996, SIGMETRICS '96.

[17]  Wen Gao,et al.  Real-time scheduling and online resource allocation on scalable streaming media server , 2003, Visual Communications and Image Processing.

[18]  E. J. Weldon,et al.  Evaluation of the performance of error-correcting codes on a Gilbert channel , 1994, Proceedings of ICC/SUPERCOMM'94 - 1994 International Conference on Communications.

[19]  Mostafa H. Ammar,et al.  A comparison of layering and stream replication video multicast schemes , 2001, NOSSDAV '01.

[20]  Jon M. Peha,et al.  Streaming video over the Internet: approaches and directions , 2001, IEEE Trans. Circuits Syst. Video Technol..

[21]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM.

[22]  Giorgio Buttazzo,et al.  Hard Real-Time Computing Systems: Predictable Scheduling Algorithms and Applications , 1997 .

[23]  Peng Gao,et al.  Real-time scheduling on scalable media stream delivery , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[24]  James W. Layland,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[25]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.