Adaptive playout for real-time media streaming

When media is streamed over best-effort networks, a buffer at the client protects against playout interruptions due to variations in the data arrival rate. While the amount of protection offered grows with the size of the client's buffer, so does the latency that is introduced. In this paper we show how adaptive media playout (AMP) - the variation of the playout speed of media frames depending on the condition of the channel - allows smaller buffer sizes and correspondingly smaller delays for a given level of protection against buffer underflow. We demonstrate this with the results of Markov chain analyses and with simulations. In addition, we consider AMP as a form of receiver-driven rate scalability, allowing clients access to streams encoded at higher source rates than their connections would ordinarily allow.

[1]  Werner Verhelst,et al.  An overlap-add technique based on waveform similarity (WSOLA) for high quality time-scale modification of speech , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Bernd Girod,et al.  Adaptive playout scheduling using time-scale modification in packet voice communications , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[3]  Bernd Girod,et al.  Real-time voice communication over the internet using packet path diversity , 2001, MULTIMEDIA '01.

[4]  Bernd Girod,et al.  Adaptive media playout for low-delay video streaming over error-prone channels , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Alan Lippman.  Video coding for multiple target audiences , 1998, Electronic Imaging.

[6]  Steven McCanne,et al.  Soft ARQ for Layered Streaming Media , 2001, J. VLSI Signal Process..

[7]  Bernd Girod,et al.  A new error concealment technique for audio transmission with packet loss , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[8]  Maria C. Yuang,et al.  Dynamic video playout smoothing method for multimedia applications , 1999 .

[9]  Bernd Girod,et al.  Adaptive playout for low latency video streaming , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[10]  Alan F. Lippman,et al.  Video coding for streaming media delivery on the Internet , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Shu Lin,et al.  Automatic-repeat-request error-control schemes , 1984, IEEE Communications Magazine.