Sender-based rate-distortion optimized streaming of 3-D wavelet video with low latency

We propose a sender-based rate-distortion optimized framework to stream scalable bitstreams of 3-D wavelet video stored at the sender to a remote receiver. Based on the requests and feedback from the receiver, the source rate-distortion profiles, the desired playout latency and transmission rate, and the network characteristics, the sender optimizes the responses sent to the receiver throughout the video playout session in order to minimize the distortion in the reconstructed frames. Rate-distortion optimized response is formulated as a convex optimization problem, and an offline-computation approach is proposed to further reduce the complexity at the sender. Experimental results show that the proposed sender-based approach outperform the receiver-based approach, and the offline-computation approach very closely approximates the fully-optimized approach.

[1]  Bernd Girod,et al.  Rate-distortion optimized video streaming with rich acknowledgments , 2004, IS&T/SPIE Electronic Imaging.

[2]  Bernd Girod,et al.  Rate-distortion optimized streaming for 3-D wavelet video , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[3]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[4]  David S. Taubman,et al.  Motion-compensated highly scalable video compression using an adaptive 3D wavelet transform based on lifting , 2001, ICIP.

[5]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[6]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[7]  Shipeng Li,et al.  Motion compensated lifting wavelet and its application in video coding , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[8]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[9]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..