Receiver-based rate-distortion optimized interactive streaming for scalable bitstreams of light fields

The paper proposes a receiver-based rate-distortion optimized framework to stream interactively scalable bitstreams of light fields. Based on the desired viewpoints, the predicted future buffer state, the network characteristics, and the target transmission rate, the receiver customizes the data request in order to minimize the distortion in the frames to be rendered. Experimental results show that the proposed framework improves the rendering quality by 1.0-2.8 dB over a heuristic scheme at the same rate. Correspondingly, to achieve the same rendering quality the proposed framework reduces 25-35% of the rate over the heuristic scheme.

[1]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[2]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[3]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[4]  Zixiang Xiong,et al.  On packetization of embedded multimedia bitstreams , 2001, IEEE Trans. Multim..

[5]  Xiaoqing Zhu,et al.  Light field compression using disparity-compensated lifting , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[6]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[7]  Bernd Girod,et al.  Rate-distortion optimized streaming of compressed light fields , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[9]  David S. Taubman,et al.  Rate-distortion optimized interactive browsing of JPEG2000 images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[10]  Bernd Girod,et al.  Receiver-based rate-distortion optimized interactive streaming for scalable bitstreams of light fields , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[11]  P. Cosman,et al.  Wavelet zerotree image compression with packetization , 1998, IEEE Signal Processing Letters.