Rate-distortion-optimized content-adaptive coding for immersive networked experience of sports events

This paper presents a content-adaptive coding scheme for immersive networked experience of sports events, in particular, soccer games. We assume that future sports events are captured by an array of fixed high-definition cameras which provide multiview image sequences for a free-viewpoint immersive networked experience in a home environment. We discuss a content-adaptive coding scheme for image sequences that exploits properties of such sequences and that permits efficient user interactions. In this work, we construct a rate distortion model for an image sequence to obtain the optimal bitrate allocation among static and dynamic content items. The optimal bitrate allocation results in a rate distortion performance of the coding scheme that outperforms that of conventional H.264/AVC coding significantly.

[1]  Itu-T and Iso Iec Jtc.  Advanced video coding for generic audiovisual services , 2010 .

[2]  Roland Mech,et al.  A noise robust method for segmentation of moving objects in video sequences , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Thomas Sikora,et al.  Extending H.264/AVC with a background sprite prediction mode , 2008, 2008 15th IEEE International Conference on Image Processing.

[4]  Harvey J. Everett.  Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[5]  Wen Gao,et al.  Modeling Background and Segmenting Moving Objects from Compressed Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Stefan Carlsson,et al.  Multi-Target Tracking - Linking Identities using Bayesian Network Inference , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[8]  Thomas Wiegand,et al.  A generic and automatic content-based approach for improved H.264/MPEG4-AVC video coding , 2005, IEEE International Conference on Image Processing 2005.