Compressed Domain Video Processing for Tile Based Panoramic Streaming using SHVC

Panoramic streaming is a particular way of video streaming where an arbitrary Region-of-Interest (RoI) of high-spatial resolution videos is transmitted, allowing users to navigate around the video and leading to an immersive experience. Tile based streaming has been proposed in the past and is drawing a lot of attention to provide a solution that scales well. In tile base streaming the video is divided into multiple tiles and a subset of tiles of interest is transmitted to the viewer. We propose a low-complexity compressed domain video processing technique, which uses H.265/SHVC and generates a single video bitstream from the selected tiles so that single hardware decoders can be used to decode the RoI video stream. Additionally, the proposed technique makes it possible to use Open GOP structures in the output layer without incurring in any interruption at switching events, which provides a better compression efficiency compared to closed GOP structures.

[1]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Wei Tsang Ooi,et al.  Adaptive encoding of zoomable video streams based on user access pattern , 2011, MMSys.

[3]  Peter Eisert,et al.  The Ultimate Immersive Experience: Panoramic 3D Video Acquisition , 2012, MMM.

[4]  Bernd Girod,et al.  An interactive region-of-interest video streaming system for online lecture viewing , 2010, 2010 18th International Packet Video Workshop.

[5]  Hans Stokking,et al.  Spatial segmentation for immersive media delivery , 2011, 2011 15th International Conference on Intelligence in Next Generation Networks.

[6]  Thomas Schierl,et al.  Compressed domain video compositing with HEVC , 2015, 2015 Picture Coding Symposium (PCS).

[7]  Yu-Wen Huang,et al.  Motion vector coding techniques for HEVC , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[8]  Thomas Schierl,et al.  Compressed domain video processing for tile based panoramic streaming using HEVC , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[9]  Thomas Wiegand,et al.  Low complexity cloud-video-mixing using HEVC , 2014, 2014 IEEE 11th Consumer Communications and Networking Conference (CCNC).

[10]  Bernd Girod,et al.  Optimal slice size for streaming regions of high resolution video with virtual pan/tilt/zoom functionality , 2007, 2007 15th European Signal Processing Conference.