Frequent layer switching for perceived quality improvements of coarse-grained scalable video

Scalable video is an attractive option for adapting the bandwidth consumption of streaming video to the available bandwidth. Fine-grained scalability can adapt most closely to the available bandwidth, but this comes at the cost of a higher overhead compared to more coarse-grained videos. In the context of VoD streaming, we have therefore explored whether a similar adaptation to the available bandwidth can be achieved by performing layer switching in coarse-grained scalable videos. In this approach, enhancement layers of a video stream are switched on and off to achieve any desired longer term bandwidth. We have performed three user studies, two using mobile devices and one using an HDTV display, to evaluate the idea. In several cases, the far-from-obvious conclusion is that layer switching is a viable way of achieving bit-rate savings and fine-grained bit-rate adaptation even for rather short times between layer switches, but it does, however, depend on scaling dimensions, content and display device.

[1]  Ralf Steinmetz,et al.  Subjective impression of variations in layer encoded videos , 2003, IWQoS'03.

[2]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  M. Angela Sasse,et al.  The sweet spot: how people trade off size and definition on mobile devices , 2008, ACM Multimedia.

[4]  Ashweeni Kumar Beeharee,et al.  Visual attention based information culling for Distributed Virtual Environments , 2003, VRST '03.

[5]  Carsten Griwodz,et al.  Fine-grained scalable streaming from coarse-grained videos , 2009, NOSSDAV '09.

[6]  M. Angela Sasse,et al.  Sharp or smooth?: comparing the effects of quantization vs. frame rate for streamed video , 2004, CHI '04.

[7]  Chee Sun Won,et al.  Efficient use of local edge histogram descriptor , 2000, MULTIMEDIA '00.

[8]  Ajay Divakaran,et al.  MPEG-7 visual motion descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[9]  Alexander Eichhorn,et al.  Pick Your Layers Wisely - A Quality Assessment of H.264 Scalable Video Coding for Mobile Devices , 2009, 2009 IEEE International Conference on Communications.

[10]  Liam Murphy,et al.  User perception of adapting video quality , 2006, Int. J. Hum. Comput. Stud..

[11]  Mark Claypool,et al.  On combining temporal scaling and quality scaling for streaming MPEG , 2006, NOSSDAV '06.

[12]  Murat Kunt,et al.  Human Vision Models for Perceptually Optimized Image Processing – A Review , 2000 .

[13]  M. P. Hollier,et al.  Models of Human Perception , 1999 .

[14]  Thomas Schierl,et al.  Transport and Signaling of SVC in IP Networks , 2007, IEEE Transactions on Circuits and Systems for Video Technology.