Optimum adaptation trajectories for streamed multimedia

Most adaptive delivery mechanisms for streaming multimedia content do not explicitly consider user-perceived quality when making adaptations. We propose that an optimal adaptation trajectory through the set of possible encodings exists and that it indicates how to adapt encoding quality in response to changes in network conditions to maximize user-perceived quality. Such an optimum adaptation trajectory can be used with any transmission adaptation policy. We describe the subjective tests we carried out to find such trajectories for a number of different MPEG-4 video clips and indicate how this knowledge could be used in the operation of a practical system.

[1]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[2]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[3]  Stefan Winkler,et al.  Vision models and quality metrics for image processing applications , 2001 .

[4]  Pascal Frossard,et al.  MPEG-2 Video Services over Packet Networks: Joint Effect of Encoding Rate and Data Loss on User-Oriented QoS , 1998 .

[5]  Yong Wang,et al.  Content-adaptive utility-based video adaptation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[6]  Shih-Fu Chang,et al.  Video Adaptation: Concepts, Technologies, and Open Issues , 2005, Proceedings of the IEEE.

[7]  H. R. Wu,et al.  Human visual system based objective digital video quality metrics , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[8]  Michael W. Levine,et al.  Fundamentals of sensation and perception , 1981 .

[9]  Yong Wang,et al.  Predicting optimal operation of MC-3DSBC multidimensional scalable video coding using subjective quality measurement , 2004, IS&T/SPIE Electronic Imaging.

[10]  Liam Murphy,et al.  User-perceived quality-aware adaptive delivery of MPEG-4 content , 2003, NOSSDAV '03.

[11]  Liang-Gee Chen,et al.  Special Issue on Advances in Video Coding and Delivery , 2005, Proc. IEEE.

[12]  Martin Vetterli,et al.  Receiver-driven layered multicast , 1996, SIGCOMM 1996.

[13]  Adam Wolisz,et al.  MLDA: a TCP-friendly congestion control framework for heterogeneous multicast environments , 2000, 2000 Eighth International Workshop on Quality of Service. IWQoS 2000 (Cat. No.00EX400).

[14]  Steven McCanne,et al.  Receiver-driven layered multicast , 1996, SIGCOMM '96.

[15]  Adam Wolisz,et al.  LDA+: a TCP-friendly adaptation scheme for multimedia communication , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[16]  Yong Wang,et al.  Subjective preference of spatio-temporal rate in video adaptation using multi-dimensional scalable coding , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[17]  Henning Schulzrinne,et al.  The Loss-delay Based Adjustment Algorithm: a Tcp-friendly Adaptation Scheme , 1998 .

[18]  Nick Feamster,et al.  Packet Loss Recovery for Streaming Video , 2002 .

[19]  Sheila S. Hemami,et al.  Perceived quality metrics for low bit rate compressed video , 2002, Proceedings. International Conference on Image Processing.

[20]  Ferran Marqués,et al.  The MPEG-4 Book , 2003, J. Electronic Imaging.

[21]  Haim Lefkovitz.  Fundamentals of sensation and perception, 3rd ed , 2001 .

[22]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.