VAPOR: variance-aware per-pixel optimal resource allocation

Characterizing the video quality seen by an end-user is a critical component of any video transmission system. In packet-based communication systems, such as wireless channels or the Internet, packet delivery is not guaranteed. Therefore, from the point-of-view of the transmitter, the distortion at the receiver is a random variable. Traditional approaches have primarily focused on minimizing the expected value of the end-to-end distortion. This paper explores the benefits of accounting for not only the mean, but also the variance of the end-to-end distortion when allocating limited source and channel resources. By accounting for the variance of the distortion, the proposed approach increases the reliability of the system by making it more likely that what the end-user sees, closely resembles the mean end-to-end distortion calculated at the transmitter. Experimental results demonstrate that variance-aware resource allocation can help limit error propagation and is more robust to channel-mismatch than approaches whose goal is to strictly minimize the expected distortion.

[1]  Bo Li,et al.  An end-to-end approach for optimal mode selection in Internet video communication: theory and application , 2000, IEEE Journal on Selected Areas in Communications.

[2]  Amy R. Reibman,et al.  Constraints on variable bit-rate video for ATM networks , 1992, IEEE Trans. Circuits Syst. Video Technol..

[3]  Mihaela van der Schaar,et al.  Control of the distortion variation in video coding systems based on motion compensated temporal filtering , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[4]  Itu-T Video coding for low bitrate communication , 1996 .

[5]  Faouzi Kossentini,et al.  Optimal mode selection and synchronization for robust video communications over error-prone networks , 2000, IEEE Journal on Selected Areas in Communications.

[6]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[7]  Athanasios Leontaris,et al.  Video compression with intra/inter mode switching and a dual frame buffer , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[8]  Raynard O. Hinds,et al.  Robust mode selection for block-motion-compensated video encoding , 1999 .

[9]  Antonio Ortega,et al.  Rate control for robust video transmission over burst-error wireless channels , 1999, IEEE J. Sel. Areas Commun..

[10]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[11]  Aggelos K. Katsaggelos,et al.  Rate-Distortion Based Video Compression: Optimal Video Frame Compression and Object Boundary Encoding , 1996 .

[12]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Rui Zhang,et al.  Prescient mode selection for robust video coding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[14]  Aggelos K. Katsaggelos,et al.  Optimal source coding and transmission power management using a min-max expected distortion approach , 2002, Proceedings. International Conference on Image Processing.

[15]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[16]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[17]  Thomas Wiegand,et al.  Optimized transmission of H.26L/JVT coded video over packet-lossy networks , 2002, Proceedings. International Conference on Image Processing.

[18]  Thomas Wiegand,et al.  Error-resilient video transmission using long-term memory motion-compensated prediction , 2000, IEEE Journal on Selected Areas in Communications.

[19]  Aggelos K. Katsaggelos,et al.  Channel modeling and its effect on the end-to-end distortion in wireless video communications , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[20]  Sanjiv Nanda,et al.  Adaptation techniques in wireless packet data services , 2000, IEEE Commun. Mag..

[21]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[22]  Aggelos K. Katsaggelos,et al.  Rate-Distortion Based Video Compression , 1997, Springer US.

[23]  Sheila S. Hemami,et al.  MINMAX rate control with a perceived distortion metric , 2004, IS&T/SPIE Electronic Imaging.

[24]  Aggelos K. Katsaggelos,et al.  Joint source coding and transmission power management for energy efficient wireless video communications , 2002, IEEE Trans. Circuits Syst. Video Technol..

[25]  Aggelos K. Katsaggelos,et al.  Variance-aware distortion estimation for wireless video communications , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[26]  Shlomo Shamai,et al.  Information theoretic considerations for cellular mobile radio , 1994 .

[27]  Aggelos K. Katsaggelos,et al.  Advances in Efficient Resource Allocation for Packet-Based Real-Time Video Transmission , 2005, Proceedings of the IEEE.

[28]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[29]  Aggelos K. Katsaggelos,et al.  Joint source coding and packet classification for real-time video transmission over differentiated services networks , 2005, IEEE Transactions on Multimedia.

[30]  Hua Yang,et al.  Recursive end-to-end distortion estimation with model-based cross-correlation approximation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[31]  Aggelos K. Katsaggelos,et al.  A Review of the Minimum Maximum Criterion for Optimal Bit Allocation Among Dependent Quantizers , 1999, IEEE Trans. Multim..

[32]  Bernice E. Rogowitz,et al.  Conference on Human Vision and Electronic Imaging , 1996 .