Rate-distortion optimized unequal loss protection for video transmission over packet erasure channels

Video transmission over networks often suffers from packet loss due to network congestions and stringent end-to-end delay constraints. In this paper, we develop a Rate-Distortion optimized Unequal Loss Protection (RD-ULP) scheme to combat packet loss. Based on packet-level transmission distortion modeling, we estimate the amount of contribution of each video packet to the reconstructed video quality, which defines the priority level of each packet. Unequal amounts of protection are then allocated to different video packets according to their priority levels and the dynamic channel conditions. The proposed RD-ULP resource allocation problem is formulated as a constrained nonlinear optimization problem. An optimization algorithm based on Particle Swarm Optimization (PSO) is then developed to solve the optimal resource allocation problem. Our extensive experimental results demonstrate the effectiveness of the proposed RD-ULP scheme, which outperforms existing methods by up to 2dB in the reconstructed video quality.

[1]  Zhihai He,et al.  Fine-Granularity Transmission Distortion Modeling for Video Packet Scheduling Over Mesh Networks , 2010, IEEE Transactions on Multimedia.

[2]  Richard E. Ladner,et al.  Approximately optimal assignment for unequal loss protection , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[3]  Yong Pei,et al.  An Adaptive Motion-Based Unequal Error Protection Approach for Real-Time Video Transport Over Wireless IP Networks , 2006, IEEE Transactions on Multimedia.

[4]  Zhihai He,et al.  Transmission Distortion Analysis for Real-Time Video Encoding and Streaming Over Wireless Networks , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Richard E. Ladner,et al.  Unequal loss protection for H.263 compressed video , 2005, Data Compression Conference, 2003. Proceedings. DCC 2003.

[6]  Joumana Farah,et al.  A novel approach to achieve unequal error protection for video transmission over 3G wireless networks , 2004, Signal Process. Image Commun..

[7]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[8]  Chengke Wu,et al.  A novel unequal loss protection approach for scalable video streaming over wireless networks , 2007, IEEE Trans. Consumer Electron..

[9]  Ya-Qin Zhang,et al.  Transporting real-time video over the Internet: challenges and approaches , 2000, Proceedings of the IEEE.

[10]  Richard E. Ladner,et al.  Unequal loss protection for H.263 compressed video , 2005, IEEE Trans. Circuits Syst. Video Technol..

[11]  Ali C. Begen,et al.  Multi-path selection for multiple description encoded video streaming , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[12]  Mihaela van der Schaar,et al.  Multi-user video streaming over multi-hop wireless networks: A distributed, cross-layer approach based on priority queuing , 2007, IEEE Journal on Selected Areas in Communications.

[13]  Bernd Girod,et al.  R-D hint tracks for low-complexity R-D optimized video streaming [rate-distortion hint track] , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[14]  Xingjun Zhang,et al.  A Hierarchical Unequal Packet Loss Protection Scheme for Robust H.264/AVC Transmission , 2009, 2009 6th IEEE Consumer Communications and Networking Conference.

[15]  M. Chakraborty,et al.  Unequally protected SPIHT video codec for low bit rate transmission over highly error-prone mobile channels , 2002, Signal Process. Image Commun..

[16]  Aggelos K. Katsaggelos,et al.  Content-aware resource allocation and packet scheduling for video transmission over wireless networks , 2007, IEEE Journal on Selected Areas in Communications.

[17]  Yücel Altunbasak,et al.  Error-resilient image and video transmission over the Internet using unequal error protection , 2003, IEEE Trans. Image Process..

[18]  Jill M. Boyce,et al.  Packet loss effects on MPEG video sent over the public Internet , 1998, MULTIMEDIA '98.

[19]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[20]  Yong Pei,et al.  Cross-Layer QoS Control for Video Communications over Wireless Ad Hoc Networks , 2005, EURASIP J. Wirel. Commun. Netw..

[21]  Mihaela van der Schaar,et al.  Unequal packet loss resilience for fine-granular-scalability video , 2001, IEEE Trans. Multim..

[22]  Wei Zhang,et al.  Distortion-Minimized Video Slicing for Unequal Loss Protection , 2009, IEEE Signal Processing Letters.

[23]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[24]  Christian Leicher.  Hierarchical Encoding of MPEG Sequences Using Priority Encoding Transmission (PET) , 1994 .

[25]  E. O. Elliott.  A model of the switched telephone network for data communications , 1965 .

[26]  Dong-Ho Cho,et al.  An adaptive redundancy control method for erasure-code-based real-time data transmission over the Internet , 2001, IEEE Trans. Multim..

[27]  Shivendra S. Panwar,et al.  Multipath video transport over ad hoc networks , 2005, IEEE Wireless Communications.

[28]  Harsha Sirisena,et al.  Hybrid error control mechanism for video transmission in the wireless IP networks , 1999, 10th IEEE Workshop on Local and Metropolitan Area Networks. Selected Papers (IEEE Cat. No.99EX512).

[29]  Madhu Sudan,et al.  Priority encoding transmission , 1996, IEEE Trans. Inf. Theory.

[30]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[31]  Bernd Girod,et al.  Robust Internet video transmission based on scalable coding and unequal error protection , 1999, Signal Process. Image Commun..

[32]  Bernd Girod,et al.  Distortion chains for predicting the video distortion for general packet loss patterns , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[33]  Richard E. Ladner,et al.  Unequal loss protection: graceful degradation of image quality over packet erasure channels through forward error correction , 2000, IEEE Journal on Selected Areas in Communications.

[34]  Stavros Kotsopoulos,et al.  Intelligence packet scheduling for optimized video transmission over wireless networks , 2007, Mobimedia 2007.

[35]  Zhengguo Li,et al.  An unequal packet loss resilience scheme for video over the Internet , 2005, IEEE Transactions on Multimedia.

[36]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[37]  Mihaela van der Schaar,et al.  Informationally Decentralized Video Streaming Over Multihop Wireless Networks , 2007, IEEE Transactions on Multimedia.

[38]  James W. Modestino,et al.  A joint source coding-power control approach for video transmission over CDMA networks , 2003, IEEE J. Sel. Areas Commun..

[39]  Rui Zhang,et al.  Optimized video streaming over lossy networks with real-time estimation of end-to-end distortion , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[40]  Zhihai He,et al.  Transmission Distortion-optimized Unequal Loss Protection for video transmission over packet erasure channels , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[41]  Thomas Wiegand,et al.  SVC-based multisource streaming for robust video transmission in mobile ad hoc networks , 2006, IEEE Wireless Communications.

[42]  Si Wu,et al.  Unequal loss protection for robust transmission of motion compensated video over the internet , 2003, Signal Process. Image Commun..

[43]  K. Ramchandran,et al.  Multiple description source coding using forward error correction codes , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[44]  Edward J. Delp,et al.  Feedback aided content adaptive unequal error protection based on Wyner-Ziv coding , 2009, 2009 Picture Coding Symposium.

[45]  Gregory W. Wornell,et al.  © Copyright Hewlett-Packard Company 2001MODELING PATH DIVERSITY FOR MULTIPLE DESCRIPTION VIDEO COMMUNICATION , 2001 .

[46]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[47]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[48]  Bernd Girod,et al.  Packet-loss-resilient Internet video streaming , 1998, Electronic Imaging.

[49]  Bernd Girod,et al.  Network-adaptive low-latency video communication over best-effort networks , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[50]  Zixiang Xiong,et al.  Real-time error protection of embedded codes for packet erasure and fading channels , 2004, IEEE Transactions on Circuits and Systems for Video Technology.