Rate-distortion optimized hybrid error control for real-time packetized video transmission

The problem of application-layer error control for real-time video transmission over packet lossy networks is commonly addressed via joint source-channel coding (JSCC), where source coding and forward error correction (FEC) are jointly designed to compensate for packet losses. In this paper, we consider hybrid application-layer error correction consisting of FEC and retransmissions. The study is carried out in an integrated joint source-channel coding (IJSCC) framework, where error resilient source coding, channel coding, and error concealment are jointly considered in order to achieve the best video delivery quality. We first show the advantage of the proposed IJSCC framework as compared to a sequential JSCC approach, where error resilient source coding and channel coding are not fully integrated. In the IJSCC framework, we also study the performance of different error control scenarios, such as pure FEC, pure retransmission, and their combination. Pure FEC and application layer retransmissions are shown to each achieve optimal results depending on the packet loss rates and the round-trip time. A hybrid of FEC and retransmissions is shown to outperform each component individually due to its greater flexibility.

[1]  Arne Svensson,et al.  Hybrid type-II ARQ/AMS and scheduling using channel prediction for downlink packet transmission and fading channels , 2001 .

[2]  Aggelos K. Katsaggelos,et al.  Rate-Distortion Based Video Compression: Optimal Video Frame Compression and Object Boundary Encoding , 1996 .

[3]  Itu-T.  Video coding for low bitrate communication , 1996 .

[4]  Harsha Sirisena,et al.  Hybrid error control mechanism for video transmission in the wireless IP networks , 1999, 10th IEEE Workshop on Local and Metropolitan Area Networks. Selected Papers (IEEE Cat. No.99EX512).

[5]  Bo Li,et al.  An end-to-end approach for optimal mode selection in Internet video communication: theory and application , 2000, IEEE Journal on Selected Areas in Communications.

[6]  Philip A. Chou,et al.  Application layer error-correction coding for rate-distortion optimized streaming to wireless clients , 2002, IEEE Transactions on Communications.

[7]  Faouzi Kossentini,et al.  Optimal mode selection and synchronization for robust video communications over error-prone networks , 2000, IEEE Journal on Selected Areas in Communications.

[8]  Steven McCanne,et al.  Limited retransmission of real-time layered multimedia , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[9]  Avideh Zakhor,et al.  Bit allocation for joint source/channel coding of scalable video , 2000, IEEE Trans. Image Process..

[10]  Donald F. Towsley,et al.  Measurement and modelling of the temporal dependence in packet loss , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[11]  Bernice E. Rogowitz,et al.  Conference on Human Vision and Electronic Imaging , 1996 .

[12]  Aggelos K. Katsaggelos,et al.  Rate-distortion optimized hybrid error control for real-time packetized video transmission , 2006 .

[13]  Aggelos K. Katsaggelos,et al.  Rate-Distortion Based Video Compression , 1997, Springer US.

[14]  Madhu Sudan,et al.  Priority encoding transmission , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[15]  Yücel Altunbasak,et al.  Error-resilient image and video transmission over the Internet using unequal error protection , 2003, IEEE Trans. Image Process..

[16]  Faouzi Kossentini,et al.  Rate-distortion optimized layered coding with unequal error protection for robust Internet video , 2001, IEEE Trans. Circuits Syst. Video Technol..

[17]  Thrasyvoulos N. Pappas,et al.  Packetization schemes for forward error correction in Internet video streaming , 2003 .

[18]  Thrasyvoulos N. Pappas,et al.  Joint block-based video source/channel coding for packet-switched networks , 1998, Electronic Imaging.

[19]  Aggelos K. Katsaggelos,et al.  Joint source coding and packet classification for real-time video transmission over differentiated services networks , 2005, IEEE Transactions on Multimedia.

[20]  Henning Schulzrinne,et al.  An RTP Payload Format for Generic Forward Error Correction , 1999, RFC.

[21]  Ya-Qin Zhang,et al.  Transporting real-time video over the Internet: challenges and approaches , 2000, Proceedings of the IEEE.

[22]  Douglas L. Jones,et al.  Joint source channel matching for a wireless image transmission , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[23]  Qian Zhang,et al.  Network-adaptive scalable video streaming over 3G wireless network , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[24]  Aggelos K. Katsaggelos,et al.  Joint source-channel coding for motion-compensated DCT-based SNR scalable video , 2002, IEEE Trans. Image Process..

[25]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[26]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[27]  Zixiang Xiong,et al.  Joint error control and power allocation for video transmission over CDMA networks with multiuser detection , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[28]  NARIMAN FARVARDIN,et al.  Optimal quantizer design for noisy channels: An approach to combined source - channel coding , 1987, IEEE Trans. Inf. Theory.

[29]  Thomas Stockhammer,et al.  Progressive Texture Video Streaming for Lossy Packet Networks , 2001 .

[30]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[31]  Guijin Wang,et al.  Channel-adaptive error control for scalable video over wireless channel , 2000 .

[32]  John M. Danskin,et al.  Joint source and channel coding for Internet image transmission , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[33]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[34]  Rui Zhang,et al.  End-to-end distortion estimation for RD-based robust delivery of pre-compressed video , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[35]  Ian F. Akyildiz,et al.  AdaptNet: an adaptive protocol suite for the next-generation wireless Internet , 2004, IEEE Communications Magazine.

[36]  Si Wu,et al.  Unequal error protection for motion compensated video streaming over the Internet , 2002, Proceedings. International Conference on Image Processing.

[37]  Albert Wang,et al.  Error control for receiver-driven layered multicast of audio and video , 2001, IEEE Trans. Multim..