Unequal loss protection for robust transmission of motion compensated video over the internet

This paper presents an unequal loss protection (ULP) scheme for robust transmission of motion compensated video over the Internet. By exploiting the temporal dependency between frames, forward error correction (FEC) codes across packets are assigned to different frames in a group of pictures in the sense of minimizing the effect of error propagation, thus improving video quality significantly. To achieve optimal allocation of FEC codes, we formulate the effect of packet loss on video quality degradation as an expected length of error propagation (ELEP) model, which makes sense intuitively, as fewer frames corrupted implies better quality of reconstructed video. Experimental results show the validity of the proposed ELEP model and that the associated ULP scheme is robust to burst packet loss in the Internet. More importantly, graceful degradation of video quality is achieved by the proposed scheme as the packet loss rate of an Internet connection increases.

[1]  Ajay Luthra,et al.  Introduction to the special issue on streaming video , 2001, IEEE Trans. Circuits Syst. Video Technol..

[2]  John G. Apostolopoulos,et al.  On multiple description streaming with content delivery networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[3]  Richard E. Ladner,et al.  Unequal loss protection: graceful degradation of image quality over packet erasure channels through forward error correction , 2000, IEEE Journal on Selected Areas in Communications.

[4]  E. O. Elliott A model of the switched telephone network for data communications , 1965 .

[5]  Jean Bolot,et al.  Adaptive FEC-Based Error Control for Interactive Audio in the Internet , 1998 .

[6]  Homer H. Chen,et al.  Error-resilient coding in JPEG-2000 and MPEG-4 , 2000, IEEE Journal on Selected Areas in Communications.

[7]  Michael T. Orchard,et al.  Multiple-description video coding using motion-compensated temporal prediction , 2002, IEEE Trans. Circuits Syst. Video Technol..

[8]  Donald F. Towsley,et al.  Measurement and modelling of the temporal dependence in packet loss , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[9]  Injong Rhee,et al.  Error control techniques for interactive low-bit rate video transmission over the Internet , 1998, SIGCOMM '98.

[10]  Dong-Ho Cho,et al.  An adaptive redundancy control method for erasure-code-based real-time data transmission over the Internet , 2001, IEEE Trans. Multim..

[11]  Fernando Pereira,et al.  Error resilience and concealment performance for MPEG-4 frame-based video coding , 1999, Signal Process. Image Commun..

[12]  Qian Zhang,et al.  Resource allocation for multimedia streaming over the Internet , 2001, IEEE Trans. Multim..

[13]  John Villasenor,et al.  An RTP Payload Format for Generic FEC with Uneven Level Protection , 2000 .

[14]  Madhu Sudan,et al.  Priority encoding transmission , 1996, IEEE Trans. Inf. Theory.

[15]  Harsha Sirisena,et al.  Hybrid error control mechanism for video transmission in the wireless IP networks , 1999, 10th IEEE Workshop on Local and Metropolitan Area Networks. Selected Papers (IEEE Cat. No.99EX512).

[16]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[17]  Mihaela van der Schaar,et al.  Unequal packet loss resilience for fine-granular-scalability video , 2001, IEEE Trans. Multim..

[18]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[19]  Donald F. Towsley,et al.  Adaptive FEC-based error control for Internet telephony , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[20]  Bernd Girod,et al.  Robust Internet video transmission based on scalable coding and unequal error protection , 1999, Signal Process. Image Commun..

[21]  Wendi B. Heinzelman,et al.  Application-specific protocol architectures for wireless networks , 2000 .

[22]  Ya-Qin Zhang,et al.  Transporting real-time video over the Internet: challenges and approaches , 2000, Proceedings of the IEEE.

[23]  Bernd Girod,et al.  Channel-adaptive video streaming using packet path diversity and rate-distortion optimized reference picture selection , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[24]  Christian Leicher Hierarchical Encoding of MPEG Sequences Using Priority Encoding Transmission (PET) , 1994 .

[25]  Amy R. Reibman,et al.  Modeling one- and two-layer variable bit rate video , 1999, TNET.

[26]  Yao Wang,et al.  Multiple description image coding using signal decomposition and reconstruction based on lapped orthogonal transforms , 1999, IEEE Trans. Circuits Syst. Video Technol..

[27]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[28]  Nick Feamster,et al.  Packet Loss Recovery for Streaming Video , 2002 .