Rate-distortion optimized layered coding with unequal error protection for robust Internet video

We present an effective framework for increasing the error-resilience of low bit-rate video communications over an error-prone packet-switched network. Our framework is based on the principle of layered coding with transport prioritization. We introduce a rate-distortion optimized mode-selection algorithm for our prioritized layered framework. This algorithm is based on a joint source/channel-coding approach and trades off source coding efficiency for increased bitstream error-resilience to optimize the video coding mode selection within and across layers. The algorithm considers the channel conditions, as well as the error recovery and concealment capabilities, of the channel codec and source decoder, respectively. Important framework parameters including the packetization scheme, decoder error concealment method, and channel codec error-protection strength are considered. The effects of mismatch between the parameters employed by the encoder and the actual channel conditions are considered. Results are presented for a wide range of packet loss rates in order to illustrate the benefits of the proposed framework.

[1]  Thomas R. Gardos,et al.  Improving H.263+ scalability performance for very low bit-rate applications , 1998, Electronic Imaging.

[2]  Itu-T.  Video coding for low bitrate communication , 1996 .

[3]  Aggelos K. Katsaggelos,et al.  Error resilience and concealment in video coding , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[4]  Faouzi Kossentini,et al.  Efficient scalable DCT-based video coding at low bit rates , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[5]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[6]  S. Wicker.  Error Control Systems for Digital Communication and Storage , 1994 .

[7]  Jörg Ott,et al.  Error resilience support in H.263+ , 1998, IEEE Trans. Circuits Syst. Video Technol..

[8]  Faouzi Kossentini,et al.  Optimal mode selection and synchronization for robust video communications over error-prone networks , 2000, IEEE Journal on Selected Areas in Communications.

[9]  Jo Yew Tham,et al.  Highly scalable wavelet-based video codec for very low bit-rate environment , 1998, IEEE J. Sel. Areas Commun..

[10]  Kenneth Rose,et al.  Towards optimal scalability in predictive video coding , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[11]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[12]  Hayder Radha,et al.  Error concealment of still image and video streams with multi-directional recursive nonlinear filters , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[13]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[14]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[15]  B. Girod,et al.  Robust H.263 compatible transmission for mobile video server access , 1996, Proceedings of First International Workshop on Wireless Image/Video Communications.

[16]  Faouzi Kossentini,et al.  H.263+: video coding at low bit rates , 1998, IEEE Trans. Circuits Syst. Video Technol..

[17]  Gustavo de los Reyes,et al.  Video transcoding for resilience in wireless channels , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[18]  K Ramchandran,et al.  Best wavelet packet bases in a rate-distortion sense , 1993, IEEE Trans. Image Process..

[19]  Mohammed Ghanbari,et al.  Two-layer coding of video signals for VBR networks , 1989, IEEE J. Sel. Areas Commun..

[20]  Jörg Ott,et al.  Application of H.263+ Video Coding Modes in Lossy Packet Network Environments , 1999, J. Vis. Commun. Image Represent..

[21]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[22]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[23]  Faouzi Kossentini,et al.  Optimal intra coding of blocks for robust video communication over the Internet , 1999, Signal Process. Image Commun..

[24]  Bernd Girod,et al.  Scalable Video Coding With Multiscale Motion Compensation And Unequal Error Protection , 1996 .

[25]  Ernst W. Biersack,et al.  Performance Avaluation of Forward Error Correction in an ATM Environment , 1993, IEEE J. Sel. Areas Commun..

[26]  R. Talluri,et al.  Error-resilient video coding in the ISO MPEG-4 standard , 1998, IEEE Commun. Mag..

[27]  Hiroshi Ohta,et al.  A Cell Loss Recovery Method Using FEC in ATM Networks , 1991, IEEE J. Sel. Areas Commun..

[28]  Mohammed Ghanbari.  An adapted H.261 two-layer video codec for ATM networks , 1992, IEEE Trans. Commun..

[29]  Jörg Ott,et al.  RTP Payload Format for the 1998 Version of ITU-T Rec. H.263 Video (H.263+) , 1998, RFC.

[30]  James W. Modestino,et al.  Design of a transport coding scheme for high-quality video over ATM networks , 1997, IEEE Trans. Circuits Syst. Video Technol..

[31]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[32]  Henning Schulzrinne,et al.  An RTP Payload Format for Generic Forward Error Correction , 1999, RFC.

[33]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[34]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[35]  John D. Villasenor,et al.  Adaptive intra update for video coding over noisy channels , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.