Content-based MPEG-2 structuring and protection

We address a new error-resilient scheme for broadcast-quality interactive MPEG-2 video streams to be transmitted over lossy packet networks. A new scene-complexity adaptive mechanism, namely Adaptive MPEG-2 Information Structuring and Protection (AMISP) is introduced. AMISP lies on an information structuring scheme which modulates the number of resynchronization points (i.e., slice headers and intra-coded macroblocks) in order to maximize the perceived video quality. The video quality the end-user experiences depends both on the quality of the compressed video before transmission and on the degradation due to packet loss. Therefore, the structuring scheme constantly determines the best compromise between the rate allocated to encoding pure video information and the rate aiming at reducing the sensitivity to packet loss. It is then extended with a Forward Error Correction (FEC) based protection algorithm to become AMISP. AMISP triggers the insertion of FEC packets in the MPEG-2 video packet stream. Finally, it is shown that AMISP outperforms usual MPEG-2 transmission schemes, and offers an acceptable video quality even at loss ratios as high as 10-2. Video quality is estimated using the Moving Picture Quality Metric, which proved to behave consistently with human judgment.

[1]  Michael R. Frater,et al.  MPEG 2 Video Services for Wireless ATM Networks , 1997, IEEE J. Sel. Areas Commun..

[2]  Wei Wang,et al.  AFEC: an adaptive forward error correction protocol for end-to-end transport of real-time traffic , 1998, Proceedings 7th International Conference on Computer Communications and Networks (Cat. No.98EX226).

[3]  Jean-Chrysotome Bolot.  End-to-end packet delay and loss behavior in the internet , 1993, SIGCOMM 1993.

[4]  A. Vega-García.  Layered Error-control Coding for Ip Multicast 7.0 References Layered Error-control Coding for Ip Multicast 6.0 Summary , 1997 .

[5]  Wei Wang,et al.  QoS-sensitive transport of real-time MPEG video using adaptive forward error correction , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[6]  James W. Modestino,et al.  Design of a transport coding scheme for high-quality video over ATM networks , 1997, IEEE Trans. Circuits Syst. Video Technol..

[7]  Francisco Javier,et al.  Designing New Network Adaptation and ATM Adaptation Layers for Interactive Multimedia Applications , 1998 .

[8]  Andrea Basso,et al.  Error concealment and early resynchronization techniques for MPEG-2 video streams damaged by transmission over ATM networks , 1996, Electronic Imaging.

[9]  Pascal Frossard,et al.  Adaptive MPEG-2 information structuring , 1999, Other Conferences.

[10]  Georg Carle,et al.  Survey of error recovery techniques for IP-based audio-visual multicast applications , 1997, IEEE Netw..

[11]  Ernst W. Biersack,et al.  Performance Avaluation of Forward Error Correction in an ATM Environment , 1993, IEEE J. Sel. Areas Commun..

[12]  Vivek K. Goyal,et al.  RTP Payload Format for MPEG1/MPEG2 Video , 1996, RFC.

[13]  Cheng-Tie Chen,et al.  Adaptation of the MPEG video-coding algorithm to network applications , 1993, IEEE Trans. Circuits Syst. Video Technol..

[14]  Masahiro Wada,et al.  Selective recovery of video packet loss using error concealment , 1989, IEEE J. Sel. Areas Commun..

[15]  Antonio Ortega,et al.  Multiple description coding via polyphase transform and selective quantization , 1998, Electronic Imaging.

[16]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[17]  Liang-Gee Chen,et al.  Error concealment of lost motion vectors with overlapped motion compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[18]  Iain E. Garden Richardson,et al.  Varying slice size to improve error tolerance of MPEG video , 1996, Electronic Imaging.

[19]  Steven McCanne,et al.  Low-Complexity Video Coding for Receiver-Driven Layered Multicast , 1997, IEEE J. Sel. Areas Commun..

[20]  Shih-Fu Chang,et al.  Effective algorithms for video transmission over wireless channels , 1998, Signal Process. Image Commun..

[21]  C. van den Branden Lambrecht.  A working spatio-temporal model of the human visual system for image restoration and quality assessment applications , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[22]  Madhu Sudan,et al.  Priority encoding transmission , 1996, IEEE Trans. Inf. Theory.

[23]  Henning Schulzrinne,et al.  An RTP Payload Format for Generic Forward Error Correction , 1999, RFC.

[24]  Ya-Qin Zhang,et al.  Performance of MPEG Codecs in the Presence of Errors , 1994, J. Vis. Commun. Image Represent..

[25]  Donald F. Towsley,et al.  Parity-based loss recovery for reliable multicast transmission , 1997, TNET.

[26]  Michael O. Rabin,et al.  Efficient dispersal of information for security, load balancing, and fault tolerance , 1989, JACM.

[27]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[28]  Jean-Chrysostome Bolot,et al.  End-to-end packet delay and loss behavior in the internet , 1993, SIGCOMM '93.

[29]  Gunnar Karlsson,et al.  User-oriented QoS in packet video delivery , 1998, IEEE Netw..

[30]  Paul E. McKenney,et al.  Packet recovery in high-speed networks using coding and buffer management , 1990, Proceedings. IEEE INFOCOM '90: Ninth Annual Joint Conference of the IEEE Computer and Communications Societies@m_The Multiple Facets of Integration.

[31]  Luigi Rizzo,et al.  Effective erasure codes for reliable computer communication protocols , 1997, CCRV.

[32]  Mohammed Ghanbari,et al.  Cell-loss concealment in ATM video codecs , 1993, IEEE Trans. Circuits Syst. Video Technol..

[33]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[34]  Pascal Frossard,et al.  AMISP: a complete content-based MPEG-2 error-resilient scheme , 2001, IEEE Trans. Circuits Syst. Video Technol..

[35]  Gunnar Karlsson,et al.  Asynchronous transfer of video , 1996, IEEE Commun. Mag..

[36]  Mark R. Pickering,et al.  Error Resilience in Video and Multiplexing Layers for Very Low Bit-Rate Video Coding Systems , 1997, IEEE J. Sel. Areas Commun..

[37]  E. Gilbert.  Capacity of a burst-noise channel , 1960 .

[38]  Pascal Frossard,et al.  Perceptual MPEG-2 Syntactic Information Coding: A Performance Study based on Psychophysics , 1997 .

[39]  Steven McCanne,et al.  vic: a flexible framework for packet video , 1995, MULTIMEDIA '95.

[40]  Cheng-Tie Chen.  Error Detection and Concealment with an Unsupervised MPEG2 Video Decoder , 1995, J. Vis. Commun. Image Represent..