Frame-Based Multiple-Description Video Coding with Extended Orthogonal Filter Banks

We propose a frame-based multiple-description video coder. The analysis filter bank is the extension of an orthogonal filter bank which computes the spatial polyphase components of the original video frames. The output of the filter bank is a set of video sequences which can be compressed with a standard coder. The filter bank design is carried out by taking into account two important requirements for video coding, namely, the fact that the dual synthesis filter bank is FIR, and that loss recovery does not enhance the quantization error. We give explicit results about the required properties of the redundant channel filter and the reconstruction error bounds in case of packet errors. We show that the proposed scheme has good error robustness to losses and good performance, both in terms of objective and visual quality, when compared to single description and other multiple description video coders based on spatial subsampling. PSNR gains of 5 dB or more are typical for packet loss probability as low as 5%.

[1]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[2]  Riccardo Bernardini,et al.  Low-delay reconstruction of punctured frame-coded streams , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[3]  Vinay A. Vaishampayan,et al.  Design of multiple description scalar quantizers , 1993, IEEE Trans. Inf. Theory.

[4]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[5]  Faouzi Kossentini,et al.  Multiple description image coding using pre- and post-processing , 2001, Proceedings International Conference on Information Technology: Coding and Computing.

[6]  Michael T. Orchard,et al.  Multiple description coding using pairwise correlating transforms , 2001, IEEE Trans. Image Process..

[7]  Thomas Wiegand,et al.  Draft ITU-T recommendation and final draft international standard of joint video specification , 2003 .

[8]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[9]  Martin Vetterli,et al.  Optimal filter banks for multiple description coding: Analysis and synthesis , 2002, IEEE Trans. Inf. Theory.

[10]  Sethuraman Panchanathan,et al.  Adaptive multiple description coding for Internet video , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[11]  Alan J. Mayne,et al.  Generalized Inverse of Matrices and its Applications , 1972 .

[12]  F. Graybill,et al.  Matrices with Applications in Statistics. , 1984 .

[13]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[14]  Avideh Zakhor,et al.  Matching pursuits multiple description coding for wireless video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[15]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[16]  K. S. Banerjee.  Generalized Inverse of Matrices and Its Applications , 1973 .

[17]  Richard E. Ladner,et al.  Unequal loss protection: graceful degradation of image quality over packet erasure channels through forward error correction , 2000, IEEE Journal on Selected Areas in Communications.

[18]  John G. Apostolopoulos,et al.  On multiple description streaming with content delivery networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[19]  Faouzi Kossentini,et al.  Standard-compliant multiple description video coding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  J. Schmee.  Matrices with Applications in Statistics , 1982 .

[21]  Martin Vetterli,et al.  Oversampled filter banks , 1998, IEEE Trans. Signal Process..

[22]  Roberto Rinaldo,et al.  Efficient reconstruction from frame-based multiple descriptions , 2005, IEEE Transactions on Signal Processing.