Super-resolution applied to Distributed Video Coding with Spatial Scalability

Distributed Video Coding is a new video coding paradigm that enables video codecs with reversed complexity. It is well-known that the performance of any distributed video coder is heavily dependent on the quality of the side information generated by motion-estimation at the decoder. As a continuation of previous works, in this paper we propose to use a super-resolution method to up-sample the non-key frames using the key frames as reference, in order to improve the side information generation in a distributed video coding scheme with spatial scalability. The framework, proposed in previous works, enables reduced encoding complexity by reduced spatial-resolution encoding of the non-reference frames, followed by Wyner-Ziv coding of the Laplacian residue. The side information generation is iterative, in the first iteration the high-frequency data of matching blocks from the key frames are added to the low-resolution blocks of the interpolated downsampled frames. Results are presented using the state-of-the-art video coding standard H.264/AVC. Keywords— Super-resolution, Wyner-Ziv, spatial scalabilty.

[1]  Debargha Mukherjee,et al.  A Robust Reversed-Complexity Wyner-Ziv Video Codec Introducing Sign-Modulated Codes , 2006 .

[2]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[4]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[5]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[6]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[7]  Michael T. Orchard,et al.  Design of trellis codes for source coding with side information at the decoder , 2001, Proceedings DCC 2001. Data Compression Conference.

[8]  Debargha Mukherjee Optimal Parameter Choice for Wyner-Ziv Coding of Laplacian Sources with Decoder Side-Information , 2007 .

[9]  Bruno Macchiavello,et al.  A simple reversed-complexity Wyner-Ziv video coding mode based on a spatial reduction framework , 2007, Electronic Imaging.

[10]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[11]  R. Queiroz,et al.  A STATISTICAL MODEL FOR A MIXED RESOLUTION WYNER-ZIV FRAMEWORK , 2007 .

[12]  Debargha Mukherjee,et al.  Super resolution of video using key frames , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[13]  Zixiang Xiong,et al.  Layered Wyner–Ziv Video Coding , 2006, IEEE Transactions on Image Processing.

[14]  Bruno Macchiavello,et al.  Motion-Based Side-Information Generation for a Scalable Wyner-Ziv Video Coder , 2007, 2007 IEEE International Conference on Image Processing.

[15]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[16]  Antonio Ortega,et al.  A Framework for Adaptive Scalable Video Coding Using Wyner-Ziv Techniques , 2006, EURASIP J. Adv. Signal Process..

[17]  Bernd Girod,et al.  Compression with side information using turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.