Side-Information Generation for Temporally and Spatially Scalable Wyner-Ziv Codecs

The distributed video coding paradigm enables video codecs to operate with reversed complexity, in which the complexity is shifted from the encoder toward the decoder. Its performance is heavily dependent on the quality of the side information generated by motio estimation at the decoder. We compare the rate-distortion performance of different side-information estimators, for both temporally and spatially scalable Wyner-Ziv codecs. For the temporally scalable codec we compared an established method with a new algorithm that uses a linear-motion model to produce side-information. As a continuation of previous works, in this paper, we propose to use a super-resolution method to upsample the nonkey frame, for the spatial scalable codec, using the key frames as reference. We verify the performance of the spatial scalable WZ coding using the state-of-the-art video coding standard H.264/AVC.

[1]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  F. Pereira,et al.  Evaluating a feedback channel based transform domain Wyner-Ziv video codec , 2008, Signal Process. Image Commun..

[3]  Antonio Ortega,et al.  A Framework for Adaptive Scalable Video Coding Using Wyner-Ziv Techniques , 2006, EURASIP J. Adv. Signal Process..

[4]  Rui Zhang,et al.  Wyner-Ziv coding for video: applications to compression and error resilience , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[5]  R. Queiroz,et al.  A STATISTICAL MODEL FOR A MIXED RESOLUTION WYNER-ZIV FRAMEWORK , 2007 .

[6]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[7]  Kannan Ramchandran,et al.  A DISTRIBUTED-SOURCE-CODING BASED ROBUST SPATIO-TEMPORAL SCALABLE VIDEO CODEC , 2004 .

[8]  Luis Torres,et al.  Iterative generation of motion-compensated side information for distributed video coding , 2005, IEEE International Conference on Image Processing 2005.

[9]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[10]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUSS): design and construction , 1999 .

[11]  Debargha Mukherjee.  Optimal Parameter Choice for Wyner-Ziv Coding of Laplacian Sources with Decoder Side-Information , 2007 .

[12]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[13]  Michael T. Orchard,et al.  Design of trellis codes for source coding with side information at the decoder , 2001, Proceedings DCC 2001. Data Compression Conference.

[14]  Bruno Macchiavello,et al.  A simple reversed-complexity Wyner-Ziv video coding mode based on a spatial reduction framework , 2007, Electronic Imaging.

[15]  Warnakulasuriya Anil Chandana Fernando,et al.  An Iterative Refinement Technique for Side Information Generation in DVC , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[16]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[17]  Anastasios N. Venetsanopoulos,et al.  A JPEG-based interpolative image coding scheme , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[18]  Debargha Mukherjee,et al.  Super-resolution of video using key frames and motion estimation , 2008, 2008 15th IEEE International Conference on Image Processing.

[19]  Edward J. Delp,et al.  Wyner-Ziv video side estimator: conventional motion search methods revisited , 2005, IEEE International Conference on Image Processing 2005.

[20]  Catarina Brites,et al.  IMPROVING FRAME INTERPOLATION WITH SPATIAL MOTION SMOOTHING FOR PIXEL DOMAIN DISTRIBUTED VIDEO CODING , 2005 .

[21]  Catarina Brites,et al.  Motion compensated refinement for low complexity pixel based distributed video coding , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[22]  Bruno Macchiavello,et al.  Motion-Based Side-Information Generation for a Scalable Wyner-Ziv Video Coder , 2007, 2007 IEEE International Conference on Image Processing.

[23]  Bernd Girod,et al.  Compression with side information using turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[24]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[25]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[26]  Debargha Mukherjee,et al.  A Robust Reversed-Complexity Wyner-Ziv Video Codec Introducing Sign-Modulated Codes , 2006 .

[27]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[28]  Mourad Ouaret,et al.  Codec-Independent Scalable Distributed Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[29]  Zixiang Xiong,et al.  Layered Wyner–Ziv Video Coding , 2006, IEEE Transactions on Image Processing.

[30]  Catarina Brites,et al.  Extrapolating Side Information for Low-Delay Pixel-Domain Distributed Video Coding , 2005, VLBV.

[31]  Edward J. Delp,et al.  Rate Distortion Analysis of Motion Side Estimation in Wyner–Ziv Video Coding , 2007, IEEE Transactions on Image Processing.

[32]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .