Witsenhausen-Wyner video coding

Inspired by Witsenhausen and Wyner's 1980 (now expired) patent on “interframe coder for video signals”, this paper presents a Witsenhausen-Wyner video codec, where the previously decoded video frame is used at the decoder as side information for joint decoding. Specifically, we replace the predictive Inter coding in H.264/AVC by the syndrome-based coding scheme of Wistenhausen and Wyner, while keeping the Intra and Skip modes unchanged. Within Wistenhausen-Wyner coding mode, we optimize the decisions between syndrome coding and entropy coding among different DCT bands and among different bit-planes within each DCT coefficient. We employ forward motion estimation at the encoder and send the motion vectors to help generate the side information at the decoder, since our focus is not on low-complexity encoding. We also examine the tradeoff between the motion vector resolution and coding performance. Extensive simulations of video transmission over wireless networks show that Witsenhausen-Wyner video coding is much more robust against channel errors than H.264/AVC. The price paid for enhanced error-resilience with Witsenhausen-Wyner coding is a small loss in compression efficiency.

[1]  Bernd Girod,et al.  Wyner-Ziv video coding with hash-based motion compensation at the receiver , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Markus Flierl,et al.  Wyner-Ziv coding of video with unsupervised motion vector learning , 2008, Signal Process. Image Commun..

[3]  Zixiang Xiong,et al.  A distributed source coding technique for correlated images using turbo-codes , 2002, IEEE Communications Letters.

[4]  Wen Gao,et al.  Wyner–Ziv-Based Multiview Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Catarina Brites,et al.  Refining Side Information for Improved Transform Domain Wyner-Ziv Video Coding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  B. Girod,et al.  Wyner-Ziv quantization and transform coding of noisy sources at high rates , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[7]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[8]  Neri Merhav,et al.  On successive refinement for the Wyner-Ziv problem , 2004, IEEE Transactions on Information Theory.

[9]  Catarina Brites,et al.  Correlation Noise Modeling for Efficient Pixel and Transform Domain Wyner–Ziv Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[11]  Sae-Young Chung,et al.  Analysis of sum-product decoding of low-density parity-check codes using a Gaussian approximation , 2001, IEEE Trans. Inf. Theory.

[12]  S. Onoe,et al.  The 3GPP proposal for IMT-2000 , 1999, IEEE Commun. Mag..

[13]  John M. Shea,et al.  Hyper-trellis decoding of pixel-domain Wyner-Ziv video coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Christine Guillemot,et al.  3-D Model-Based Frame Interpolation for Distributed Video Coding of Static Scenes , 2007, IEEE Transactions on Image Processing.

[15]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[16]  Catarina Brites,et al.  IMPROVING FRAME INTERPOLATION WITH SPATIAL MOTION SMOOTHING FOR PIXEL DOMAIN DISTRIBUTED VIDEO CODING , 2005 .

[17]  Zixiang Xiong,et al.  Layered Wyner–Ziv Video Coding , 2006, IEEE Transactions on Image Processing.

[18]  Wen Gao,et al.  Distributed video coding using wavelet , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[19]  Edward J. Delp,et al.  Rate Distortion Analysis of Motion Side Estimation in Wyner–Ziv Video Coding , 2007, IEEE Transactions on Image Processing.

[20]  Zixiang Xiong,et al.  Successive refinement for the Wyner-Ziv problem and layered code design , 2004, IEEE Transactions on Signal Processing.

[21]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[22]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[23]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[24]  Vinod M. Prabhakaran,et al.  Syndrome-Based Robust Video Transmission Over Networks with Bursty Losses , 2006, 2006 International Conference on Image Processing.

[25]  Zixiang Xiong,et al.  Compression of binary sources with side information at the decoder using LDPC codes , 2002, IEEE Communications Letters.

[26]  Edward J. Delp,et al.  Efficient and Low-Complexity Surveillance Video Compression Using Backward-Channel Aware Wyner-Ziv Video Coding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Wen Gao,et al.  Wyner–Ziv Switching Scheme for Multiple Bit-Rate Video Streaming , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  D. Marpe,et al.  The H.264/MPEG4 advanced video coding standard and its applications , 2006, IEEE Communications Magazine.

[29]  Shlomo Shamai,et al.  Nested linear/Lattice codes for structured multiterminal binning , 2002, IEEE Trans. Inf. Theory.

[30]  Faouzi Kossentini,et al.  H.263+: video coding at low bit rates , 1998, IEEE Trans. Circuits Syst. Video Technol..

[31]  Aaron D. Wyner,et al.  Recent results in the Shannon theory , 1974, IEEE Trans. Inf. Theory.

[32]  Edward J. Delp,et al.  Wyner–Ziv Video Coding With Universal Prediction , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Ahmet M. Kondoz,et al.  An Improved Decoding Algorithm for DVC Over Multipath Error Prone Wireless Channels , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Zixiang Xiong,et al.  Two-Terminal Video Coding , 2009, IEEE Transactions on Image Processing.

[35]  Zixiang Xiong,et al.  Wyner-Ziv coding based on TCQ and LDPC codes , 2005, IEEE Transactions on Communications.

[36]  Bruno Macchiavello,et al.  Iterative Side-Information Generation in a Mixed Resolution Wyner-Ziv Framework , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[38]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[39]  Bernd Girod,et al.  Wyner-Ziv Residual Coding of Video , 2006 .

[40]  Rüdiger L. Urbanke,et al.  Design of capacity-approaching irregular low-density parity-check codes , 2001, IEEE Trans. Inf. Theory.

[41]  Zixiang Xiong,et al.  Wyner–Ziv Video Compression and Fountain Codes for Receiver-Driven Layered Multicast , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Kannan Ramchandran,et al.  Achieving H.264-like compression efficiency with distributed video coding , 2007, Electronic Imaging.

[43]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[44]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[45]  Kannan Ramchandran,et al.  PRISM: A Video Coding Paradigm With Motion Estimation at the Decoder , 2007, IEEE Transactions on Image Processing.