Multi-hypothesis distributed stereo video coding

Distributed Video Coding (DVC) is a video coding paradigm that exploits the source statistics at the decoder based on the availability of the Side Information (SI). Stereo sequences are constituted by two views to give the user an illusion of depth. In this paper, we present a DVC decoder for stereo sequences, exploiting an interpolated intra-view SI and two inter-view SIs. The quality of the SI has a major impact on the DVC Rate-Distortion (RD) performance. As the inter-view SIs individually present lower RD performance compared with the intra-view SI, we propose multi-hypothesis decoding for robust fusion and improved performance. Compared with a state-of-the-art single side information solution, the proposed DVC decoder improves the RD performance for all the chosen test sequences by up to 0.8 dB. The proposed multi-hypothesis decoder showed higher robustness compared with other fusion techniques.

[1]  Soren Forchhammer,et al.  Stereo side information generation in low-delay distributed stereo video coding , 2012, Other Conferences.

[2]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[3]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[4]  Mads Nielsen,et al.  Multi-hypothesis transform domain Wyner-Ziv video coding including optical flow , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[5]  Wen Gao,et al.  Multi-hypothesis based multi-view distributed video coding , 2009, 2009 Picture Coding Symposium.

[6]  Catarina Brites,et al.  Wyner-Ziv Stereo Video Coding using a Side Information Fusion Approach , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[7]  Bernd Girod,et al.  Rate-adaptive codes for distributed source coding , 2006, Signal Process..

[8]  Mourad Ouaret,et al.  Iterative Multiview Side Information for Enhanced Reconstruction in Distributed Video Coding , 2009, EURASIP J. Image Video Process..

[9]  Catarina Brites,et al.  Learning based decoding approach for improved Wyner-Ziv video coding , 2012, 2012 Picture Coding Symposium.

[10]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[11]  Kai-Kuang Ma,et al.  Stereoscopic video error concealment for missing frame recovery using disparity-based frame difference projection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[12]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[13]  Thomas Maugey,et al.  Fusion schemes for multiview distributed video coding , 2009, 2009 17th European Signal Processing Conference.

[14]  C. Guillemot,et al.  Distributed Monoview and Multiview Video Coding , 2007, IEEE Signal Processing Magazine.

[15]  Xin Huang,et al.  Cross-band noise model refinement for transform domain Wyner-Ziv video coding , 2012, Signal Process. Image Commun..