Undecoded Coefficients Recovery in Distributed Video Coding by Exploiting Spatio-Temporal Correlation: A Linear Programming Approach

Distributed video coding (DVC) aims at achieving low-complexity encoding in contrast to the existing video coding standards' high complexity encoding. According to the Wyner-Ziv theorem this can be achieved, under certain conditions, by independent encoding of the frames while resorting to joint decoding. However, the performance of a Wyner-Ziv coding scheme significantly depends on its knowledge about the spatio-temporal correlation of the video. Unfortunately, correlation statistics in a video widely varies both along the spatial and temporal directions. Therefore, we argue that in a feedback free transform domain DVC scheme the decoder will fail to recover all the transform coefficients with a nonzero probability. Thus, we suggest to integrate a recovery method with the decoder that aims at recovering the undecoded coefficients by exploiting the spatio-temporal correlation of the video. Besides, we extend and modify a recovery scheme, recently proposed in the context of images, for DVC so that it exploits both spatial and temporal correlations in recovering the undecoded coefficients. The essential idea of this scheme is to formulate the recovery problem as a linear optimization problem which can be solved efficiently using linear programming. Our simulation results demonstrated that the proposed scheme can significantly improve the PSNR and visual quality of the erroneous video frames produced by a DVC decoder.

[1]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[2]  Mourad Ouaret,et al.  Hybrid spatial and temporal error concealment for distributed video coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[3]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[4]  Amir Said Measuring the strength of partial encryption schemes , 2005, IEEE International Conference on Image Processing 2005.

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  Mortuza Ali,et al.  Exploiting spatial smoothness to recover undecoded coefficients for transform domain distributed video coding , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Philip Ogunbona,et al.  Recovering DC Coefficients in Block-Based DCT , 2006, IEEE Transactions on Image Processing.

[8]  Kannan Ramchandran,et al.  PRISM: A Video Coding Paradigm With Motion Estimation at the Decoder , 2007, IEEE Transactions on Image Processing.

[9]  Wenjun Zeng,et al.  Efficient frequency domain selective scrambling of digital video , 2003, IEEE Trans. Multim..

[10]  C.-C. Jay Kuo,et al.  Recovering missing coefficients in DCT-transformed images , 2011, 2011 18th IEEE International Conference on Image Processing.

[11]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[12]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[13]  Shlomo Shamai,et al.  Nested linear/Lattice codes for structured multiterminal binning , 2002, IEEE Trans. Inf. Theory.

[14]  Wesley De Neve,et al.  Flexible macroblock ordering in H.264/AVC , 2006, J. Vis. Commun. Image Represent..

[15]  Henrique S. Malvar,et al.  Low-complexity transform and quantization in H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  David R. Bull,et al.  A concealment based approach to distributed video coding , 2008, 2008 15th IEEE International Conference on Image Processing.

[17]  Xiaobo Li,et al.  Partial encryption of compressed images and videos , 2000, IEEE Trans. Signal Process..

[18]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.