Source Modeling for Distributed Video Coding

This paper studies source and correlation models for distributed video coding (DVC). It first considers a two-state HMM, i.e., a Gilbert-Elliott process, to model the bit-planes produced by DVC schemes. A statistical analysis shows that this model allows us to accurately capture the memory present in the video bit-planes. The achievable rate bounds are derived for these ergodic sources, first assuming an additive binary symmetric correlation channel between the two sources. These bounds show that a rate gain can be achieved by exploiting the sources memory with the additive BSC model. A Slepian-Wolf decoding algorithm which jointly estimates the sources and the source model parameters is then described. Simulation results show that the additive correlation model does not always fit well with the correlation between the actual video bit-planes. This has led us to consider a second correlation model (the predictive model). The rate bounds are then derived for the predictive correlation model in the case of memory sources, showing that exploiting the source memory does not bring any rate gain and that the noise statistic is a sufficient statistic for the MAP decoder. We also evaluate the rate loss when the correlation model assumed by the decoder is not matched to the true one. An a posteriori estimation of the correlation channel has hence been added to the decoder in order to use the most appropriate correlation model for each bit-plane. The new decoding algorithm has been integrated in a DVC decoder, leading to a rate saving of up to 10.14% for the same PSNR, with respect to the case where the bit-planes are assumed to be memoryless uniform sources correlated with the SI via an additive channel model.

[1]  Aline Roumy,et al.  Maximum Likelihood BSC Parameter Estimation for the Slepian-Wolf Problem , 2011, IEEE Communications Letters.

[2]  Catarina Brites,et al.  Correlation Noise Modeling for Efficient Pixel and Transform Domain Wyner–Ziv Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Frank R. Kschischang,et al.  Designing good LDPC codes for markov-modulated channels , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[4]  Zixiang Xiong,et al.  Successive refinement for the Wyner-Ziv problem and layered code design , 2005, IEEE Trans. Signal Process..

[5]  Aline Roumy,et al.  Hidden Markov Model for distributed video coding , 2010, 2010 IEEE International Conference on Image Processing.

[6]  M. Rezaeian Computation of capacity for Gilbert-Elliott channels, using a statistical method , 2005, 2005 Australian Communications Theory Workshop.

[7]  Bernd Girod,et al.  Compression with side information using turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[8]  Krishna R. Narayanan,et al.  A decision feedback based scheme for Slepian-Wolf coding of sources with hidden Markov correlation , 2006, IEEE Communications Letters.

[9]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[10]  Zixiang Xiong,et al.  Compression of binary sources with side information at the decoder using LDPC codes , 2002, IEEE Communications Letters.

[11]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[12]  Distributed Source Coding Using Raptor Codes for Hidden Markov Sources , 2009, IEEE Transactions on Signal Processing.

[13]  Ying Zhao,et al.  Compression of correlated binary sources using turbo codes , 2001, IEEE Communications Letters.

[14]  Shlomo Shamai,et al.  Nested linear/Lattice codes for structured multiterminal binning , 2002, IEEE Trans. Inf. Theory.

[15]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[16]  Aaron D. Wyner,et al.  Recent results in the Shannon theory , 1974, IEEE Trans. Inf. Theory.

[17]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[18]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[19]  J. Garcia-Frías Decoding of low-density parity check codes over finite-state binary Markov channels , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[20]  Catarina Brites,et al.  Encoder Rate Control for Transform Domain Wyner-Ziv Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[21]  John D. Villasenor,et al.  Turbo decoding of Gilbert-Elliot channels , 2002, IEEE Trans. Commun..

[22]  Christine Guillemot,et al.  Spatial prediction in distributed video coding using Wyner-Ziv DPCM , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[23]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[24]  A.W. Eckford The factor graph EM Algorithm: applications for LDPC codes , 2005, IEEE 6th Workshop on Signal Processing Advances in Wireless Communications, 2005..

[25]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[26]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[27]  Thomas M. Cover,et al.  A Proof of the Data Compression Theorem of Slepian and Wolf for Ergodic Sources , 1971 .

[28]  Aline Roumy,et al.  Non-uniform source modeling for distributed video coding , 2010, 2010 18th European Signal Processing Conference.

[29]  Frank R. Kschischang,et al.  Analysis of low-density parity-check codes for the Gilbert-Elliott channel , 2005, IEEE Transactions on Information Theory.

[30]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[31]  Wei Zhong,et al.  LDPC codes for compression of multi-terminal sources with hidden Markov correlation , 2003, IEEE Communications Letters.

[32]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[33]  Catarina Brites,et al.  An Efficient Encoder Rate Control Solution for Transform Domain Wyner–Ziv Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Javier Del Ser,et al.  Asymmetric Joint Source-Channel Coding for Correlated Sources with Blind HMM Estimation at the Receiver , 2005, EURASIP J. Wirel. Commun. Netw..

[35]  Vaneet Aggarwal,et al.  Distributed Joint Source-Channel Coding for arbitrary memoryless correlated sources and Source coding for Markov correlated sources using LDPC codes , 2008, ArXiv.

[36]  Javier Garcia-Frías,et al.  Decoding of low-density parity-check codes over finite-state binary Markov channels , 2004, IEEE Transactions on Communications.

[37]  K. Raahemifar,et al.  Encoder rate control for transform domain Wyner-Ziv Video Coding , 2013, 2013 International Conference on Electronics, Computer and Computation (ICECCO).