Joint estimation and compression of correlated nonbinary sources using punctured turbo codes

We propose a system to perform data compression of correlated nonbinary sources when the correlation between sources is not known, either at the encoder or the decoder. The sequences of nonbinary symbols are transformed into sequences of bits, and then source coded using punctured turbo codes, with the puncturing adjusted to achieve the desired compression rate. Each source is compressed without knowledge about the other source, and the correlation model is not assumed to be known at the encoder. The source decoder uses iterative schemes over the compressed binary sequences, and recovers the nonbinary symbol sequences from both sources. The correlation model between sources does not need to be known at the decoder, since it can be estimated jointly with the iterative decoding process. Compared with the case in which the correlation is known at the decoder, no significant performance loss is observed. The performance of the proposed scheme is close to the Slepian-Wolf theoretical limit.

[1]  Javier Garcia-Frías,et al.  Joint source-channel decoding of correlated sources over noisy channels , 2001, Proceedings DCC 2001. Data Compression Conference.

[2]  Michelle Effros,et al.  Lossless source coding for multiple access networks , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[3]  Aaron D. Wyner,et al.  Recent results in the Shannon theory , 1974, IEEE Trans. Inf. Theory.

[4]  Robert M. Gray,et al.  Encoding of correlated observations , 1987, IEEE Trans. Inf. Theory.

[5]  A. Kh. Al Jabri,et al.  Zero-Error Codes for Correlated Information Sources , 1997, IMACC.

[6]  Zixiang Xiong,et al.  Distributed compression of binary sources using conventional parallel and serial concatenated convolutional codes , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[7]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUSS): design and construction , 1999 .

[8]  Rick S. Blum,et al.  Slepian-Wolf coding for nonuniform sources using turbo codes , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[9]  K. Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[10]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[11]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  T. Berger,et al.  On instantaneous codes for zero-error coding of two correlated sources , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[14]  Te Sun Han,et al.  Universal coding for the Slepian-Wolf data compression system and the strong converse theorem , 1994, IEEE Trans. Inf. Theory.

[15]  Zixiang Xiong,et al.  A distributed source coding technique for correlated images using turbo-codes , 2002, IEEE Communications Letters.

[16]  Bernd Girod,et al.  Compression with side information using turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[17]  Ying Zhao,et al.  Data Compression of Unknown Single and Correlated Binary Sources Using Punctured Turbo Codes , 2002 .

[18]  Ying Zhao,et al.  Compression of correlated binary sources using turbo codes , 2001, IEEE Communications Letters.

[19]  Ying Zhao,et al.  Data compression of correlated non-binary sources using punctured turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[20]  Patrick Mitran,et al.  Coding for the Slepian-Wolf problem with turbo codes , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[21]  H. S. WITSENHAUSEN,et al.  The zero-error side information problem and chromatic numbers (Corresp.) , 1976, IEEE Trans. Inf. Theory.

[22]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[23]  Michelle Effros,et al.  Optimal code design for lossless and near lossless source coding in multiple access networks , 2001, Proceedings DCC 2001. Data Compression Conference.

[24]  Shlomo Shamai,et al.  Systematic Lossy Source/Channel Coding , 1998, IEEE Trans. Inf. Theory.