How Optimal Is Algebraic Binning Approach : A Case Study of the Turbo-Binning Scheme With Uniform and Nonuniform Sources

This paper investigates the optimality of the binning approach in distributed source coding for both uniform and nonuniform sources. While the algebraic binning scheme is optimal for uniform sources both asymptotically and at finite lengths, it is shown that the optimality holds only asymptotically for nonuniform sources. Highperformance turbo codes are used with the binning scheme on several source distributions to quantify how close they can get to the theoretical limit with relatively large block sizes. For nonuniform sources, optimal code design and variable-length bin-indexes are exploited as a useful extension to the conventional binning scheme. It is shown that the two strategies combined can improve the compression rate by as much as 0.22 bit/symbol for highly biased sources.

[1]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[2]  G. Forney,et al.  Trellis shaping , 1992, IEEE/CAM Information Theory Workshop at Cornell.

[3]  Daniel J. Costello,et al.  A note on asymmetric turbo-codes , 1999, IEEE Communications Letters.

[4]  Nam C. Phamdo,et al.  Source-channel optimized trellis codes for bitonal image transmission over AWGN channels , 1999, IEEE Trans. Image Process..

[5]  K. Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[6]  Ying Zhao,et al.  Compression of correlated binary sources using turbo codes , 2001, IEEE Communications Letters.

[7]  Fady Alajaji,et al.  Turbo codes for nonuniform memoryless sources over noisy channels , 2002, IEEE Communications Letters.

[8]  Zixiang Xiong,et al.  Distributed compression of binary sources using conventional parallel and serial concatenated convolutional codes , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[9]  Rick S. Blum,et al.  Compression of a binary source with side information using parallelly concatenated convolutional codes , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[10]  Rick S. Blum,et al.  Slepian-Wolf coding for nonuniform sources using turbo codes , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.