Lossless and near-lossless source coding for multiple access networks

A multiple access source code (MASC) is a source code designed for the following network configuration: a pair of correlated information sequences {X/sub i/}/sub i=1//sup /spl infin// and {Y/sub i/}/sub i=1//sup /spl infin// is drawn independent and identically distributed (i.i.d.) according to joint probability mass function (p.m.f.) p(x,y); the encoder for each source operates without knowledge of the other source; the decoder jointly decodes the encoded bit streams from both sources. The work of Slepian and Wolf describes all rates achievable by MASCs of infinite coding dimension (n/spl rarr//spl infin/) and asymptotically negligible error probabilities (P/sub e//sup (n)//spl rarr/0). In this paper, we consider the properties of optimal instantaneous MASCs with finite coding dimension (n</spl infin/) and both lossless (P/sub e//sup (n)/=0) and nearlossless (P/sub e//sup (n)//spl rarr/0) performance. The interest in near-lossless codes is inspired by the discontinuity in the limiting rate region at P/sub e//sup (n)/=0 and the resulting performance benefits achievable by using near-lossless MASCs as entropy codes within lossy MASCs. Our central results include generalizations of Huffman and arithmetic codes to the MASC framework for arbitrary p(x,y), n, and P/sub e//sup (n)/ and polynomial-time design algorithms that approximate these optimal solutions.

[1]  Bernd Girod,et al.  Compression with side information using turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[2]  Michelle Effros,et al.  Optimal code design for lossless and near lossless source coding in multiple access networks , 2001, Proceedings DCC 2001. Data Compression Conference.

[3]  A. Kh. Al Jabri,et al.  Zero-Error Codes for Correlated Information Sources , 1997, IMACC.

[4]  Michael Fleming,et al.  Network vector quantization , 2001, IEEE Transactions on Information Theory.

[5]  Qian Zhao,et al.  Side information source coding: low complexity design and source independence , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[6]  S. Shamai,et al.  Nested linear/lattice codes for Wyner-Ziv encoding , 1998, 1998 Information Theory Workshop (Cat. No.98EX131).

[7]  Kannan Ramchandran,et al.  Distributed source coding: symmetric rates and applications to sensor networks , 2000, Proceedings DCC 2000. Data Compression Conference.

[8]  Michelle Effros,et al.  Low complexity code design for lossless and near-lossless side information source codes , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[9]  Robert M. Gray,et al.  Encoding of correlated observations , 1987, IEEE Trans. Inf. Theory.

[10]  Kenneth Rose,et al.  On zero-error source coding with decoder side information , 2003, IEEE Trans. Inf. Theory.

[11]  Shimon Even,et al.  Graph Algorithms , 1979 .

[12]  L. Lovász.  Combinatorial problems and exercises , 1979 .

[13]  Ying Zhao,et al.  Data compression of correlated non-binary sources using punctured turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[14]  H. S. WITSENHAUSEN,et al.  The zero-error side information problem and chromatic numbers (Corresp.) , 1976, IEEE Trans. Inf. Theory.

[15]  Noga Alon,et al.  Source coding and graph entropies , 1996, IEEE Trans. Inf. Theory.

[16]  K. Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[17]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUSS): design and construction , 1999 .

[18]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[19]  T. Berger,et al.  On instantaneous codes for zero-error coding of two correlated sources , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[20]  Qian Zhao Michelle Efios.  Lossless Source Coding for Multiple Access Networks , 2001 .

[21]  Kenneth Rose,et al.  Minimum redundancy zero-error source coding with side information , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[22]  Patrick Mitran,et al.  Coding for the Slepian-Wolf problem with turbo codes , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).