Distributed Structure: Joint Expurgation for the Multiple-Access Channel

In this paper, we obtain an improved lower bound on the error exponent of the memoryless multiple-access channel via the use of linear codes, thus demonstrating that structure can be beneficial even when capacity may be achieved via random codes. We show that if the multiple-access channel is additive over a finite field, then any error probability, and hence any error exponent, achievable by a linear code for the associated single-user channel, is also achievable for the multiple-access channel. In particular, linear codes allow to attain joint expurgation, and hence, attain the single-user expurgated exponent of the single-user channel, whenever the latter is achieved by a uniform distribution. Thus, for additive channels, at low rates, where expurgation is needed, our approach strictly improves performance over previous results, where expurgation was used for at most one of the users. Even when the multiple-access channel is not additive, it may be transformed into such a channel. While the transformation is information-lossy, we show that the distributed structure gain in some “nearly additive” cases outweighs the loss. Finally, we apply a similar approach to the Gaussian multiple-access channel. While we believe that due to the power constraints, it is impossible to attain the single-user error exponent, we do obtain an improvement over the best known achievable error exponent, given by Gallager, for certain parameters. This is accomplished using a nested lattice triplet with judiciously chosen parameters.

[1]  Giacomo Como,et al.  The Capacity of Finite Abelian Group Codes Over Symmetric Memoryless Channels , 2009, IEEE Transactions on Information Theory.

[2]  Gregory Poltyrev,et al.  On coding without restrictions for the AWGN channel , 1993, IEEE Trans. Inf. Theory.

[3]  Michael Gastpar,et al.  Computation Over Multiple-Access Channels , 2007, IEEE Transactions on Information Theory.

[4]  R. Zamir,et al.  A modulo-lattice transformation for multiple-access channels , 2008, 2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel.

[5]  S. Sandeep Pradhan,et al.  A proof of the existence of good nested lattices , 2007 .

[6]  Uri Erez,et al.  Lattice Strategies for the Dirty Multiple Access Channel , 2007, IEEE Transactions on Information Theory.

[7]  Giacomo Como,et al.  Group Codes Outperform Binary-Coset Codes on Nonbinary Symmetric Memoryless Channels , 2010, IEEE Transactions on Information Theory.

[8]  Imre Csiszár Linear codes for sources and source networks: Error exponents, universal coding , 1982, IEEE Trans. Inf. Theory.

[9]  Hans-Andrea Loeliger,et al.  Averaging bounds for lattices and linear codes , 1997, IEEE Trans. Inf. Theory.

[10]  Robert G. Gallager,et al.  A perspective on multiaccess channels , 1984, IEEE Trans. Inf. Theory.

[11]  Uri Erez,et al.  Error exponents of modulo-additive noise channels with side information at the transmitter , 2001, IEEE Trans. Inf. Theory.

[12]  Brian L. Hughes,et al.  A new universal random coding bound for the multiple-access channel , 1996, IEEE Trans. Inf. Theory.

[13]  Yuval Kochman,et al.  Lattice Coding for Signals and Networks: Side-information problems , 2014 .

[14]  D. Slepian,et al.  A coding theorem for multiple access channels with correlated sources , 1973 .

[15]  Simon Litsyn,et al.  Lattices which are good for (almost) everything , 2005, IEEE Transactions on Information Theory.

[16]  Rajesh P. N. Rao,et al.  Predictive Coding , 2019, A Blueprint for the Hard Problem of Consciousness.

[17]  R. Gallager Information Theory and Reliable Communication , 1968 .

[18]  Alexander Barg,et al.  Random codes: Minimum distances and error exponents , 2002, IEEE Trans. Inf. Theory.

[19]  Pierre Moulin,et al.  On error exponents of modulo lattice additive noise channels , 2006, IEEE Transactions on Information Theory.

[20]  Uri Erez,et al.  Achieving 1/2 log (1+SNR) on the AWGN channel with lattice encoding and decoding , 2004, IEEE Transactions on Information Theory.

[21]  Peter Elias,et al.  Predictive coding-I , 1955, IRE Trans. Inf. Theory.

[22]  Hans-Martin Wallmeier,et al.  Random coding bound and codes produced by permutations for the multiple-access channel , 1985, IEEE Trans. Inf. Theory.

[23]  Frederick Jelinek,et al.  Evaluation of expurgated bound exponents , 1968, IEEE Trans. Inf. Theory.

[24]  C. A. Rogers Lattice coverings of space , 1959 .

[25]  Alexander Sprintson,et al.  Joint Physical Layer Coding and Network Coding for Bidirectional Relaying , 2008, IEEE Transactions on Information Theory.

[26]  Achilleas Anastasopoulos,et al.  Error Exponent Regions for Gaussian Broadcast and Multiple-Access Channels , 2008, IEEE Transactions on Information Theory.

[27]  S. Sandeep Pradhan,et al.  Lattices for Distributed Source Coding: Jointly Gaussian Sources and Reconstruction of a Linear Function , 2007, IEEE Transactions on Information Theory.

[28]  R. Dobrushin Asymptotic Optimality of Group and Systematic Codes for Some Channels , 1963 .

[29]  Achilleas Anastasopoulos,et al.  A New Upper Bound on the Average Error Exponent for Multiple-Access Channels , 2010, ArXiv.