Error Exponent for Multiple Access Channels: Upper Bounds

The problem of bounding the reliability function of a multiple access channel (MAC) is studied. Two new upper bounds on the error exponent of a two-user discrete memoryless (DM)-MAC are derived. The first bound (sphere packing) is an upper bound on the exponent of the average probability of error and is the first bound of this type that is zero outside the capacity region and thus results in a tighter sphere-packing exponent when compared with the tightest known exponent derived by Haroutunian. The second bound (minimum distance) is an upper bound on the exponent of the maximal (as opposed to average) probability of error. To obtain this bound, first, an upper bound on the minimum Bhattacharyya distance between codeword pairs is derived. For a certain class of two-user DM-MACs, an upper bound on the exponent of maximal probability of error is derived as a consequence of the upper bound on the minimum Bhattacharyya distance. We analytically evaluate the sphere packing bound for uniform composition codes for an additive and nonsymmetric channel and show that it is tight near the boundary of the capacity region, i.e., equal to the random coding lower bound.

[1]  G. A. Barnard,et al.  Transmission of Information: A Statistical Theory of Communications. , 1961 .

[2]  Hans-Martin Wallmeier,et al.  Random coding bound and codes produced by permutations for the multiple-access channel , 1985, IEEE Trans. Inf. Theory.

[3]  Achilleas Anastasopoulos,et al.  A new sphere-packing bound for maximal error exponent for multiple-access channels , 2008, 2008 IEEE International Symposium on Information Theory.

[4]  Imre Csisźar,et al.  The Method of Types , 1998, IEEE Trans. Inf. Theory.

[5]  Robert G. Gallager,et al.  The random coding bound is tight for the average code (Corresp.) , 1973, IEEE Trans. Inf. Theory.

[6]  D. Slepian,et al.  A coding theorem for multiple access channels with correlated sources , 1973 .

[7]  Rudolf Ahlswede,et al.  On two-way communication channels and a problem by Zarankiewicz , 1973 .

[8]  Achilleas Anastasopoulos,et al.  New bounds on the maximal error exponent for multiple-access channels , 2009, 2009 IEEE International Symposium on Information Theory.

[9]  Richard E. Blahut,et al.  Principles and practice of information theory , 1987 .

[10]  Eli Haim,et al.  Improving the MAC error exponent using distributed structure , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[11]  Robert M. Gray,et al.  Coding for noisy channels , 2011 .

[12]  Elwyn R. Berlekamp,et al.  Lower Bounds to Error Probability for Coding on Discrete Memoryless Channels. II , 1967, Inf. Control..

[13]  Robert G. Gallager,et al.  A perspective on multiaccess channels , 1984, IEEE Trans. Inf. Theory.

[14]  R. Gallager Information Theory and Reliable Communication , 1968 .

[15]  N. Sloane,et al.  Lower Bounds to Error Probability for Coding on Discrete Memoryless Channels. I , 1993 .

[16]  Rudolf Ahlswede,et al.  Multi-way communication channels , 1973 .

[17]  Richard E. Blahut,et al.  Composition bounds for channel block codes , 1977, IEEE Trans. Inf. Theory.

[18]  Udo Augustin,et al.  GedÄchtnisfreie KanÄle für diskrete Zeit , 1966 .

[19]  R. Ahlswede An elementary proof of the strong converse theorem for the multiple-access channel , 1982 .

[20]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[21]  Alexander Barg,et al.  Random codes: Minimum distances and error exponents , 2002, IEEE Trans. Inf. Theory.

[22]  Ali Nazari Error Exponent for Discrete Memoryless Multiple-Access Channels. , 2011 .

[23]  O. F. Cook The Method of Types , 1898 .

[24]  Amiel Feinstein,et al.  Error bounds in noisy channels without memory , 1955, IRE Trans. Inf. Theory.

[25]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[26]  Brian L. Hughes,et al.  A new universal random coding bound for the multiple-access channel , 1996, IEEE Trans. Inf. Theory.

[27]  Svante Janson,et al.  New versions of Suen's correlation inequality , 1998, Random Struct. Algorithms.

[28]  Achilleas Anastasopoulos,et al.  A new universal random-coding bound for average probability error exponent for multiple-access channels , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[30]  Giacomo Como,et al.  Group Codes Outperform Binary-Coset Codes on Nonbinary Symmetric Memoryless Channels , 2010, IEEE Transactions on Information Theory.

[31]  Imre Csiszár,et al.  Graph decomposition: A new key to coding theorems , 1981, IEEE Trans. Inf. Theory.

[32]  Frederick Jelinek,et al.  Evaluation of expurgated bound exponents , 1968, IEEE Trans. Inf. Theory.

[33]  Robert G. Gallager,et al.  A simple derivation of the coding theorem and some applications , 1965, IEEE Trans. Inf. Theory.