Random Coding Error Exponents for the Two-User Interference Channel

This paper is about deriving lower bounds on the error exponents for the two-user interference channel under the random coding regime for several ensembles. Specifically, we first analyze the standard random coding ensemble, where the codebooks are comprised of independently and identically distributed (i.i.d.) codewords. For this ensemble, we focus on optimum decoding, which is in contrast to other, suboptimal decoding rules that have been used in the literature (e.g., joint typicality decoding, treating interference as noise, and so on). The fact that the interfering signal is a codeword, rather than an i.i.d. noise process, complicates the application of conventional techniques of performance analysis of the optimum decoder. In addition, unfortunately, these conventional techniques result in loose bounds. Using analytical tools rooted in statistical physics, as well as advanced union bounds, we derive single-letter formulas for the random coding error exponents. We compare our results with the best known lower bound on the error exponent, and show that our exponents can be strictly better. Then, in the second part of this paper, we consider more complicated coding ensembles and find a lower bound on the error exponent associated with the celebrated Han–Kobayashi random coding ensemble, which is based on superposition coding.

[1]  Neri Merhav,et al.  List Decoding—Random Coding Exponents and Expurgated Exponents , 2013, IEEE Transactions on Information Theory.

[2]  Achilleas Anastasopoulos,et al.  Error Exponent Regions for Gaussian Broadcast and Multiple-Access Channels , 2008, IEEE Transactions on Information Theory.

[3]  L. Goddard Information Theory , 1962, Nature.

[4]  Cheng Chang,et al.  Interference channel capacity region for randomized fixed-composition codes , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[6]  Abbas El Gamal,et al.  Optimal Achievable Rates for Interference Networks With Random Codes , 2012, IEEE Transactions on Information Theory.

[7]  Albert Guillén i Fàbregas,et al.  Mismatched multi-letter successive decoding for the multiple-access channel , 2014, 2014 IEEE International Symposium on Information Theory.

[8]  Neri Merhav,et al.  Erasure/List Random Coding Error Exponents Are Not Universally Achievable , 2016, IEEE Transactions on Information Theory.

[9]  Neri Merhav List Decoding - Random Coding Exponents and Expurgated Exponents , 2014, IEEE Trans. Inf. Theory.

[10]  Claude E. Shannon,et al.  Two-way Communication Channels , 1961 .

[11]  Aydano B. Carleial,et al.  A case where interference does not reduce capacity (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[12]  Neri Merhav,et al.  Relations Between Random Coding Exponents and the Statistical Physics of Random Codes , 2007, IEEE Transactions on Information Theory.

[13]  Albert Guillén i Fàbregas,et al.  Multiuser Random Coding Techniques for Mismatched Decoding , 2013, IEEE Transactions on Information Theory.

[14]  Neri Merhav,et al.  Erasure/List Random Coding Error Exponents Are Not Universally Achievable , 2016, IEEE Trans. Inf. Theory.

[15]  R. Benzel,et al.  The capacity region of a class of discrete additive degraded interference channels (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[16]  Thomas M. Cover,et al.  Network Information Theory , 2001 .

[17]  R. Ahlswede The Capacity Region of a Channel with Two Senders and Two Receivers , 1974 .

[18]  Neri Merhav Exact Correct-Decoding Exponent of the Wiretap Channel Decoder , 2014, IEEE Transactions on Information Theory.

[19]  Chandra Nair,et al.  Sub-optimality of Han-Kobayashi achievable region for interference channels , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[20]  Neri Merhav The Generalized Random Energy Model and its Application to the Statistical Physics of Ensembles of Hierarchical Codes , 2009, IEEE Transactions on Information Theory.

[21]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[22]  Hiroshi Sato,et al.  Two-user communication channels , 1977, IEEE Trans. Inf. Theory.

[23]  Aydano B. Carleial,et al.  Interference channels , 1978, IEEE Trans. Inf. Theory.

[24]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[25]  Neri Merhav,et al.  Error Exponents of Optimum Decoding for the Interference Channel , 2010, IEEE Transactions on Information Theory.

[26]  Te Sun Han,et al.  A new achievable rate region for the interference channel , 1981, IEEE Trans. Inf. Theory.

[27]  Neri Merhav Exact Random Coding Error Exponents of Optimal Bin Index Decoding , 2014, IEEE Transactions on Information Theory.

[28]  Nadav Shulman,et al.  Communication over an unknown channel via common broadcasting , 2003 .