Error Exponents of Typical Random Codes of Source-Channel Coding

The error exponent of the typical random code (TRC) in a communication scenario of source-channel coding with side information at the decoder is the main objective of this work. We derive a lower bound, which is at least as large as the random binning-coding exponent due to Merhav (2016), and we show numerically that it may be strictly larger. We deduce the exponents of the TRCs in two special cases: Slepian-Wolf (SW) source coding and joint source-channel coding. Each of these models is further studied in order to provide deeper intuition concerning the behavior of the typical random code. We also propose an alternative expression for the error exponent of typical random binning in SW model, which is given by an optimization over four parameters only, instead of a computationally heavy optimization over probability distributions.

[1]  Jun Chen,et al.  On the Reliability Function of Variable-Rate Slepian-Wolf Coding , 2017, Entropy.

[2]  Imre Csiszár On the error exponent of source-channel transmission with a distortion threshold , 1982, IEEE Trans. Inf. Theory.

[3]  Neri Merhav,et al.  Error Exponents of Typical Random Trellis Codes , 2019, IEEE Transactions on Information Theory.

[4]  Erna Viterbi Error Exponents of Typical Random Codes , 2017 .

[5]  Neri Merhav Universal decoding for source-channel coding with side information , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[6]  Neri Merhav,et al.  Error Exponents of Typical Random Codes for the Colored Gaussian Channel , 2018, 2019 IEEE International Symposium on Information Theory (ISIT).

[7]  Achilleas Anastasopoulos,et al.  Error Exponent for Multiple Access Channels: Upper Bounds , 2015, IEEE Transactions on Information Theory.

[8]  Neri Merhav,et al.  The generalized stochastic likelihood decoder: Random coding and expurgated bounds , 2015, 2016 IEEE International Symposium on Information Theory (ISIT).

[9]  Neri Merhav,et al.  Error Exponents of Typical Random Codes , 2017, 2018 IEEE International Symposium on Information Theory (ISIT).

[10]  Alexander Barg,et al.  Random codes: Minimum distances and error exponents , 2002, IEEE Trans. Inf. Theory.