Input-Output Distance Properties of Good Linear Codes

Consider a linear code defined as a mapping between vector spaces of dimensions <tex>$k$</tex> and <tex>$n$</tex>. Let <tex>$\beta^{\ast}$</tex> denote the minimal (relative) weight among all images of input vectors of full Hamming weight <tex>$k$</tex>. Operationally, <tex>$\beta^{\ast}$</tex> characterizes the threshold for adversarial (erasure) noise beyond which decoder is guaranteed to produce estimate of k-input with 100% symbol error rate (SER). This paper studies the relation between <tex>$\beta^{\ast}$</tex> and <tex>$\delta$</tex>, the minimum distance of the code, which gives the threshold for 0 % SER. An optimal tradeoff between <tex>$\beta^{\ast}$</tex> and <tex>$\delta$</tex> is obtained (over large alphabets) and all linear codes achieving <tex>$\beta^{\ast}=1$</tex> are classified: they are repetition-like. More generally, a design criteria is proposed for codes with favorable graceful degradation properties. As an example, it is shown that in an overdetermined system of <tex>$n$</tex> homogeneous linear equations in <tex>$k$</tex> variables (over a field) it is always possible to satisfy some <tex>$k-1$</tex> equations with non-zero assignments to every unknown, provided that any subset of <tex>$k$</tex> equations is linearly independent. This statement is true if and only if <tex>$n\geq 2k-1$</tex>.

[1]  Simon Litsyn,et al.  Improved upper bounds for codes with unequal error protection , 2005, IEEE Transactions on Information Theory.

[2]  Arya Mazumdar,et al.  The adversarial joint source-channel problem , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[3]  Yury Polyanskiy,et al.  On metric properties of maps between Hamming spaces and related graph homomorphisms , 2015, J. Comb. Theory A.

[4]  Alex Samorodnitsky,et al.  Improved log-Sobolev inequalities, hypercontractivity and uncertainty principle on the hypercube , 2016, Journal of Functional Analysis.

[5]  Arya Mazumdar,et al.  Results on combinatorial joint source-channel coding , 2012, 2012 IEEE Information Theory Workshop.

[6]  David Ellis,et al.  Juntas in the ℓ1‐grid and Lipschitz maps between discrete tori , 2016, Random Struct. Algorithms.

[7]  Nazanin Rahnavard,et al.  Unequal error protection using low-density parity-check codes , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[8]  Andrew J. Young,et al.  Converse and duality results for combinatorial source-channel coding in binary Hamming spaces , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[9]  Arya Mazumdar,et al.  Distance preserving maps and combinatorial joint source-channel coding for large alphabets , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[10]  van Wj Wil Gils,et al.  On linear unequal error protection codes , 1982 .

[11]  Robert Michael Tanner,et al.  A transform theory for a class of group-invariant codes , 1988, IEEE Trans. Inf. Theory.

[12]  Richard E. Ladner,et al.  Unequal loss protection: graceful degradation of image quality over packet erasure channels through forward error correction , 2000, IEEE Journal on Selected Areas in Communications.