On the Complexity of Computing the Capacity of Codes That Avoid Forbidden Difference Patterns

Some questions related to the computation of the capacity of codes that avoid forbidden difference patterns are analysed. The maximal number of n-bit sequences whose pairwise differences do not contain some given forbidden difference patterns is known to increase exponentially with n; the coefficient of the exponent is the capacity of the forbidden patterns. In this paper, new inequalities for the capacity are given that allow for the approximation of the capacity with arbitrary high accuracy. The computational cost of the algorithm derived from these inequalities is fixed once the desired accuracy is given. Subsequently, a polynomial time algorithm is given for determining if the capacity of a set is positive while the same problem is shown to be NP-hard when the sets of forbidden patterns are defined over an extended set of symbols. Finally, the existence of extremal norms is proved for any set of matrices arising in the capacity computation. Based on this result, a second capacity approximating algorithm is proposed. The usefulness of this algorithm is illustrated by computing exactly the capacity of particular codes that were only known approximately

[1]  J. Mairesse,et al.  Asymptotic height optimization for topical IFS, Tetris heaps, and the finiteness conjecture , 2001 .

[2]  John N. Tsitsiklis,et al.  The Lyapunov exponent and joint spectral radius of pairs of matrices are hard—when not impossible—to compute and to approximate , 1997, Math. Control. Signals Syst..

[3]  V. Kozyakin A Dynamical Systems Construction of a Counterexample to the Finiteness Conjecture , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[4]  P. Siegel,et al.  Bounds on the rate of codes which forbid specified difference sequences , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).

[5]  John N. Tsitsiklis,et al.  A survey of computational complexity results in systems and control , 2000, Autom..

[6]  V. Protasov Asymptotic behaviour of the partition function , 2000 .

[7]  Vincent D. Blondel,et al.  Computationally Efficient Approximations of the Joint Spectral Radius , 2005, SIAM J. Matrix Anal. Appl..

[8]  Vincent D. Blondel,et al.  An Elementary Counterexample to the Finiteness Conjecture , 2002, SIAM J. Matrix Anal. Appl..

[9]  V. Protasov The Geometric Approach for Computing the Joint Spectral Radius , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[10]  P. Siegel,et al.  On codes with local joint constraints , 2007 .

[11]  Yang Wang,et al.  Bounded semigroups of matrices , 1992 .

[12]  I. Daubechies,et al.  Sets of Matrices All Infinite Products of Which Converge , 1992 .

[13]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[14]  J. Tsitsiklis,et al.  The boundedness of all products of a pair of matrices is undecidable , 2000 .

[15]  Paul H. Siegel,et al.  On codes that avoid specified differences , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[16]  Alfred V. Aho,et al.  Algorithms for Finding Patterns in Strings , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.