Convex Programming Upper Bounds on the Capacity of 2-D Constraints

The capacity of 1-D constraints is given by the entropy of a corresponding stationary maxentropic Markov chain. Namely, the entropy is maximized over a set of probability distributions, which is defined by some linear equalities and inequalities. In this paper, certain aspects of this characterization are extended to 2-D constraints. The result is a method for calculating an upper bound on the capacity of 2-D constraints. The key steps are as follows: The maxentropic stationary probability distribution on square configurations is considered; set of linear equalities and inequalities is derived from this stationarity; the result is then a convex program, which can be easily solved numerically. Our method improves upon previous upper bounds for the capacity of the 2-D “no isolated bits” constraint, as well as certain 2-D RLL constraints.

[1]  Ido Tal,et al.  Bounds on the Rate of 2-D Bit-Stuffing Encoders , 2008, IEEE Transactions on Information Theory.

[2]  Ron M. Roth,et al.  Two-Dimensional Constrained Coding Based on Tiling , 2008, IEEE Transactions on Information Theory.

[3]  Søren Forchhammer,et al.  Entropy of Bit-Stuffing-Induced Measures for Two-Dimensional Checkerboard Constraints , 2007, IEEE Transactions on Information Theory.

[4]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[5]  Paul H. Siegel,et al.  Improved bit-stuffing bounds on two-dimensional constraints , 2002, IEEE Transactions on Information Theory.

[6]  Jørn Justesen,et al.  Bounds on the capacity of constrained two-dimensional codes , 2000, IEEE Trans. Inf. Theory.

[7]  Kenneth Zeger,et al.  On the capacity of two-dimensional run-length constrained channels , 1999, IEEE Trans. Inf. Theory.

[8]  Jorge J. Moré,et al.  The NEOS Server , 1998 .

[9]  R. Blahut,et al.  The capacity and coding gain of certain checkerboard codes , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[10]  Herbert S. Wilf,et al.  The Number of Independent Sets in a Grid Graph , 1998, SIAM J. Discret. Math..

[11]  S. Friedland On the entropy of Zd subshifts of finite type , 1997 .

[12]  J. Steif,et al.  Non-uniqueness of measures of maximal entropy for subshifts of finite type , 1994, Ergodic Theory and Dynamical Systems.

[13]  Tuvi Etzion,et al.  Cascading methods for runlength-limited arrays , 1997, IEEE Trans. Inf. Theory.