The glassy phase of Gallager codes

Abstract:Gallager codes are the best error-correcting codes to date. In this paper we study them by using the tools of statistical mechanics. The corresponding statistical mechanics model is a spin model on a sparse random graph. The model can be solved by elementary methods (i.e. without replicas) in a large connectivity limit. For low enough temperatures it presents a completely frozen glassy phase (qEA = 1). The same scenario is shown to hold for finite connectivities. In this case we adopt the replica approach and exhibit a one-step replica symmetry breaking order parameter. We argue that our ansatz yields the exact solution of the model. This allows us to determine the whole phase diagram and to understand the performances of Gallager codes.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[3]  V.W.S. Chan,et al.  Principles of Digital Communication and Coding , 1979 .

[4]  M. Mézard,et al.  Spin Glass Theory and Beyond , 1987 .

[5]  Haim Sompolinsky,et al.  STATISTICAL MECHANICS OF NEURAL NETWORKS , 1988 .

[6]  William H. Press,et al.  Numerical recipes , 1990 .

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  J. Nadal,et al.  From statistical physics to statistical inference and back , 1994 .

[9]  David Mackay,et al.  On Thresholds of Codes , 2000 .

[10]  M. Mézard,et al.  The Bethe lattice spin glass revisited , 2000, cond-mat/0009418.

[11]  D. Saad,et al.  Tighter decoding reliability bound for Gallager's error-correcting code. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  D. Sherrington,et al.  Absence of replica symmetry breaking in a region of the phase diagram of the Ising spin glass , 2000, cond-mat/0008139.

[13]  Sae-Young Chung,et al.  On the design of low-density parity-check codes within 0.0045 dB of the Shannon limit , 2001, IEEE Communications Letters.

[14]  Riccardo Zecchina,et al.  Exact solutions for diluted spin glasses and optimization problems , 2001, Physical review letters.

[15]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.