On the Tanner Graph Cycle Distribution of Random LDPC, Random Protograph-Based LDPC, and Random Quasi-Cyclic LDPC Code Ensembles

In this paper, we study the cycle distribution of random low-density parity-check (LDPC) codes, randomly constructed protograph-based LDPC codes, and random quasi-cyclic (QC) LDPC codes. We prove that for a random bipartite graph, with a given (irregular) degree distribution, the distributions of cycles of different length tend to independent Poisson distributions, as the size of the graph tends to infinity. We derive asymptotic upper and lower bounds on the expected values of the Poisson distributions that are independent of the size of the graph, and only depend on the degree distribution and the cycle length. For a random lift of a bi-regular protograph, we prove that the asymptotic cycle distributions are essentially the same as those of random bipartite graphs as long as the degree distributions are identical. For random QC-LDPC codes, however, we show that the cycle distribution can be quite different from the other two categories. In particular, depending on the protograph and the value of <inline-formula> <tex-math notation="LaTeX">$c$ </tex-math></inline-formula>, the expected number of cycles of length <inline-formula> <tex-math notation="LaTeX">$c$ </tex-math></inline-formula>, in this case, can be either <inline-formula> <tex-math notation="LaTeX">$\Theta (N)$ </tex-math></inline-formula> or <inline-formula> <tex-math notation="LaTeX">$\Theta (1)$ </tex-math></inline-formula>, where <inline-formula> <tex-math notation="LaTeX">$N$ </tex-math></inline-formula> is the lifting degree (code length). We also provide numerical results that match our theoretical derivations. Our results provide a theoretical foundation for emperical results that were reported in the literature but were not well-justified. They can also be used for the analysis and design of LDPC codes and associated algorithms that are based on cycles.

[1]  Amir H. Banihashemi,et al.  Lowering the error floor of LDPC codes using cyclic liftings , 2010, 2010 IEEE International Symposium on Information Theory.

[2]  W. Specht Zur Theorie der elementaren Mittel , 1960 .

[3]  Brendan D. McKay,et al.  Short Cycles in Random Regular Graphs , 2004, Electron. J. Comb..

[4]  Kyeongcheol Yang,et al.  Quasi-cyclic LDPC codes for fast encoding , 2005, IEEE Transactions on Information Theory.

[5]  J. Thorpe Low-Density Parity-Check (LDPC) Codes Constructed from Protographs , 2003 .

[6]  William E. Ryan,et al.  Enumerators for Protograph-Based Ensembles of LDPC and Generalized LDPC Codes , 2011, IEEE Transactions on Information Theory.

[7]  Kyung-Joong Kim,et al.  Bounds on the Size of Parity-Check Matrices for Quasi-Cyclic Low-Density Parity-Check Codes , 2013, IEEE Transactions on Information Theory.

[8]  Amir H. Banihashemi,et al.  On the design of LDPC code ensembles for BIAWGN channels , 2010, IEEE Transactions on Communications.

[9]  Hua Xiao,et al.  Error rate estimation of low-density parity-check codes on binary symmetric channels using cycle enumeration , 2009, IEEE Transactions on Communications.

[10]  Amir H. Banihashemi,et al.  A heuristic search for good low-density parity-check codes at short block lengths , 2001, ICC 2001. IEEE International Conference on Communications. Conference Record (Cat. No.01CH37240).

[11]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[12]  Amir H. Banihashemi,et al.  New Characterization and Efficient Exhaustive Search Algorithm for Leafless Elementary Trapping Sets of Variable-Regular LDPC Codes , 2016, IEEE Transactions on Information Theory.

[13]  Béla Bollobás,et al.  A Probabilistic Proof of an Asymptotic Formula for the Number of Labelled Regular Graphs , 1980, Eur. J. Comb..

[14]  Keith M. Chugg,et al.  An algorithm for counting short cycles in bipartite graphs , 2006, IEEE Transactions on Information Theory.

[15]  Thomas J. Richardson,et al.  Error Floors of LDPC Codes , 2003 .

[16]  Jörg Flum,et al.  The Parameterized Complexity of Counting Problems , 2004, SIAM J. Comput..

[17]  Amir H. Banihashemi,et al.  Characterization of Elementary Trapping Sets in Irregular LDPC Codes and the Corresponding Efficient Exhaustive Search Algorithms , 2018, IEEE Transactions on Information Theory.

[18]  Jonathan L. Gross,et al.  Topological Graph Theory , 1987, Handbook of Graph Theory.

[19]  Amir H. Banihashemi,et al.  Message-Passing Algorithms for Counting Short Cycles in a Graph , 2010, IEEE Transactions on Communications.

[20]  Amir H. Banihashemi,et al.  An efficient algorithm for finding dominant trapping sets of LDPC codes , 2011, 2010 6th International Symposium on Turbo Codes & Iterative Information Processing.

[21]  Amir H. Banihashemi,et al.  On Characterization and Efficient Exhaustive Search of Elementary Trapping Sets of Variable-Regular LDPC Codes , 2015, IEEE Communications Letters.

[22]  Amir H. Banihashemi,et al.  Asymptotic Average Number of Different Categories of Trapping Sets, Absorbing Sets and Stopping Sets in Random Regular and Irregular LDPC Code Ensembles , 2017, ArXiv.

[23]  Amir H. Banihashemi,et al.  On Characterization of Elementary Trapping Sets of Variable-Regular LDPC Codes , 2013, IEEE Transactions on Information Theory.

[24]  Emre Telatar,et al.  Finite-length analysis of low-density parity-check codes on the binary erasure channel , 2002, IEEE Trans. Inf. Theory.

[25]  Sunghwan Kim,et al.  Quasi-Cyclic Low-Density Parity-Check Codes With Girth Larger Than $12$ , 2007, IEEE Transactions on Information Theory.

[26]  Béla Bollobás,et al.  Random Graphs , 1985 .

[27]  Amir H. Banihashemi,et al.  On the girth of quasi cyclic protograph LDPC codes , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[28]  Marc P. C. Fossorier,et al.  Quasi-Cyclic Low-Density Parity-Check Codes From Circulant Permutation Matrices , 2004, IEEE Trans. Inf. Theory.

[29]  Lara Dolecek,et al.  Non-Binary Protograph-Based LDPC Codes: Enumerators, Analysis, and Designs , 2014, IEEE Transactions on Information Theory.

[30]  Evangelos Eleftheriou,et al.  Regular and irregular progressive edge-growth tanner graphs , 2005, IEEE Transactions on Information Theory.

[31]  Amir H. Banihashemi,et al.  Counting Short Cycles of Quasi Cyclic Protograph LDPC Codes , 2012, IEEE Communications Letters.