Breaking the Computational Bottleneck: Design of Near-Optimal High-Memory Spatially-Coupled Codes

Spatially-coupled (SC) codes, known for their threshold saturation phenomenon and low-latency windowed decoding algorithms, are ideal for streaming applications and data storage systems. SC codes are constructed by partitioning an underlying block code, followed by rearranging and concatenating the partitioned components in a convolutional manner. The number of partitioned components determines the memory of SC codes. In this paper, we investigate the relation between the performance of SC codes and the density distribution of partitioning matrices. While adopting higher memories results in improved SC code performance, obtaining finite-length, high-performance SC codes with high memory is known to be computationally challenging. We break this computational bottleneck by developing a novel probabilistic framework that obtains (locally) optimal density distributions via gradient descent. Starting from random partitioning matrices abiding by the obtained distribution, we perform low-complexity optimization algorithms that minimize the number of detrimental objects to construct high-memory, high-performance quasicyclic SC codes. We apply our framework to various objects of interests, from the simplest short cycles, to more sophisticated objects such as concatenated cycles aiming at finer-grained optimization. Simulation results show that codes obtained through our proposed method notably outperform state-of-the-art SC codes with the same constraint length and optimized SC codes with uniform partitioning. The performance gain is shown to be universal over a variety of channels, from canonical channels such as additive white Gaussian noise and binary symmetric channels, to practical channels underlying flash memory and magnetic recording systems. Index Terms LDPC codes, spatially-coupled codes, absorbing sets, edge distribution, gradient descent, near-optimal partitioning, data storage, Flash memories, magnetic recording, communications.

[1]  David Declercq,et al.  Decoding Algorithms for Nonbinary LDPC Codes Over GF$(q)$ , 2007, IEEE Transactions on Communications.

[2]  Lara Dolecek,et al.  Non-Binary LDPC Codes for Magnetic Recording Channels: Error Floor Analysis and Optimized Code Design , 2016, IEEE Transactions on Communications.

[3]  Lara Dolecek,et al.  Non-Binary Protograph-Based LDPC Codes: Enumerators, Analysis, and Designs , 2014, IEEE Transactions on Information Theory.

[4]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[5]  Lara Dolecek,et al.  Analysis and Enumeration of Absorbing Sets for Non-Binary Graph-Based Codes , 2014, IEEE Transactions on Communications.

[6]  Ali Emre Pusane,et al.  Deriving Good LDPC Convolutional Codes from LDPC Block Codes , 2010, IEEE Transactions on Information Theory.

[7]  Laurent Schmalen,et al.  Non-uniformly coupled LDPC codes: Better thresholds, smaller rate-loss, and less complexity , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[8]  J. Yedidia,et al.  Construction of high-girth QC-LDPC codes , 2008, 2008 5th International Symposium on Turbo Codes and Related Topics.

[9]  Pablo M. Olmos,et al.  A Scaling Law to Predict the Finite-Length Performance of Spatially-Coupled LDPC Codes , 2014, IEEE Transactions on Information Theory.

[10]  Lara Dolecek,et al.  A Channel-Aware Combinatorial Approach to Design High Performance Spatially-Coupled Codes , 2020, IEEE Transactions on Information Theory.

[11]  Dan Williams,et al.  Platform Storage Performance With 3D XPoint Technology , 2017, Proceedings of the IEEE.

[12]  Lara Dolecek,et al.  Analysis of Absorbing Sets and Fully Absorbing Sets of Array-Based LDPC Codes , 2009, IEEE Transactions on Information Theory.

[13]  David G. M. Mitchell,et al.  Designing Protograph-Based Quasi-Cyclic Spatially Coupled LDPC Codes With Large Girth , 2020, IEEE Transactions on Communications.

[14]  Simon Litsyn,et al.  Design of non-binary quasi-cyclic LDPC codes by ACE optimization , 2013, 2013 IEEE Information Theory Workshop (ITW).

[15]  Paul H. Siegel,et al.  Windowed Decoding of Spatially Coupled Codes , 2011, IEEE Transactions on Information Theory.

[16]  Lara Dolecek,et al.  A General Non-Binary LDPC Code Optimization Framework Suitable for Dense Flash Memory and Magnetic Storage , 2016, IEEE Journal on Selected Areas in Communications.

[17]  Jörg Kliewer,et al.  A generalized algebraic approach to optimizing SC-LDPC codes , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[18]  A. Robert Calderbank,et al.  Minimizing the Number of Detrimental Objects in Multi-Dimensional Graph-Based Codes , 2019, IEEE Transactions on Communications.

[19]  Shayan Garani Srinivasa,et al.  A Communication-Theoretic Framework for 2-DMR Channel Modeling: Performance Evaluation of Coding and Signal Processing Methods , 2014, IEEE Transactions on Magnetics.

[20]  Florian Hug,et al.  Searching for Voltage Graph-Based LDPC Tailbiting Codes With Large Girth , 2011, IEEE Transactions on Information Theory.

[21]  Lara Dolecek,et al.  GRADE-AO: Towards Near-Optimal Spatially-Coupled Codes With High Memories , 2021 .

[22]  Michael Lentmaier,et al.  Spatially Coupled LDPC Codes Constructed From Protographs , 2014, IEEE Transactions on Information Theory.

[23]  Amir H. Banihashemi,et al.  Spatially Coupled LDPC Codes With Small Constraint Length and Low Error Floor , 2020, IEEE Communications Letters.

[24]  Michael Lentmaier,et al.  Iterative Decoding Threshold Analysis for LDPC Convolutional Codes , 2010, IEEE Transactions on Information Theory.

[25]  Nicolas Macris,et al.  Threshold Saturation for Spatially Coupled LDPC and LDGM Codes on BMS Channels , 2013, IEEE Transactions on Information Theory.

[26]  Lara Dolecek,et al.  High performance non-binary spatially-coupled codes for flash memories , 2017, 2017 IEEE Information Theory Workshop (ITW).

[27]  Thomas P. Parnell,et al.  Modelling of the threshold voltage distributions of sub-20nm NAND flash memory , 2014, 2014 IEEE Global Communications Conference.

[28]  Rüdiger L. Urbanke,et al.  Threshold Saturation via Spatial Coupling: Why Convolutional LDPC Ensembles Perform So Well over the BEC , 2010, IEEE Transactions on Information Theory.

[29]  Lara Dolecek,et al.  Finite-Length Construction of High Performance Spatially-Coupled Codes via Optimized Partitioning and Lifting , 2019, IEEE Transactions on Communications.

[30]  Amir H. Banihashemi,et al.  Efficient Search of Girth-Optimal QC-LDPC Codes , 2016, IEEE Transactions on Information Theory.

[31]  Marco Baldi,et al.  Design and Analysis of Time-Invariant SC-LDPC Convolutional Codes With Small Constraint Length , 2018, IEEE Transactions on Communications.

[32]  Lara Dolecek,et al.  A Combinatorial Methodology for Optimizing Non-Binary Graph-Based Codes: Theoretical Analysis and Applications in Data Storage , 2017, IEEE Transactions on Information Theory.

[33]  Manabu Hagiwara,et al.  Comment on "Quasi-Cyclic Low Density Parity Check Codes From Circulant Permutation Matrices" , 2009, IEEE Trans. Inf. Theory.

[34]  Jaekyun Moon,et al.  Pattern-dependent noise prediction in signal-dependent noise , 2001, IEEE J. Sel. Areas Commun..

[35]  Lara Dolecek,et al.  The Cycle Consistency Matrix Approach to Absorbing Sets in Separable Circulant-Based LDPC Codes , 2012, IEEE Transactions on Information Theory.

[36]  Amir H. Banihashemi,et al.  Construction of Time Invariant Spatially Coupled LDPC Codes Free of Small Trapping Sets , 2021, IEEE Transactions on Communications.

[37]  A. Kavcic,et al.  The Feasibility of Magnetic Recording at 10 Terabits Per Square Inch on Conventional Media , 2009, IEEE Transactions on Magnetics.