A Combinatorial Methodology for Optimizing Non-Binary Graph-Based Codes: Theoretical Analysis and Applications in Data Storage

Non-binary (NB) low-density parity-check (LDPC) codes are graph-based codes that are increasingly being considered as a powerful error correction tool for modern dense storage devices. Optimizing NB-LDPC codes to overcome their error floor is one of the main code design challenges facing storage engineers upon deploying such codes in practice. Furthermore, the increasing levels of asymmetry incorporated by the channels underlying modern dense storage systems, e.g., multi-level Flash systems, exacerbate the error floor problem by widening the spectrum of problematic objects that contribute to the error floor of an NB-LDPC code. In a recent research, the weight consistency matrix (WCM) framework was introduced as an effective combinatorial NB-LDPC code optimization methodology that is suitable for modern Flash memory and magnetic recording (MR) systems. The WCM framework was used to optimize codes for asymmetric Flash channels, MR channels that have intrinsic memory, in addition to canonical symmetric additive white Gaussian noise channels. In this paper, we provide an in-depth theoretical analysis needed to understand and properly apply the WCM framework. We focus on general absorbing sets of type two (GASTs) as the detrimental objects of interest. In particular, we introduce a novel tree representation of a GAST called the unlabeled GAST tree, using which we prove that the WCM framework is optimal in the sense that it operates on the minimum number of matrices, which are the WCMs, to remove a GAST. Then, we enumerate WCMs and demonstrate the significance of the savings achieved by the WCM framework in the number of matrices processed to remove a GAST. Moreover, we provide a linear-algebraic analysis of the null spaces of WCMs associated with a GAST. We derive the minimum number of edge weight changes needed to remove a GAST via its WCMs, along with how to choose these changes. In addition, we propose a new set of problematic objects, namely oscillating sets of type two (OSTs), which contribute to the error floor of NB-LDPC codes with even column weights on asymmetric channels, and we show how to customize the WCM framework to remove OSTs. We also extend the domain of the WCM framework applications by demonstrating its benefits in optimizing column weight 5 codes, codes used over Flash channels with additional soft information, and spatially coupled codes. The performance gains achieved via the WCM framework range between 1 and nearly 2.5 orders of magnitude in the error floor region over interesting channels.

[1]  Lara Dolecek,et al.  Non-Binary LDPC Codes for Magnetic Recording Channels: Error Floor Analysis and Optimized Code Design , 2016, IEEE Transactions on Communications.

[2]  Osman S. Unsal,et al.  Flash correct-and-refresh: Retention-aware error management for increased flash memory lifetime , 2012, 2012 IEEE 30th International Conference on Computer Design (ICCD).

[3]  Paul H. Siegel,et al.  Error floor approximation for LDPC codes in the AWGN channel , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Rolf Johannesson,et al.  Searching for Binary and Nonbinary Block and Convolutional LDPC Codes , 2016, IEEE Transactions on Information Theory.

[5]  Lara Dolecek,et al.  The Cycle Consistency Matrix Approach to Absorbing Sets in Separable Circulant-Based LDPC Codes , 2012, IEEE Transactions on Information Theory.

[6]  Lara Dolecek,et al.  Non-Binary LDPC Code Optimization for Partial-Response Channels , 2014, GLOBECOM 2014.

[7]  Lara Dolecek,et al.  Analysis and Enumeration of Absorbing Sets for Non-Binary Graph-Based Codes , 2014, IEEE Transactions on Communications.

[8]  Richard D. Wesel,et al.  Enhanced Precision Through Multiple Reads for LDPC Decoding in Flash Memories , 2013, IEEE Journal on Selected Areas in Communications.

[9]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[10]  Sandro Bellini,et al.  Thresholds of Absorbing Sets in Low-Density Parity-Check Codes , 2017, IEEE Transactions on Communications.

[11]  William E. Ryan,et al.  Low-Floor Detection/Decoding of LDPC-Coded Partial Response Channels , 2010, IEEE Journal on Selected Areas in Communications.

[12]  Lara Dolecek,et al.  Finite-Length Construction of High Performance Spatially-Coupled Codes via Optimized Partitioning and Lifting , 2019, IEEE Transactions on Communications.

[13]  Hua Xiao,et al.  Error Rate Estimation of Low-Density Parity-Check Codes Decoded by Quantized Soft-Decision Iterative Algorithms , 2013, IEEE Transactions on Communications.

[14]  Yong Liang Guan,et al.  Read and Write Voltage Signal Optimization for Multi-Level-Cell (MLC) NAND Flash Memory , 2016, IEEE Transactions on Communications.

[15]  Hsie-Chia Chang,et al.  A 520k (18900, 17010) Array Dispersion LDPC Decoder Architectures for NAND Flash Memory , 2016, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[16]  Rüdiger L. Urbanke,et al.  Design of capacity-approaching irregular low-density parity-check codes , 2001, IEEE Trans. Inf. Theory.

[17]  M. Fossorier,et al.  Design of regular (2,d/sub c/)-LDPC codes over GF(q) using their binary images , 2008, IEEE Transactions on Communications.

[18]  Qiuju Diao,et al.  Cyclic and Quasi-Cyclic LDPC Codes on Constrained Parity-Check Matrices and Their Trapping Sets , 2012, IEEE Transactions on Information Theory.

[19]  Amin Shokrollahi,et al.  LDPC Codes for 2D Arrays , 2014, IEEE Transactions on Information Theory.

[20]  Paul H. Siegel,et al.  Turbo decoding for partial response channels , 2000, IEEE Trans. Commun..

[21]  Xinde Hu,et al.  Error Floor Estimation of Long LDPC Codes on Magnetic Recording Channels , 2010, IEEE Transactions on Magnetics.

[22]  David G. M. Mitchell,et al.  Edge spreading design of high rate array-based SC-LDPC codes , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[23]  Tolga M. Duman,et al.  Comprehensive performance investigation of turbo codes over high density magnetic recording channels , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).

[24]  Simon Litsyn,et al.  Design of non-binary quasi-cyclic LDPC codes by ACE optimization , 2013, 2013 IEEE Information Theory Workshop (ITW).

[25]  Rami Cohen,et al.  Iterative Decoding of LDPC Codes Over the $q$ -Ary Partial Erasure Channel , 2015, IEEE Transactions on Information Theory.

[26]  Michael Lentmaier,et al.  Iterative Decoding Threshold Analysis for LDPC Convolutional Codes , 2010, IEEE Transactions on Information Theory.

[27]  Jaekyun Moon,et al.  Pattern-dependent noise prediction in signal-dependent noise , 2001, IEEE J. Sel. Areas Commun..

[28]  Pablo M. Olmos,et al.  A Scaling Law to Predict the Finite-Length Performance of Spatially-Coupled LDPC Codes , 2014, IEEE Transactions on Information Theory.

[29]  Mohamed M. Khairy,et al.  Selective max-min algorithm for low-density parity-check decoding , 2013, IET Commun..

[30]  Michael Lentmaier,et al.  Spatially Coupled LDPC Codes Constructed From Protographs , 2014, IEEE Transactions on Information Theory.

[31]  Lara Dolecek,et al.  High performance non-binary spatially-coupled codes for flash memories , 2017, 2017 IEEE Information Theory Workshop (ITW).

[32]  Qiuju Diao,et al.  LDPC Codes on Partial Geometries: Construction, Trapping Set Structure, and Puncturing , 2013, IEEE Transactions on Information Theory.

[33]  David Declercq,et al.  Decoding Algorithms for Nonbinary LDPC Codes Over GF$(q)$ , 2007, IEEE Transactions on Communications.

[34]  Paul H. Siegel,et al.  Windowed Decoding of Protograph-Based LDPC Convolutional Codes Over Erasure Channels , 2010, IEEE Transactions on Information Theory.

[35]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[36]  Lara Dolecek,et al.  Predicting error floors of structured LDPC codes: deterministic bounds and estimates , 2009, IEEE Journal on Selected Areas in Communications.

[37]  Giulio Colavolpe,et al.  On the application of factor graphs and the sum-product algorithm to ISI channels , 2005, IEEE Transactions on Communications.

[38]  Amir H. Banihashemi,et al.  On Characterization of Elementary Trapping Sets of Variable-Regular LDPC Codes , 2013, IEEE Transactions on Information Theory.

[39]  Jörg Kliewer,et al.  A generalized algebraic approach to optimizing SC-LDPC codes , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[40]  Jinhong Yuan,et al.  Euclidean Geometry-Based Spatially Coupled LDPC Codes for Storage , 2016, IEEE Journal on Selected Areas in Communications.

[41]  Haruhiko Kaneko,et al.  Error Control Coding for Multilevel Cell Flash Memories Using Nonbinary Low-Density Parity-Check Codes , 2009, 2009 24th IEEE International Symposium on Defect and Fault Tolerance in VLSI Systems.

[42]  Onur Mutlu,et al.  Threshold voltage distribution in MLC NAND flash memory: Characterization, analysis, and modeling , 2013, 2013 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[43]  Shayan Garani Srinivasa,et al.  A Communication-Theoretic Framework for 2-DMR Channel Modeling: Performance Evaluation of Coding and Signal Processing Methods , 2014, IEEE Transactions on Magnetics.

[44]  Giulio Colavolpe,et al.  Nonbinary spatially-coupled LDPC codes on the binary erasure channel , 2013, 2013 IEEE International Conference on Communications (ICC).

[45]  Ali Emre Pusane,et al.  Deriving Good LDPC Convolutional Codes from LDPC Block Codes , 2010, IEEE Transactions on Information Theory.

[46]  Amir H. Banihashemi,et al.  An efficient algorithm for finding dominant trapping sets of LDPC codes , 2011, 2010 6th International Symposium on Turbo Codes & Iterative Information Processing.

[47]  Emina Soljanin,et al.  Asymptotic Spectra of Trapping Sets in Regular and Irregular LDPC Code Ensembles , 2007, IEEE Transactions on Information Theory.

[48]  Lara Dolecek,et al.  Non-Binary Protograph-Based LDPC Codes: Enumerators, Analysis, and Designs , 2014, IEEE Transactions on Information Theory.

[49]  Alexandre Graell i Amat,et al.  Threshold Saturation for Nonbinary SC-LDPC Codes on the Binary Erasure Channel , 2016, IEEE Transactions on Information Theory.

[50]  David Declercq,et al.  Design of regular (2,d/sub c/)-LDPC codes over GF(q) using their binary images , 2008, IEEE Transactions on Communications.

[51]  Bane Vasic,et al.  Coding and Signal Processing for Magnetic Recording Systems , 2004 .

[52]  Yuta Toriyama,et al.  A 2.267-Gb/s, 93.7-pJ/bit Non-Binary LDPC Decoder With Logarithmic Quantization and Dual-Decoding Algorithm Scheme for Storage Applications , 2018, IEEE Journal of Solid-State Circuits.

[53]  Lara Dolecek,et al.  Spatially-Coupled Code Design for Partial-Response Channels: Optimal Object-Minimization Approach , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[54]  Lara Dolecek,et al.  Absorbing set characterization of array-based spatially coupled LDPC codes , 2014, 2014 IEEE International Symposium on Information Theory.

[55]  Rüdiger L. Urbanke,et al.  Spatially coupled ensembles universally achieve capacity under belief propagation , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[56]  Shashi Kiran Chilappagari,et al.  On the Construction of Structured LDPC Codes Free of Small Trapping Sets , 2012, IEEE Transactions on Information Theory.

[57]  Lara Dolecek,et al.  A General Non-Binary LDPC Code Optimization Framework Suitable for Dense Flash Memory and Magnetic Storage , 2016, IEEE Journal on Selected Areas in Communications.

[58]  Thomas P. Parnell,et al.  Modelling of the threshold voltage distributions of sub-20nm NAND flash memory , 2014, 2014 IEEE Global Communications Conference.

[59]  Lara Dolecek,et al.  Spatially Coupled Codes Optimized for Magnetic Recording Applications , 2017, IEEE Transactions on Magnetics.

[60]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.

[61]  Shashi Kiran Chilappagari,et al.  Eliminating trapping sets in low-density parity-check codes by using Tanner graph covers , 2008, IEEE Transactions on Information Theory.

[62]  Gerhard Fettweis,et al.  Improving code diversity on block-fading channels by spatial coupling , 2014, 2014 IEEE International Symposium on Information Theory.

[63]  Lara Dolecek,et al.  Analysis of Absorbing Sets and Fully Absorbing Sets of Array-Based LDPC Codes , 2009, IEEE Transactions on Information Theory.