When Can Helper Node Selection Improve Regenerating Codes? Part II: An Explicit Exact-Repair Code Construction

Part I of this work answered the following fundamental question: Under and only under what (n,k,d) values does proactively choosing the helper nodes improve the storage-bandwidth tradeoff of regenerating codes (RCs)? A critical component of the achievability results in Part I is a low-complexity helper selection solution, termed the family helper selection (FHS) scheme. In Part I, FHS was proved to be optimal or weakly optimal (depending on the underlying scenario) based on the assumption that as long as the minimum min-cut value of FHS is no less than the file size, we can always find a distributed storage code that can reconstruct the original file. This work relaxes this assumption by providing an exact-repair code construction that attains the minimum-bandwidth-regenerating (MBR) point of FHS, previously calculated/predicted only by the min-cut analysis in Part I. As an outcome, for the MBR points, FHS is indeed optimal or weakly optimal under various scenarios. In addition to closing the loop of the graph-based study in Part I, the proposed construction can also be viewed as a generalization of the existing fractional repetition (FR) codes. FR codes are exact-repair codes that admit the highly-desirable repair-by-transfer property. However, the unique construction of FR codes limits its application to a restricted set of (n,k,d) system parameters. In contrast, our new construction, termed the generalized FR (GFR) codes, can be applied to arbitrary (n,k,d) values. Our GFR codes retain most of the practical benefits of FR codes, i.e., being exact-repair and being almost repairable-by-transfer.

[1]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[2]  Shuo-Yen Robert Li,et al.  Linear network coding , 2003, IEEE Trans. Inf. Theory.

[3]  Kannan Ramchandran,et al.  Distributed Storage Codes With Repair-by-Transfer and Nonachievability of Interior Points on the Storage-Bandwidth Tradeoff , 2010, IEEE Transactions on Information Theory.

[4]  Tracey Ho,et al.  A Random Linear Network Coding Approach to Multicast , 2006, IEEE Transactions on Information Theory.

[5]  Kannan Ramchandran,et al.  Interference Alignment in Regenerating Codes for Distributed Storage: Necessity and Code Constructions , 2010, IEEE Transactions on Information Theory.

[6]  Kannan Ramchandran,et al.  DRESS codes for the storage cloud: Simple randomized constructions , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[7]  Nihar B. Shah,et al.  Optimal Exact-Regenerating Codes for Distributed Storage at the MSR and MBR Points via a Product-Matrix Construction , 2010, IEEE Transactions on Information Theory.

[8]  Kannan Ramchandran,et al.  Asymptotic Interference Alignment for Optimal Repair of MDS Codes in Distributed Storage , 2013, IEEE Transactions on Information Theory.

[9]  Yunnan Wu,et al.  A Construction of Systematic MDS Codes With Minimum Repair Bandwidth , 2009, IEEE Transactions on Information Theory.

[10]  Kannan Ramchandran,et al.  Fractional repetition codes for repair in distributed storage systems , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  Natalia Silberstein,et al.  Optimal Fractional Repetition Codes Based on Graphs and Designs , 2014, IEEE Transactions on Information Theory.

[12]  Chih-Chun Wang,et al.  When Can Helper Node Selection Improve Regenerating Codes? Part I: Graph-Based Analysis , 2016, ArXiv.

[13]  Yunnan Wu Existence and construction of capacity-achieving network codes for distributed storage , 2009, 2009 IEEE International Symposium on Information Theory.

[14]  Aditya Ramamoorthy,et al.  Replication based storage systems with local repair , 2013, 2013 International Symposium on Network Coding (NetCod).

[15]  Yunnan Wu,et al.  Reducing repair traffic for erasure coding-based storage via interference alignment , 2009, 2009 IEEE International Symposium on Information Theory.

[16]  Kannan Ramchandran,et al.  Explicit construction of optimal exact regenerating codes for distributed storage , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[17]  Chih-Chun Wang,et al.  When Can Intelligent Helper Node Selection Improve the Performance of Distributed Storage Networks? , 2018, IEEE Transactions on Information Theory.

[18]  Van H. Vu,et al.  Generating Random Regular Graphs , 2003, STOC '03.

[19]  Kenneth W. Shum,et al.  General Fractional Repetition Codes for Distributed Storage Systems , 2014, IEEE Communications Letters.

[20]  Aditya Ramamoorthy,et al.  Repairable replication-based storage systems using resolvable designs , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[21]  Sriram Vishwanath,et al.  Explicit MBR all-symbol locality codes , 2013, 2013 IEEE International Symposium on Information Theory.

[22]  John T. Gill,et al.  Scalable constructions of fractional repetition codes in distributed storage systems , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[23]  Alexandros G. Dimakis,et al.  Network Coding for Distributed Storage Systems , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.