Locally Repairable and Locally Regenerating Codes Obtained by Parity-Splitting of HashTag Codes

We construct an explicit family of locally repairable and locally regenerating codes whose existence was proven in a recent work by Kamath et al. about codes with local regeneration (but no explicit construction was given). This explicit family of codes is based on HashTag codes. HashTag codes are recently defined vector codes with different vector length $\alpha$ (also called a sub-packetization level) that achieve the optimal repair bandwidth of MSR codes or near-optimal repair bandwidth depending on the sub-packetization level. We applied the technique of parity-splitting code construction. Additionally, we show that the lower bound on the size of the finite field where these codes are constructed, given in the same work of Kamath et al., can be lower. Finally, we discuss the importance of having two ways for node repair with locally regenerating HashTag codes: repair only with local parity nodes or repair with both local and global parity nodes. To the best of the authors' knowledge, this is the first work where this is discussed. Namely, we give a practical example where several optimization metrics such as the repair bandwidth, the number of I/O operations, the access time for the contacted parts and the size of the stored file determine the repair procedure.

[1]  Harald Øverby,et al.  General Sub-Packetized Access-Optimal Regenerating Codes , 2016, IEEE Communications Letters.

[2]  Dimitris S. Papailiopoulos,et al.  Simple regenerating codes: Network coding for cloud storage , 2011, 2012 Proceedings IEEE INFOCOM.

[3]  Camilla Hollanti,et al.  A connection between locally repairable codes and exact regenerating codes , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[4]  Harald Øverby,et al.  HashTag Erasure Codes: From Theory to Practice , 2016, IEEE Transactions on Big Data.

[5]  Alexandros G. Dimakis,et al.  Network Coding for Distributed Storage Systems , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[6]  Minghua Chen,et al.  Pyramid Codes: Flexible Schemes to Trade Space for Access Efficiency in Reliable Data Storage Systems , 2007, Sixth IEEE International Symposium on Network Computing and Applications (NCA 2007).

[7]  Alexander Barg,et al.  Explicit Constructions of Optimal-Access MDS Codes With Nearly Optimal Sub-Packetization , 2016, IEEE Transactions on Information Theory.

[8]  Cheng Huang,et al.  On the Locality of Codeword Symbols , 2011, IEEE Transactions on Information Theory.

[9]  Chih-Chun Wang,et al.  When locally repairable codes meet regenerating codes — What if some helpers are unavailable , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[10]  Dimitris S. Papailiopoulos,et al.  XORing Elephants: Novel Erasure Codes for Big Data , 2013, Proc. VLDB Endow..

[11]  P. Vijay Kumar,et al.  Codes With Local Regeneration and Erasure Correction , 2014, IEEE Transactions on Information Theory.

[12]  Harald Øverby,et al.  Balanced locally repairable codes , 2016, 2016 9th International Symposium on Turbo Codes and Iterative Information Processing (ISTC).

[13]  Frédérique Oggier,et al.  Self-repairing homomorphic codes for distributed storage systems , 2010, 2011 Proceedings IEEE INFOCOM.

[14]  Cheng Huang,et al.  Erasure Coding in Windows Azure Storage , 2012, USENIX Annual Technical Conference.

[15]  Sriram Vishwanath,et al.  Optimal Locally Repairable and Secure Codes for Distributed Storage Systems , 2012, IEEE Transactions on Information Theory.