New bounds on the field size for maximally recoverable codes instantiating grid-like topologies

In recent years, the rapidly increasing amounts of data created and processed through the internet resulted in distributed storage systems employing erasure coding based schemes. Aiming to balance the tradeoff between data recovery for correlated failures and efficient encoding and decoding, distributed storage systems employing maximally recoverable codes came up. Unifying a number of topologies considered both in theory and practice, Gopalan \cite{Gopalan2017} initiated the study of maximally recoverable codes for grid-like topologies. In this paper, we focus on the maximally recoverable codes that instantiate grid-like topologies $T_{m\times n}(1,b,0)$. To characterize the property of codes for these topologies, we introduce the notion of \emph{pseudo-parity check matrix}. Then, using the hypergraph independent set approach, we establish the first polynomial upper bound on the field size needed for achieving the maximal recoverability in topologies $T_{m\times n}(1,b,0)$, when $n$ is large enough. And we further improve this general upper bound for topologies $T_{4\times n}(1,2,0)$ and $T_{3\times n}(1,3,0)$. By relating the problem to generalized \emph{Sidon sets} in $\mathbb{F}_q$, we also obtain non-trivial lower bounds on the field size for maximally recoverable codes that instantiate topologies $T_{4\times n}(1,2,0)$ and $T_{3\times n}(1,3,0)$.

[1]  Nihar B. Shah,et al.  Optimal Exact-Regenerating Codes for Distributed Storage at the MSR and MBR Points via a Product-Matrix Construction , 2010, IEEE Transactions on Information Theory.

[2]  Dimitris S. Papailiopoulos,et al.  Optimal locally repairable codes and connections to matroid theory , 2013, 2013 IEEE International Symposium on Information Theory.

[3]  Frédérique E. Oggier,et al.  Locally repairable codes with multiple repair alternatives , 2013, 2013 IEEE International Symposium on Information Theory.

[4]  Dimitris S. Papailiopoulos,et al.  Simple regenerating codes: Network coding for cloud storage , 2011, 2012 Proceedings IEEE INFOCOM.

[5]  A. Dimakis,et al.  Deterministic Regenerating Codes for Distributed Storage Yunnan , 2007 .

[6]  Dimitris S. Papailiopoulos,et al.  XORing Elephants: Novel Erasure Codes for Big Data , 2013, Proc. VLDB Endow..

[7]  Shachar Lovett,et al.  The Independence Number of the Birkhoff Polytope Graph, and Applications to Maximally Recoverable Codes , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[8]  Zhifang Zhang,et al.  Repair Locality With Multiple Erasure Tolerance , 2014, IEEE Transactions on Information Theory.

[9]  Cheng Huang,et al.  Erasure Coding in Windows Azure Storage , 2012, USENIX Annual Technical Conference.

[10]  Sergey Yekhanin,et al.  On the locality of codeword symbols in non-linear codes , 2013, Discret. Math..

[11]  Sriram Vishwanath,et al.  Optimal locally repairable codes via rank-metric codes , 2013, 2013 IEEE International Symposium on Information Theory.

[12]  Elena Grigorescu,et al.  Maximally recoverable codes: The bounded case , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[13]  Cheng Huang,et al.  On the Locality of Codeword Symbols , 2011, IEEE Transactions on Information Theory.

[14]  Alexandr V. Kostochka,et al.  On independent sets in hypergraphs , 2011, Random Struct. Algorithms.

[15]  Cheng Huang,et al.  Explicit Maximally Recoverable Codes With Locality , 2013, IEEE Transactions on Information Theory.

[16]  Chau Yuen,et al.  Optimal Locally Repairable Linear Codes , 2014, IEEE Journal on Selected Areas in Communications.

[17]  Frédérique Oggier,et al.  Self-repairing homomorphic codes for distributed storage systems , 2010, 2011 Proceedings IEEE INFOCOM.

[18]  Balaji Srinivasan Babu,et al.  Binary codes with locality for multiple erasures having short block length , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[19]  Alexandros G. Dimakis,et al.  Network Coding for Distributed Storage Systems , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[20]  Dimitris S. Papailiopoulos,et al.  Locally Repairable Codes , 2012, IEEE Transactions on Information Theory.

[21]  Itzhak Tamo,et al.  A Family of Optimal Locally Recoverable Codes , 2013, IEEE Transactions on Information Theory.

[22]  Vojtech Rödl,et al.  On Uncrowded Hypergraphs , 1995, Random Struct. Algorithms.

[23]  Yunnan Wu,et al.  Reducing repair traffic for erasure coding-based storage via interference alignment , 2009, 2009 IEEE International Symposium on Information Theory.

[24]  Oleg Golberg Combinatorial Nullstellensatz , 2007 .

[25]  Zhifang Zhang,et al.  An Integer Programming-Based Bound for Locally Repairable Codes , 2014, IEEE Transactions on Information Theory.

[26]  Itzhak Tamo,et al.  Locally Recoverable Codes on Algebraic Curves , 2017, IEEE Transactions on Information Theory.

[27]  János Komlós,et al.  A Note on Ramsey Numbers , 1980, J. Comb. Theory, Ser. A.

[28]  Paul H. Siegel,et al.  Binary Linear Locally Repairable Codes , 2015, IEEE Transactions on Information Theory.

[29]  F. MacWilliams,et al.  The Theory of Error-Correcting Codes , 1977 .

[30]  P. Vijay Kumar,et al.  Codes with locality for two erasures , 2014, 2014 IEEE International Symposium on Information Theory.

[31]  Wentu Song,et al.  On Sequential Locally Repairable Codes , 2018, IEEE Transactions on Information Theory.

[32]  Venkatesan Guruswami,et al.  Maximally Recoverable LRCs: A field size lower bound and constructions for few heavy parities , 2019, SODA.

[33]  P. Vijay Kumar,et al.  Optimal linear codes with a local-error-correction property , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[34]  A. Robert Calderbank,et al.  Binary cyclic codes that are locally repairable , 2014, 2014 IEEE International Symposium on Information Theory.

[35]  Shubhangi Saraf,et al.  Maximally Recoverable Codes for Grid-like Topologies , 2016, SODA.

[36]  Arya Mazumdar,et al.  Bounds on the Size of Locally Recoverable Codes , 2015, IEEE Transactions on Information Theory.

[37]  Natalia Silberstein,et al.  Optimal binary locally repairable codes via anticodes , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[38]  Rudolf Lide,et al.  Finite fields , 1983 .

[39]  Hong-Yeop Song,et al.  Binary Locally Repairable Codes With Minimum Distance at Least Six Based on Partial $t$ -Spreads , 2017, IEEE Communications Letters.

[40]  Bin Chen,et al.  Some results on optimal locally repairable codes , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[41]  Masoud Ardakani,et al.  A Class of Binary Locally Repairable Codes , 2016, IEEE Transactions on Communications.

[42]  Itzhak Tamo,et al.  Bounds on locally recoverable codes with multiple recovering sets , 2014, 2014 IEEE International Symposium on Information Theory.

[43]  János Komlós,et al.  Extremal Uncrowded Hypergraphs , 1982, J. Comb. Theory, Ser. A.

[44]  D. Shivakrishna,et al.  On Maximally Recoverable Codes for Product Topologies , 2018, 2018 Twenty Fourth National Conference on Communications (NCC).

[45]  Qiang Fu,et al.  Locality of optimal binary codes , 2017, Finite Fields Their Appl..

[46]  K. Conrad,et al.  Finite Fields , 2018, Series and Products in the Development of Mathematics.

[47]  Minghua Chen,et al.  On the Maximally Recoverable Property for Multi-Protection Group Codes , 2007, 2007 IEEE International Symposium on Information Theory.