Hierarchical Coding to Enable Scalability and Flexibility in Heterogeneous Cloud Storage

In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. Codes with hierarchical locality have been intensively studied due to their effectiveness in reducing the average reading time in cloud storage. In this paper, we present the first codes with hierarchical locality that achieve scalability and flexibility in heterogeneous cloud storage using small field size. We propose a double- level construction utilizing so-called Cauchy Reed-Solomon codes. We then develop a triple-level construction based on this double-level code; this construction can be easily generalized into any hierarchical structure with a greater number of layers since it naturally achieves scalability in the cloud storage systems.

[1]  Hong Jiang,et al.  Improving Storage Availability in Cloud-of-Clouds with Hybrid Redundant Data Distribution , 2015, 2015 IEEE International Parallel and Distributed Processing Symposium.

[2]  Xinmiao Zhang.  Generalized Three-Layer Integrated Interleaved Codes , 2018, IEEE Communications Letters.

[3]  Paul H. Siegel,et al.  Multi-erasure locally recoverable codes over small fields , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Martin Bossert,et al.  Multi-block interleaved codes for local and global read access , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[5]  Khaled Abdel-Ghaffar,et al.  Integrated interleaving - a novel ECC architecture , 2001 .

[6]  Frank R. Kschischang,et al.  Universal and Dynamic Locally Repairable Codes with Maximal Recoverability via Sum-Rank Codes , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[7]  Mario Blaum,et al.  Extended Product and Integrated Interleaved Codes , 2018, IEEE Transactions on Information Theory.

[8]  Ian Lumb,et al.  A Taxonomy and Survey of Cloud Computing Systems , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[9]  Yingquan Wu.  Generalized Integrated Interleaved Codes , 2017, IEEE Transactions on Information Theory.

[10]  Alexander Barg,et al.  Codes With Hierarchical Locality From Covering Maps of Curves , 2019, IEEE Transactions on Information Theory.