A computer-aided investigation on the fundamental limits of caching

We considered the optimal memory-transmission-rate tradeoff of caching systems. Different from the conventional analytical approach usually seen in the information theory literature, we rely on a computer-aided approach in this investigation. The linear programming (LP) outer bound of the entropy space serves as the starting point of this approach, however our effort goes significantly beyond using it to prove information inequalities. We first identify and formalize the symmetry structure in the problem, which enables us to show the existence of optimal symmetric solutions. A symmetry-reduced linear program is then used to identify the boundary of the memory-transmission-rate tradeoff for several simple cases, for which we obtain a set of tight outer bounds. General hypotheses on the optimal tradeoff region are formed from these computed data, which are then analytically proved. This leads to a complete characterization of the optimal tradeoff for systems with only two users, and certain partial characterization for systems with only two files. Next, we show that by carefully analyzing the joint entropy structure of the outer bounds for certain cases, a novel code construction can be reverse-engineered, which eventually leads to a general class of codes. Finally, we show that strong outer bounds can be computed through strategically relaxing the LP. This allows us firstly to deduce generic characteristic of the converse proof, and secondly to compute outer bounds for larger problem cases, despite the seemingly impossible computation scale.

[1]  Chao Tian A Note on the Rate Region of Exact-Repair Regenerating Codes , 2015, ArXiv.

[2]  Zhen Zhang,et al.  On Characterization of Entropy Function via Information Inequalities , 1998, IEEE Trans. Inf. Theory.

[3]  Hooshang Ghasemi,et al.  Improved lower bounds for coded caching , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[4]  Urs Niesen,et al.  Fundamental Limits of Caching , 2014, IEEE Trans. Inf. Theory.

[5]  Randall Dougherty,et al.  Insufficiency of linear coding in network information flow , 2005, IEEE Transactions on Information Theory.

[6]  Mohammad Mohammadi Amiri,et al.  Fundamental Limits of Coded Caching: Improved Delivery Rate-Cache Capacity Trade-off , 2016 .

[7]  Chao Tian Characterizing the Rate Region of the (4,3,3) Exact-Repair Regenerating Codes , 2014, IEEE Journal on Selected Areas in Communications.

[8]  Urs Niesen,et al.  Decentralized coded caching attains order-optimal memory-rate tradeoff , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[9]  Chao Tian Symmetry, demand types and outer bounds in caching systems , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[10]  Jaime Llorca,et al.  Order-Optimal Rate of Caching and Coded Multicasting With Random Demands , 2015, IEEE Transactions on Information Theory.

[11]  Vinod M. Prabhakaran,et al.  Critical database size for effective caching , 2015, 2015 Twenty First National Conference on Communications (NCC).

[12]  Zhi Chen Fundamental Limits of Caching: Improved Bounds For Small Buffer Users , 2014, ArXiv.

[13]  Suhas N. Diggavi,et al.  Hierarchical coded caching , 2014, 2014 IEEE International Symposium on Information Theory.

[14]  A. Salman Avestimehr,et al.  The Exact Rate-Memory Tradeoff for Caching With Uncoded Prefetching , 2016, IEEE Transactions on Information Theory.

[15]  Chao Tian,et al.  Multilevel Diversity Coding With Regeneration , 2016, IEEE Trans. Inf. Theory.

[16]  Raymond W. Yeung,et al.  A framework for linear information inequalities , 1997, IEEE Trans. Inf. Theory.

[17]  Chao Tian,et al.  Symmetry, Outer Bounds, and Code Constructions: A Computer-Aided Investigation on the Fundamental Limits of Caching , 2016, 2017 IEEE International Symposium on Information Theory (ISIT).

[18]  T. Charles Clancy,et al.  Improved approximation of storage-rate tradeoff for caching via new outer bounds , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[19]  Urs Niesen,et al.  Coded Caching With Nonuniform Demands , 2017, IEEE Transactions on Information Theory.

[20]  Jun Chen,et al.  A Lower Bound on the Sum Rate of Multiple Description Coding With Symmetric Distortion Constraints , 2014, IEEE Transactions on Information Theory.

[21]  Michael Gastpar,et al.  K users caching two files: An improved achievable rate , 2016, 2016 Annual Conference on Information Science and Systems (CISS).

[22]  Zhen Zhang,et al.  On Symmetrical Multilevel Diversity Coding , 1999, IEEE Trans. Inf. Theory.

[23]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[24]  Urs Niesen,et al.  Online coded caching , 2014, ICC.

[25]  Michèle Wigger,et al.  Improved Converses and Gap Results for Coded Caching , 2018, IEEE Transactions on Information Theory.

[26]  Chao Tian,et al.  Caching and Delivery via Interference Elimination , 2018, IEEE Transactions on Information Theory.

[27]  Deniz Gündüz,et al.  Coded caching for a large number of users , 2016, 2016 IEEE Information Theory Workshop (ITW).

[28]  Raymond W. Yeung,et al.  A First Course in Information Theory , 2002 .

[29]  Kai Zhang,et al.  On the Symmetry Reduction of Information Inequalities , 2018, IEEE Transactions on Communications.

[30]  Ravi Tandon,et al.  Improved Approximation of Storage-Rate Tradeoff for Caching With Multiple Demands , 2016, IEEE Transactions on Communications.

[31]  B. Donald,et al.  Quantifier Elimination for Conjunctions of Linear Constraints via a Convex Hull Algorithm , 2013 .

[32]  John MacLaren Walsh,et al.  Multilevel Diversity Coding Systems: Rate Regions, Codes, Computation, & Forbidden Minors , 2014, IEEE Transactions on Information Theory.

[33]  Mohammad Ali Maddah-Ali,et al.  Characterizing the rate-memory tradeoff in cache networks within a factor of 2 , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[34]  Frank Harary,et al.  Graph Theory As A Mathematical Model In Social Science , 1953 .

[35]  Zhen Zhang,et al.  A non-Shannon-type conditional inequality of information quantities , 1997, IEEE Trans. Inf. Theory.

[36]  Jesús Gómez-Vilardebó,et al.  Fundamental Limits of Caching: Improved Rate-Memory Tradeoff with Coded Prefetching , 2018, 2018 IEEE International Conference on Communications (ICC).

[37]  Emil Grosswald,et al.  The Theory of Partitions , 1984 .

[38]  Chao Tian Latent capacity region: A case study on symmetric broadcast with common messages , 2009, ISIT.

[39]  Jayant Apte,et al.  Exploiting symmetry in computing polyhedral bounds on network coding rate regions , 2015, 2015 International Symposium on Network Coding (NetCod).

[40]  Kai Wan On Caching with More Users than Files , 2018 .

[41]  Zhi Chen,et al.  Fundamental limits of caching: improved bounds for users with small buffers , 2016, IET Commun..

[42]  Chee Wei Tan,et al.  Proving and disproving information inequalities , 2014, 2014 IEEE International Symposium on Information Theory.