Cache Networks of Counting Queues

We consider a cache network in which intermediate nodes equipped with caches can serve content requests. We model this network as a universally stable queuing system, in which packets carrying identical responses are consolidated before being forwarded downstream. We refer to resulting queues as <inline-formula> <tex-math notation="LaTeX">$\mathtt {M/M/1c}$ </tex-math></inline-formula> or <italic>counting queues</italic>, as consolidated packets carry a counter indicating the packet’s multiplicity. Cache networks comprising such queues are hard to analyze; we propose two approximations: one via <inline-formula> <tex-math notation="LaTeX">$\mathtt {M/M/\infty }$ </tex-math></inline-formula> queues, and one based on <inline-formula> <tex-math notation="LaTeX">$\mathtt {M/M/1c}$ </tex-math></inline-formula> queues under the assumption of Poisson arrivals. We show that, in both cases, the problem of jointly determining (a) content placements and (b) service rates admits a poly-time, <inline-formula> <tex-math notation="LaTeX">$1-1/e$ </tex-math></inline-formula> approximation algorithm. We also show that our analysis, with respect to both algorithms and associated guarantees, extends to (a) counting queues over items, rather than responses, as well as to (b) queuing at nodes and edges, as opposed to just edges. Numerical evaluations indicate that our proposed approximation algorithms yield good solutions in practice, significantly outperforming competitors.

[1]  Anthony Unwin,et al.  Reversibility and Stochastic Networks , 1980 .

[2]  Stephen Farrell,et al.  Network of Information (NetInf) - An information-centric networking architecture , 2013, Comput. Commun..

[3]  Stratis Ioannidis,et al.  Kelly Cache Networks , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[4]  Vyas Sekar,et al.  SmartRE: an architecture for coordinated network-wide redundancy elimination , 2009, SIGCOMM '09.

[5]  Jan Vondrák,et al.  Optimal approximation for submodular and supermodular optimization with bounded curvature , 2013, SODA.

[6]  Donald F. Towsley,et al.  Analysis of TTL-based cache networks , 2012, 6th International ICST Conference on Performance Evaluation Methodologies and Tools.

[7]  Ying Cui,et al.  VIP: a framework for joint dynamic forwarding and caching in named data networks , 2013, ICN '14.

[8]  Andreas Krause,et al.  Continuous DR-submodular Maximization: Structure and Algorithms , 2017, NIPS 2017.

[9]  Peter G. Harrison,et al.  Performance modelling of communication networks and computer architectures , 1992, International computer science series.

[10]  Chaitanya Swamy,et al.  Approximation Algorithms for Data Placement Problems , 2008, SIAM J. Comput..

[11]  Kin K. Leung,et al.  Optimal Energy Tradeoff Among Communication, Computation and Caching with QoI-Guarantee , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[12]  J. R. Jackson Networks of Waiting Lines , 1957 .

[13]  Donald F. Towsley,et al.  On the complexity of optimal routing and content caching in heterogeneous networks , 2014, 2015 IEEE Conference on Computer Communications (INFOCOM).

[14]  Ronald W. Wolff,et al.  Poisson Arrivals See Time Averages , 1982, Oper. Res..

[15]  Miguel Rio,et al.  DR-Cache: Distributed Resilient Caching with Latency Guarantees , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[16]  Florin Ciucu,et al.  Exact analysis of TTL cache networks , 2014, Perform. Evaluation.

[17]  Stratis Ioannidis,et al.  Jointly Optimal Routing and Caching for Arbitrary Network Topologies , 2017, IEEE Journal on Selected Areas in Communications.

[18]  Alhussein A. Abouzeid,et al.  Proactive retention aware caching , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[19]  Vahab S. Mirrokni,et al.  Tight approximation algorithms for maximum general assignment problems , 2006, SODA '06.

[20]  R. Gallager Stochastic Processes , 2014 .

[21]  Myron Hlynka,et al.  Queueing Networks and Markov Chains (Modeling and Performance Evaluation With Computer Science Applications) , 2007, Technometrics.

[22]  Antonios Argyriou,et al.  Distributed Caching Algorithms in the Realm of Layered Video Streaming , 2019, IEEE Transactions on Mobile Computing.

[23]  Atilla Eryilmaz,et al.  Wireless Multicasting for Content Distribution: Stability and Delay Gain Analysis , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[24]  Konstantinos Poularakis,et al.  Code, Cache and Deliver on the Move: A Novel Caching Paradigm in Hyper-Dense Small-Cell Networks , 2017, IEEE Transactions on Mobile Computing.

[25]  S. Shenker,et al.  Replication strategies in unstructured peer-to-peer networks , 2002, SIGCOMM '02.

[26]  Sem C. Borst,et al.  Distributed Caching Algorithms for Content Distribution Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[27]  Michele Garetto,et al.  A unified approach to the performance analysis of caching systems , 2013, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[28]  Stratis Ioannidis,et al.  Intermediate Data Caching Optimization for Multi-Stage and Parallel Big Data Frameworks , 2018, 2018 IEEE 11th International Conference on Cloud Computing (CLOUD).

[29]  Van Jacobson,et al.  Networking named content , 2009, CoNEXT '09.

[30]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless Content Delivery Through Distributed Caching Helpers , 2013, IEEE Transactions on Information Theory.

[31]  Konstantinos Poularakis,et al.  On the Complexity of Optimal Content Placement in Hierarchical Caching Networks , 2016, IEEE Transactions on Communications.

[32]  Andreas Krause,et al.  Submodular Function Maximization , 2014, Tractability.

[33]  S. Zachary,et al.  Loss networks , 2009, 0903.0640.

[34]  Cheng-Shang Chang,et al.  Performance guarantees in communication networks , 2000, Eur. Trans. Telecommun..

[35]  Yuval Filmus,et al.  Monotone Submodular Maximization over a Matroid via Non-Oblivious Local Search , 2012, SIAM J. Comput..

[36]  M. Stone Applications of the theory of Boolean rings to general topology , 1937 .

[37]  Seungjoon Lee,et al.  Optimal Content Placement for a Large-Scale VoD System , 2010, IEEE/ACM Transactions on Networking.

[38]  Giuseppe Bianchi,et al.  Check before storing: what is the performance price of content integrity verification in LRU caching? , 2013, CCRV.

[39]  Andreas Krause,et al.  Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domains , 2016, AISTATS.

[40]  J. Riordan Moment Recurrence Relations for Binomial, Poisson and Hypergeometric Frequency Distributions , 1937 .

[41]  Mohamad Assaad,et al.  Energy Efficiency in Cache-Enabled Small Cell Networks With Adaptive User Clustering , 2018, IEEE Transactions on Wireless Communications.

[42]  Zhensheng Zhang,et al.  A heuristic wavelength assignment algorithm for multihop WDM networks with wavelength routing and wavelength re-use , 1995, TNET.

[43]  R. J. Paul,et al.  Optimization Theory: The Finite Dimensional Case , 1977 .

[44]  Bo Li,et al.  CoolStreaming/DONet: a data-driven overlay network for peer-to-peer live media streaming , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[45]  Jan Vondrák,et al.  Dependent Randomized Rounding via Exchange Properties of Combinatorial Structures , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[46]  Yuanyuan Li,et al.  Universally Stable Cache Networks , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[47]  Ming Zhang,et al.  An untold story of middleboxes in cellular networks , 2011, SIGCOMM.

[48]  Jan Vondrák,et al.  Maximizing a Monotone Submodular Function Subject to a Matroid Constraint , 2011, SIAM J. Comput..

[49]  Hao Che,et al.  Hierarchical Web caching systems: modeling, design and experimental results , 2002, IEEE J. Sel. Areas Commun..

[50]  Dario Rossi,et al.  Caching performance of content centric networks under multi-path routing (and more) , 2011 .

[51]  I. Stoica,et al.  A data-oriented (and beyond) network architecture , 2007, SIGCOMM '07.

[52]  Daniel Sadoc Menasché,et al.  Flexible Content Placement in Cache Networks using Reinforced Counters , 2015, ArXiv.

[53]  Yuguang Fang,et al.  Teletraffic analysis and mobility modeling of PCS networks , 1999, IEEE Trans. Commun..

[54]  Costas Courcoubetis,et al.  Pricing communication networks - economics, technology and modelling , 2003, Wiley-Interscience series in systems and optimization.

[55]  Srinivasan Keshav,et al.  An Engineering Approach to Computer Networking: ATM Networks , 1996 .

[56]  Philippe Robert,et al.  A versatile and accurate approximation for LRU cache performance , 2012, 2012 24th International Teletraffic Congress (ITC 24).

[57]  Konstantinos Poularakis,et al.  Joint Caching and Routing in Congestible Networks of Arbitrary Topology , 2019, IEEE Internet of Things Journal.

[58]  Konstantinos Poularakis,et al.  Service Placement and Request Routing in MEC Networks With Storage, Computation, and Communication Constraints , 2020, IEEE/ACM Transactions on Networking.

[59]  Yuval Rabani,et al.  Competitive Algorithms for Distributed Data Management , 1995, J. Comput. Syst. Sci..

[60]  Maxim Sviridenko,et al.  Pipage Rounding: A New Method of Constructing Algorithms with Proven Performance Guarantee , 2004, J. Comb. Optim..

[61]  Stratis Ioannidis,et al.  Adaptive Caching Networks With Optimality Guarantees , 2016, IEEE/ACM Transactions on Networking.