More Space may be Cheaper: Multi-Dimensional Resource Allocation for NVM-based Cloud Cache

Cloud cache has been crucial to promoting the performance of I/O intensive applications. Due to the capacity and cost advantages over DRAM, NVM has been gradually utilized in cloud cache. However, NVM usually has limited write endurance, resulting in a frequent device replacement and a high cost. Cloud cache also needs to ensure Service-Level Agreement (SLA) such as an enough cache capacity, but there are few existing approaches that deal with the NVM writing problem without breaking SLA. Therefore, we propose a new SLA-aware cloud cache framework called MECC to extend the NVM lifetimes and thus reduce the total system cost with performance ensurance. Through dynamically allocating the two kinds of resources, i.e., NVM cache space and cache updating quota, to tenants according to their characteristics, MECC achieves the same performance for all tenants with a 56.3% cost reduction on average.

[1]  Adam Leventhal,et al.  Flash storage memory , 2008, CACM.

[2]  Mohit Singh,et al.  Sharing Buffer Pool Memory in Multi-Tenant Relational Database-as-a-Service , 2015, Proc. VLDB Endow..

[3]  池本 顕一,et al.  Service Level Agreementに基づいたサービス管理方法 , 1996 .

[4]  Jinoh Kim,et al.  Learning-based Dynamic Cache Management in a Cloud , 2019, J. Parallel Distributed Comput..

[5]  Xiaozhou Li,et al.  DistCache: Provable Load Balancing for Large-Scale Storage Systems with Distributed Caching , 2019, FAST.

[6]  Onur Mutlu,et al.  Architecting phase change memory as a scalable dram alternative , 2009, ISCA '09.

[7]  Jing Xu,et al.  CloudCache: On-demand Flash Cache Management for Cloud Computing , 2016, FAST.

[8]  Mor Harchol-Balter,et al.  RobinHood: Tail Latency Aware Caching - Dynamic Reallocation from Cache-Rich to Cache-Poor , 2018, OSDI.

[9]  Benjamin Hindman,et al.  Dominant Resource Fairness: Fair Allocation of Multiple Resource Types , 2011, NSDI.

[10]  Sachin Katti,et al.  Flashield: a Hybrid Key-value Cache that Controls Flash Write Amplification , 2019, NSDI.

[11]  Sachin Katti,et al.  Reducing DRAM footprint with NVM in Facebook , 2018, EuroSys.

[12]  Ken Takeuchi,et al.  Analysis on Heterogeneous SSD Configuration with Quadruple-Level Cell (QLC) NAND Flash Memory , 2019, 2019 IEEE 11th International Memory Workshop (IMW).

[13]  Chun Jason Xue,et al.  SLC-enabled wear leveling for MLC PCM considering process variation , 2014, 2014 51st ACM/EDAC/IEEE Design Automation Conference (DAC).

[14]  Woongki Baek,et al.  CoPart: Coordinated Partitioning of Last-Level Cache and Memory Bandwidth for Fairness-Aware Workload Consolidation on Commodity Servers , 2019, EuroSys.

[15]  Antony I. T. Rowstron,et al.  Write off-loading: Practical power management for enterprise storage , 2008, TOS.

[16]  Antony I. T. Rowstron,et al.  Software-defined caching: managing caches in multi-tenant data centers , 2015, SoCC.

[17]  Zhiyi Ma,et al.  Towards an SLA-Driven cache adjustment approach for applications on PaaS , 2013, Internetware.

[18]  Song Jiang,et al.  OC-Cache: An Open-channel SSD Based Cache for Multi-Tenant Systems , 2018, 2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC).