Harmonized memory system for object-based cloud storage

A new storage system that integrates non-volatile with conventional memory, a harmonized memory system (HMS) for object-based cloud storage, is proposed. The system overcomes IO bottlenecks when managing large amounts of metadata and transaction logs and is composed of five modules. The first, the harmonized memory supervisor, is a translation layer for accessing the harmonized array module. It manages address translation, address mapping by page linking, and wear leveling. The second, the harmonized array module, is divided into dynamic and static areas composed of DRAM, and PCM together with NAND flash memory, respectively. The harmonized memory migration engine and data pattern predictor, which anticipates future data flow, are designed to maximize the effectiveness of the PCM array area. The harmonized logging conductor processes the log between the PCM array and NAND flash areas. Experimental results show the total execution time and energy consumption of HMS is 5.77 faster and 4.27 times lower, respectively, than the conventional DRAM-HDD model for object-based storage workloads.

[1]  Suman Nath,et al.  Rethinking Database Algorithms for Phase Change Memory , 2011, CIDR.

[2]  Thomas F. Wenisch,et al.  Storage Management in the NVRAM Era , 2013, Proc. VLDB Endow..

[3]  Osamu Tatebe,et al.  Design of Object Storage Using OpenNVM for High-performance Distributed File System , 2016, J. Inf. Process..

[4]  Ning Zhang,et al.  Building Cost-Effective Storage Clouds , 2014, 2014 IEEE International Conference on Cloud Engineering.

[5]  Michael Stonebraker,et al.  A Prolegomenon on OLTP Database Systems for Non-Volatile Memory , 2014, ADMS@VLDB.

[6]  Charles C. Weems,et al.  A New Memory-Disk Integrated System with HW Optimizer , 2015, ACM Trans. Archit. Code Optim..

[7]  Ravindra Patankar,et al.  Automated validation of structured large databases: an illustration of material code bulk validation , 2016, Int. J. Big Data Intell..

[8]  Ada Gavrilovska,et al.  pVM: persistent virtual memory for efficient capacity scaling and object storage , 2016, EuroSys.

[9]  Michael Stonebraker,et al.  Anti-Caching: A New Approach to Database Management System Architecture , 2013, Proc. VLDB Endow..

[10]  Amar Kapadia,et al.  OpenStack Object Storage (Swift) Essentials , 2015 .

[11]  Nancy A. Lynch,et al.  Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services , 2002, SIGA.

[12]  Joe Arnold,et al.  OpenStack Swift: Using, Administering, and Developing for Swift Object Storage , 2014 .

[13]  Jun Yang,et al.  Fine-grained metadata journaling on NVM , 2016, 2016 32nd Symposium on Mass Storage Systems and Technologies (MSST).

[14]  Kui Ren,et al.  On the synchronization bottleneck of OpenStack Swift-like cloud storage systems , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[15]  Karsten Schwan,et al.  NVRAM-aware Logging in Transaction Systems , 2014, Proc. VLDB Endow..

[16]  M.H. Kryder,et al.  After Hard Drives—What Comes Next? , 2009, IEEE Transactions on Magnetics.

[17]  Gary Valentin,et al.  Fractal prefetching B+-Trees: optimizing both cache and disk performance , 2002, SIGMOD '02.

[18]  Fabrice Bellard,et al.  QEMU, a Fast and Portable Dynamic Translator , 2005, USENIX Annual Technical Conference, FREENIX Track.

[19]  Jian Zhang,et al.  COSBench: cloud object storage benchmark , 2013, ICPE '13.

[20]  C. Mohan,et al.  High performance database logging using storage class memory , 2011, 2011 IEEE 27th International Conference on Data Engineering.

[21]  Caitlin Bestler,et al.  Scalable Object Storage with Resource Reservations and Dynamic Load Balancing , 2016, 2016 IEEE International Conference on Networking, Architecture and Storage (NAS).

[22]  Thandar Thein,et al.  A platform for big data analytics on distributed scale-out storage system , 2015, Int. J. Big Data Intell..

[23]  Shin-Dug Kim,et al.  Optimized Memory-Disk Integrated System with DRAM and Nonvolatile Memory , 2016, IEEE Transactions on Multi-Scale Computing Systems.