A Scale-Out Enterprise Storage Architecture

A robust enterprise SSD design should provide scalable throughput and storage capacity by integrating (up to thousands) flash chips in a scale-out fashion. However, the current "channel-based" SSD architecture is not a scalable design choice to allow such a dense integration. Motivated by the inherent architectural scalability of PCIe, we propose UT-SSD, a novel enterprise-scale scale-out SSD architecture, which enables the connection of a large number of (1000s) flash chips using the native PCIe buses instead of the conventional channels. We also propose an architectural enhancement that further improves the performance of our base UT-SSD by maximizing flash utilization. Our experimental analysis of UT-SSD with workloads drawn from various domains shows that the throughput of UT-SSD can reach up to 110 GB/s by successfully aggregating the bandwidth of 4096 flash chips. In addition, our proposed enhancement over this base UT-SSD increases the flash utilization by 50.7%, which in turn results in 116% additional throughput improvement.

[1]  Steven Swanson,et al.  QuickSAN: a storage area network for fast, distributed, solid state disks , 2013, ISCA.

[2]  A. L. Narasimha Reddy,et al.  Don't Let RAID Raid the Lifetime of Your SSD Array , 2013, HotStorage.

[3]  Alexander S. Szalay,et al.  FlashGraph: Processing Billion-Node Graphs on an Array of Commodity SSDs , 2014, FAST.

[4]  Eui-Nam Huh,et al.  Software-Defined Storage Definition and Overview , 2016 .

[5]  Mahmut T. Kandemir,et al.  Sprinkler: Maximizing resource utilization in many-chip solid state disks , 2014, 2014 IEEE 20th International Symposium on High Performance Computer Architecture (HPCA).

[6]  David Flynn,et al.  DFS: A file system for virtualized flash storage , 2010, TOS.

[7]  Nicholas J. Wright,et al.  Performance analysis of commodity and enterprise class flash devices , 2010, 2010 5th Petascale Data Storage Workshop (PDSW '10).

[8]  John Shalf,et al.  Exploring the future of out-of-core computing with compute-local non-volatile memory , 2014, Sci. Program..

[9]  Myoungsoo Jung,et al.  Power, Energy, and Thermal Considerations in SSD-Based I/O Acceleration , 2014, HotStorage.

[10]  John Shalf,et al.  Triple-A: a Non-SSD based autonomic all-flash array for high performance storage systems , 2014, ASPLOS.

[11]  Yong Wang,et al.  SDF: software-defined flash for web-scale internet storage systems , 2014, ASPLOS.

[12]  Zale Schoenborn Board Design Guidelines for PCI Express™ Architecture Board Design Guidelines for PCI Express™ Architecture , 2004 .

[13]  Steven Swanson,et al.  The bleak future of NAND flash memory , 2012, FAST.

[14]  Antony I. T. Rowstron,et al.  Write off-loading: Practical power management for enterprise storage , 2008, TOS.

[15]  James O'Reilly Software-Defined Storage , 2017 .