Understanding Rack-Scale Disaggregated Storage

Disaggregation of resources in the data center, especially at the rack-scale, offers the opportunity to use valuable resources more efficiently. It is common that mass storage racks in large-scale clouds are filled with servers with Hard Disk Drives (HDDs) attached directly to each of them, either using SATA or SAS depending on the number of HDDs. What does disaggregated storage mean for these racks? We define four categories of in-rack disaggregation: complete, dynamic elastic, failure, and configuration disaggregation. We explore the benefits and impact of these design points by building a highly flexible research storage fabric, that allows us to build example systems that embody the four designs.

[1]  Babak Falsafi,et al.  Scale-out NUMA , 2014, ASPLOS.

[2]  Rao Pramod Subba,et al.  Is memory disaggregation feasible? A case study with Spark SQL , 2016, Symposium on Architectures for Networking and Communications Systems.

[3]  Robert Cypher,et al.  Disks for Data Centers , 2016 .

[4]  Victor I. Chang,et al.  Disaggregated Architecture for at Scale Computing , 2015, ESaaSA@CLOSER.

[5]  Thomas F. Wenisch,et al.  Disaggregated memory for expansion and sharing in blade servers , 2009, ISCA '09.

[6]  Ju Wang,et al.  Windows Azure Storage: a highly available cloud storage service with strong consistency , 2011, SOSP.

[7]  Antony I. T. Rowstron,et al.  Feeding the Pelican: Using Archival Hard Drives for Cold Storage Racks , 2016, HotStorage.

[8]  Scott Shenker,et al.  Network Requirements for Resource Disaggregation , 2016, OSDI.

[9]  Scott Shenker,et al.  Network support for resource disaggregation in next-generation datacenters , 2013, HotNets.

[10]  Antony I. T. Rowstron,et al.  Pelican: A Building Block for Exascale Cold Data Storage , 2014, OSDI.

[11]  Jichuan Chang,et al.  Disaggregated Memory Benefits for Server Consolidation , 2011 .

[12]  Thomas F. Wenisch,et al.  System-level implications of disaggregated memory , 2012, IEEE International Symposium on High-Performance Comp Architecture.

[13]  Cheng Huang,et al.  Erasure Coding in Windows Azure Storage , 2012, USENIX Annual Technical Conference.

[14]  Christoforos E. Kozyrakis,et al.  Flash storage disaggregation , 2016, EuroSys.