GassyFS : An In-Memory File System That Embraces Volatility

For many years storage systems were designed for slow storage devices. However, the average speed of these devices has been growing exponentially, making traditional storage system designs increasingly inadequate. Sufficient time must be dedicated to redesigning future storage systems or they might never adequately support fast storage devices using traditional storage semantics. In this paper, we argue that storage systems should expose a persistence-performance trade-off to applications that are willing to explicitly take control over durability. We describe our prototype system called GassyFS that stores file system data in distributed remote memory and provides support for checkpointing file system state. As a consequence of this design, we explore a spectrum of mechanisms and policies for efficiently sharing data across file system boundaries.

[1]  Marshall Kirk McKusick Keynote Address: A Brief History of the {BSD} Fast Filesystem , 2015 .

[2]  Carlos Maltzahn,et al.  In-vivo Storage System Development , 2013, Euro-Par Workshops.

[3]  Roberto Ierusalimschy,et al.  Scriptable operating systems with Lua , 2015 .

[4]  Dhabaleswar K. Panda,et al.  pNFS/PVFS2 over InfiniBand: early experiences , 2007, PDSW '07.

[5]  Martin L. Kersten,et al.  Peak performance: remote memory revisited , 2013, DaMoN '13.

[6]  Peter Snyder,et al.  tmpfs: A Virtual Memory File System , 1990 .

[7]  Michael Dahlin,et al.  Cooperative caching: using remote client memory to improve file system performance , 1994, OSDI '94.

[8]  Carlos Maltzahn,et al.  Mantle: a programmable metadata load balancer for the ceph file system , 2015, SC15: International Conference for High Performance Computing, Networking, Storage and Analysis.

[9]  Golden G. Richard,et al.  dRamDisk: efficient RAM sharing on a commodity cluster , 2006, 2006 IEEE International Performance Computing and Communications Conference.

[10]  André Brinkmann,et al.  Towards Dynamic Scripted pNFS Layouts , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[11]  Alexandru Uta,et al.  Overcoming data locality: An in-memory runtime file system with symmetrical data distribution , 2016, Future Gener. Comput. Syst..

[12]  Evangelos P. Markatos,et al.  The Network RamDisk: Using remote memory on heterogeneous NOWs , 1999, Cluster Computing.