Peak performance: remote memory revisited

Many database systems share a need for large amounts of fast storage. However, economies of scale limit the utility of extending a single machine with an arbitrary amount of memory. The recent broad availability of the zero-copy data transfer protocol RDMA over low-latency and high-throughput network connections such as InfiniBand prompts us to revisit the long-proposed usage of memory provided by remote machines. In this paper, we present a solution to make use of remote memory without manipulation of the operating system, and investigate the impact on database performance.

[1]  Pavan Balaji,et al.  Sockets vs. RDMA Interface over 10-Gigabit Networks: An In-depth Analysis of the Memory Traffic Bottleneck , 2004 .

[2]  Martin L. Kersten,et al.  Generic Database Cost Models for Hierarchical Memory Systems , 2002, VLDB.

[3]  Hemal Shah,et al.  Internet Small Computer System Interface (iSCSI) Extensions for Remote Direct Memory Access (RDMA) , 2007, RFC.

[4]  Dhabaleswar K. Panda,et al.  High-Performance Design of HBase with RDMA over InfiniBand , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium.

[5]  Evangelos P. Markatos,et al.  The Network RamDisk: Using remote memory on heterogeneous NOWs , 1999, Cluster Computing.

[6]  Jens Teubner,et al.  A Spinning Join That Does Not Get Dizzy , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[7]  D.K. Panda,et al.  Enhancing the Performance of NFSv4 with RDMA , 2007, Fourth International Workshop on Storage Network Architecture and Parallel I/Os (SNAPI 2007).

[8]  Renato Recio,et al.  A Remote Direct Memory Access Protocol Specification , 2007, RFC.

[9]  Parag Agrawal,et al.  The case for RAMClouds: scalable high-performance storage entirely in DRAM , 2010, OPSR.

[10]  Sotiris Ioannidis,et al.  On Using Network Memory to Improve the Performance of Transaction-Based Systems , 1998 .

[11]  Patrick Valduriez,et al.  Distributed database systems: where are we now? , 1991, Computer.

[12]  Dhabaleswar K. Panda,et al.  High performance RDMA-based design of HDFS over InfiniBand , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[13]  Ariel Cohen.  A performance analysis of 4X InfiniBand data transfer operations , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[14]  Dhabaleswar K. Panda,et al.  pNFS/PVFS2 over InfiniBand: early experiences , 2007, PDSW '07.