Work-in-Progress: A Deep Learning Strategy for I/O Scheduling in Storage Systems

Under the big data era, there is a crucial need to improve the performance of storage systems for data-intensive applications. Data-intensive applications tend to behave in a predictable manner, which can be exploited for improving the performance of the storage system. At the storage level, we propose a deep recurrent neural network that learns the patterns of I/O requests and predicts the upcoming ones, such that memory contents can be pre-loaded at the right time to prevent cache/memory misses. Preliminary experimental results, on two real-world I/O logs of storage systems (from financial and web search), are reported-they partially demonstrate the effectiveness of the proposed method.

[1]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[2]  Yuanyuan Zhou,et al.  Association Proceedings of the Third USENIX Conference on File and Storage Technologies San Francisco , CA , USA March 31 – April 2 , 2004 , 2004 .

[3]  Xin Chen,et al.  I/O Characteristics Discovery in Cloud Storage Systems , 2018, 2018 IEEE 11th International Conference on Cloud Computing (CLOUD).

[4]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[5]  Dharmendra S. Modha,et al.  SARC: Sequential Prefetching in Adaptive Replacement Cache , 2005, USENIX Annual Technical Conference, General Track.

[6]  G.E. Moore,et al.  Cramming More Components Onto Integrated Circuits , 1998, Proceedings of the IEEE.

[7]  Xinlei Chen,et al.  Visualizing and Understanding Neural Models in NLP , 2015, NAACL.

[8]  Jiang Zhou,et al.  Vectorizing disks blocks for efficient storage system via deep learning , 2019, Parallel Comput..

[9]  Khuzaima Daudjee,et al.  EC-Store: Bridging the Gap between Storage and Latency in Distributed Erasure Coded Systems , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[10]  Jun Xu Block Trace Analysis and Storage System Optimization , 2018, Apress.

[11]  Gabriel H. Loh,et al.  3D-Stacked Memory Architectures for Multi-core Processors , 2008, 2008 International Symposium on Computer Architecture.

[12]  Christoforos E. Kozyrakis,et al.  Learning Memory Access Patterns , 2018, ICML.