Development of Intelligent Network Storage System with Adaptive Decision-Making

An enormous amount of digitization of content has led to extreme demands on storage systems. Multitier storage systems built with parallel distributed file-system enhance their scalability and I/O performance, while achieving cost-effectiveness in handling large data. However, these storage systems are not flexible enough to adapt to the complexity and dynamic environment of data. Designing a storage system to be more intelligent is a proven technique to overcome the challenges of managing complex data in a dynamic environment and hence, this paper proposes an Intelligent Network Storage System (INSS) with adaptive decision-making capability. An intelligent agent is introduced for autotiering and it can dynamically decide which storage tier data can be relocated based on their recent access patterns. The intelligent agent’s design and implementation were inspired by the human brain and consequently, the functions from each of brain’s five core regions were developed in INSS prototype. The intelligent agent utilizes Reinforcement Learning (RL) which guides the system itself to learn the optimal policies in relocating data. The prototype was built on a test bed with Lustre: A SAN file system for Linux with one metadata server and 3 storage nodes. With its adaptive and real-time decisionmaking capability, the policies optimized by RL were evaluated and the analysis has shown to achieve a high degree of accuracy with no performance penalty.

[1]  Anna Bernasconi,et al.  Introduction to Storage Area Networks , 2003 .

[2]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[3]  Ali Selamat,et al.  Multi-agent reinforcement learning for route guidance system , 2011 .

[4]  Gong Zhang,et al.  Automated lookahead data migration in SSD-enabled multi-tiered storage systems , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[5]  Li Xiaofeng,et al.  Learning and decision making in human during a game of matching pennies , 2009, 2009 ISECS International Colloquium on Computing, Communication, Control, and Management.

[6]  David Vengerov,et al.  A reinforcement learning framework for online data migration in hierarchical storage systems , 2007, The Journal of Supercomputing.

[7]  Himabindu Pucha,et al.  Cost Effective Storage using Extent Based Dynamic Tiering , 2011, FAST.

[8]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[9]  Alex M. Andrew,et al.  Reinforcement Learning: : An Introduction , 1998 .

[10]  Yun Mayya,et al.  Negotiation and persuasion approach using reinforcement learning technique on broker's board agent system , 2011, The 7th International Conference on Networked Computing and Advanced Information Management.

[11]  Ah-Hwee Tan,et al.  Direct Code Access in Self-Organizing Neural Networks for Reinforcement Learning , 2007, IJCAI.

[12]  Enrico Schiattarella.  Introduction to Storage Area Networks , 2002 .

[13]  Xiaofeng Li,et al.  Learning and Decision Making in Human During a Game of Matching Pennies , 2010, J. Digit. Content Technol. its Appl..

[14]  S.H.G. ten Hagen,et al.  A short introduction to reinforcement learning , 1997 .

[15]  Gee Wah Ng,et al.  A Cognitive Architecture for Knowledge Exploitation , 2010, AGI 2010.