Dynamic File Allocation in Storage Area Networks with Neural Network Prediction

Disk arrays are widely used in Storage Area Networks (SANs) to achieve mass storage capacity and high level I/O parallelism. Data partitioning and distribution among the disks is a promising approach to minimize the file access time and balance the I/O workload. But disk I/O parallelism by itself does not guarantee the optimal performance of an application. The disk access rates fluctuate with time because of access pattern variations, which leads to a workload imbalance. The user access pattern prediction is of great importance to dynamic data reorganization between hot and cool disks. Data migration occurs according to current and future disk allocation states and access frequencies. The objective of this paper is to develop a neural network based disk allocation trend prediction method and optimize the disks’ file capacity to their balanced level. A Levenberg-Marquardt neural network was adopted to predict the disk access frequencies with the I/O track. History. Data reorganization on disk arrays was optimized to provide a good workload balance. The simulation results proved that the proposed method performs well.

[1]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[2]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[3]  Stavros J. Perantonis,et al.  Two highly efficient second-order algorithms for training feedforward networks , 2002, IEEE Trans. Neural Networks.

[4]  Ming-Syan Chen,et al.  SIFA: a scalable file system with intelligent file allocation , 2002, Proceedings 26th Annual International Computer Software and Applications.

[5]  Gerhard Weikum,et al.  Dynamic file allocation in disk arrays , 1991, SIGMOD '91.

[6]  Henry E. Stanton Theory of cellular pulsations , 1943 .

[7]  Hector Garcia-Molina,et al.  Disk striping , 1986, 1986 IEEE Second International Conference on Data Engineering.

[8]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[9]  Bu-Sung Lee,et al.  File allocation with balanced response time in a distributed multi-server information system , 1998, Inf. Softw. Technol..

[10]  Yukihiro Toyoda,et al.  A parameter optimization method for radial basis function type models , 2003, IEEE Trans. Neural Networks.

[11]  Michelle Y. Kim,et al.  Synchronized Disk Interleaving , 1986, IEEE Transactions on Computers.