Data Consistency for Self-acting Load Balancing of Parallel File System

With the increasing scale of I/O servers, nice load balancing algorithm among I/O servers is becoming more and more important in parallel file systems. However, seldom systems have focused their attentions on the imbalance between I/O servers. In order to address this problem, we have proposed a self-acting load balancing strategy. In this paper, data consistency between I/O servers is mainly discussed. A method called re-migration is adopted to reduce the concurrent data-access impact on the self-acting load balancing strategy. According to some experiments, this method is proved to be able to reduce the average response time and improve performance of parallel I/O obviously. Besides, it also improves the flexibility of systems.

[1]  Robert B. Ross,et al.  PVFS: A Parallel File System for Linux Clusters , 2000, Annual Linux Showcase & Conference.

[2]  Limin Xiao,et al.  Self-Acting Load Balancing with Parallel Sub File Migration for Parallel File System , 2010, 2010 Third International Joint Conference on Computational Science and Optimization.

[3]  Julian M. Kunkel Towards Automatic Load Balancing of a Parallel File System with Subfile Based Migration , 2007 .

[4]  Anthony P. Reeves,et al.  Strategies for Dynamic Load Balancing on Highly Parallel Computers , 1993, IEEE Trans. Parallel Distributed Syst..

[5]  Frédéric Cuppens,et al.  Analyzing consistency of security policies , 1997, Proceedings. 1997 IEEE Symposium on Security and Privacy (Cat. No.97CB36097).

[6]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[7]  Ye-Sho Chen,et al.  Theoretical foundation of the 80/20 rule , 1993, Scientometrics.

[8]  Vipin Kumar,et al.  Scalable Load Balancing Techniques for Parallel Computers , 1994, J. Parallel Distributed Comput..

[9]  James P. Titus,et al.  Security and Privacy , 1967, 2022 IEEE Future Networks World Forum (FNWF).