Enhancing the Performance of Metadata Service for Cloud Computing

Efficient metadata management is critical for distributed file system in cloud computing. In this paper we propose a new metadata management scheme which employs master metadata server (MMDS) and metadata look-up table server between the metadata servers and clients. The MMDS checks the state of MDSs for load-balancing, and thereby avoids hot spot. The proposed scheme significantly reduces the network traffic as well.

[1]  Scott A. Brandt,et al.  Dynamic Metadata Management for Petabyte-Scale File Systems , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[2]  Robert B. Ross,et al.  PVFS: A Parallel File System for Linux Clusters , 2000, Annual Linux Showcase & Conference.

[3]  E. L. Miller,et al.  Efficient Metadata Management in Large Distributed File Systems , .

[4]  Hong Jiang,et al.  CEFT: A cost-effective, fault-tolerant parallel virtual file system , 2006, J. Parallel Distributed Comput..

[5]  Scott A. Brandt,et al.  Efficient metadata management in large distributed storage systems , 2003, 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings..

[6]  Andrew Warfield,et al.  Xen and the art of virtualization , 2003, SOSP '03.

[7]  Tao Yang,et al.  An Efficient Data Location Protocol for Self.organizing Storage Clusters , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[8]  Hong Jiang,et al.  Hierarchical Bloom filter arrays (HBA): a novel, scalable metadata management system for large cluster-based storage , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[9]  GhemawatSanjay,et al.  The Google file system , 2003 .