A Design and Implementation of Global Distributed POSIX File System on the Top of Multiple Independent Cloud Services

We propose an extension of distcloud-fs for achieving a global distributed POSIX file system in intercloud environment. The file system works in intercloud environment, that is, on the top of multiple independent cloud services. The important capability of the intercloud extension is that there is no need for users to take care of infrastructure layer, while the file system stores data into multiple cloud services, transparently and automatically. As the result, cloud users may have diversity about vendors and locations for data platform, as discussed in various intercloud research projects. In this paper, we describe the architecture of the distcloud-fs and its intercloud extension. We also describe design and implementation of the prototype and discuss some typical use cases of the file system with practical demonstrations.

[1]  Anja Feldmann,et al.  Live wide-area migration of virtual machines including local persistent state , 2007, VEE '07.

[2]  Rajkumar Buyya,et al.  Inter‐Cloud architectures and application brokering: taxonomy and survey , 2014, Softw. Pract. Exp..

[3]  Rich Salz,et al.  A Universally Unique IDentifier (UUID) URN Namespace , 2005, RFC.

[4]  Tomohiro Kudoh,et al.  A WAN-Optimized Live Storage Migration Mechanism toward Virtual Machine Evacuation upon Severe Disasters , 2013, IEICE Trans. Inf. Syst..

[5]  Mike Murphy,et al.  The Efficacy of Live Virtual Machine Migrations Over the Internet , 2007, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing (VTDC '07).

[6]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[7]  Ian J. Taylor,et al.  Attic: A Case Study for Distributing Data in BOINC Projects , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[8]  Prashant J. Shenoy,et al.  CloudNet: dynamic pooling of cloud resources by live WAN migration of virtual machines , 2011, VEE.

[9]  Hiroshi Esaki,et al.  Dripcast - Architecture and Implementation of Server-less Java Programming Framework for Billions of IoT Devices , 2015, J. Inf. Process..

[10]  Jussi Kangasharju,et al.  Measuring large-scale distributed systems: case of BitTorrent Mainline DHT , 2013, IEEE P2P 2013 Proceedings.

[11]  Kohei Ichikawa,et al.  Transpacific Live Migration with Wide Area Distributed Storage , 2014, 2014 IEEE 38th Annual Computer Software and Applications Conference.

[12]  Hiroshi Esaki,et al.  Design and Implementation of Global Reference and Indirect Method Invocation Mechanisms in the Dripcast , 2016, 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC).

[13]  Eui-nam Huh,et al.  Inter-cloud Media Storage and Media Cloud Architecture for Inter-cloud Communication , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[14]  Ian Kelley A distributed architecture for intra- and inter-cloud data management , 2014, ScienceCloud '14.