The Implementation of Supporting Uniform Data Distribution with Software-Dened Storage Service on Heterogeneous Cloud Storage

In order to improve accessibility and efficiency of a cloud system, this work proposed a mechanism to integrate Ceph, HDFS and Swift based on the OpenStack. We first build a heterogeneous storage environment including Ceph, HDFS and Swift based on the open source OpenStack and then measure their performances. To integrate storage services of Ceph, HDFS and Swift, we propose a proportion-based file distribution mechanism. The proportion for file partition is dependent on the remaining storage capacity so that we can distribute those sub files to different storage. This mechanism also enhances the file security. In addition, a high usability user interface is provided so as to make the proposed system more friendly. Experimental results show the efficiency of our system.

[1]  Mohsine Eleuldj,et al.  OpenStack: Toward an Open-source Solution for Cloud Computing , 2012 .

[2]  Chao-Tung Yang,et al.  Implementation of Software-Defined Storage Service with Heterogeneous Object Storage Technologies , 2015 .

[3]  Cong Wang,et al.  Privacy-Preserving Public Auditing for Data Storage Security in Cloud Computing , 2010, 2010 Proceedings IEEE INFOCOM.

[4]  Larry L. Peterson,et al.  Container-based operating system virtualization: a scalable, high-performance alternative to hypervisors , 2007, EuroSys '07.

[5]  Josef Spillner,et al.  Creating optimal cloud storage systems , 2013, Future Gener. Comput. Syst..

[6]  柏崎 礼生,et al.  大阪大学の仮想化基盤におけるSoftware Defined Storageの評価実験 , 2014, IOT 2014.

[7]  Jian Zhang,et al.  COSBench: cloud object storage benchmark , 2013, ICPE '13.

[8]  Chengzhang Peng,et al.  Building a Cloud Storage Service System , 2011 .

[9]  Antonio Pescapè,et al.  Integration of Cloud computing and Internet of Things: A survey , 2016, Future Gener. Comput. Syst..

[10]  Kuan-Ching Li,et al.  DAC: Improving storage availability with Deduplication-Assisted Cloud-of-Clouds , 2017, Future Gener. Comput. Syst..

[11]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[12]  Mark Ryan,et al.  Cloud computing security: The scientific challenge, and a survey of solutions , 2013, J. Syst. Softw..

[13]  Gil Neiger,et al.  Intel virtualization technology , 2005, Computer.

[14]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[15]  Subasish Mohapatra,et al.  Virtualization: A Survey on Concepts, Taxonomy and Associated Security Issues , 2010, 2010 Second International Conference on Computer and Network Technology.

[16]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[17]  Joe Arnold,et al.  OpenStack Swift: Using, Administering, and Developing for Swift Object Storage , 2014 .