Performance analysis and framework optimization of open source cloud storage system

More and more embedded devices, such as mobile phones, tablet PCs and laptops, are used in every field, so huge files need to be stored or backed up into cloud storage. Optimizing the performance of cloud storage is very important for Internet development. This paper presents the performance evaluation of the open source distributed storage system, a highly available, distributed, eventually consistent object/blob store from OpenStack cloud computing components. This paper mainly focuses on the mechanism of cloud storage as well as the optimization methods to process different sized files. This work provides two major contributions through comprehensive performance evaluations. First, it provides different configurations for OpenStack Swift system and an analysis of how every component affects the performance. Second, it presents the detailed optimization methods to improve the performance in processing different sized files. The experimental results show that our method improves the performance and the structure. We give the methods to optimize the object-based cloud storage system to deploy the readily available storage system.

[1]  Shuigeng Zhou,et al.  A RAMCloud Storage System based on HDFS: Architecture, implementation and evaluation , 2013, J. Syst. Softw..

[2]  Ya Wang,et al.  Cloud Storage as the Infrastructure of Cloud Computing , 2010, 2010 International Conference on Intelligent Computing and Cognitive Informatics.

[3]  Hai Jin,et al.  Rethink the storage of virtual machine images in clouds , 2015, Future Gener. Comput. Syst..

[4]  Qinghua Zheng,et al.  An optimized approach for storing and accessing small files on cloud storage , 2012, J. Netw. Comput. Appl..

[5]  R. K. Saranya,et al.  Improving Accessing Efficiency of Cloud Storage Using De- Duplication and Feedback Schemes , 2015 .

[6]  Nader Mohamed,et al.  A Novel Approach for Dual-Direction Load Balancing and Storage Optimization in Cloud Services , 2014, 2014 IEEE 13th International Symposium on Network Computing and Applications.

[7]  Xiaojing Jia.  Google Cloud Computing Platform Technology Architecture and the Impact of Its Cost , 2010, 2010 Second World Congress on Software Engineering.

[8]  Felix Freitag,et al.  Cloud services in the Guifi.net community network , 2015, Comput. Networks.

[9]  E. Riedel,et al.  Object-based storage: pushing more functionality into storage , 2005, IEEE Potentials.

[10]  Philippe Olivier Alexandre Navaux,et al.  High Performance Computing in the cloud: Deployment, performance and cost efficiency , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[11]  Tao Wang,et al.  An Effective Strategy for Improving Small File Problem in Distributed File System , 2015, 2015 2nd International Conference on Information Science and Control Engineering.

[12]  Vijay Varadharajan,et al.  Trust Enhanced Cryptographic Role-Based Access Control for Secure Cloud Data Storage , 2015, IEEE Transactions on Information Forensics and Security.

[13]  Hong Jiang,et al.  POD: Performance Oriented I/O Deduplication for Primary Storage Systems in the Cloud , 2014, 2014 IEEE 28th International Parallel and Distributed Processing Symposium.

[14]  Wang Weihong,et al.  Secure big data storage and sharing scheme for cloud tenants , 2015, China Communications.

[15]  Juebo Wu,et al.  Research and Application of Cloud Storage , 2010, 2010 2nd International Workshop on Intelligent Systems and Applications.

[16]  Hua Wang,et al.  An Empirical Study on the Interplay between Filesystems and SSD , 2012, 2012 IEEE Seventh International Conference on Networking, Architecture, and Storage.

[17]  Pietro Michiardi,et al.  IOStack: Software-Defined Object Storage , 2016, IEEE Internet Computing.

[18]  Aiko Pras,et al.  Inside dropbox: understanding personal cloud storage services , 2012, Internet Measurement Conference.

[19]  Sun Weidong,et al.  Tree-structured parallel regeneration for multiple data losses in distributed storage systems based on erasure codes , 2013, China Communications.

[20]  Kenli Li,et al.  Performance Optimization for Managing Massive Numbers of Small Files in Distributed File Systems , 2015, IEEE Transactions on Parallel and Distributed Systems.

[21]  Keqin Li,et al.  Systematic Data Placement Optimization in Multi-Cloud Storage for Complex Requirements , 2016, IEEE Transactions on Computers.

[22]  Rajkumar Buyya,et al.  Brokering Algorithms for Optimizing the Availability and Cost of Cloud Storage Services , 2013, 2013 IEEE 5th International Conference on Cloud Computing Technology and Science.

[23]  Remzi Seker,et al.  Big Data and virtualization for manufacturing cyber-physical systems: A survey of the current status and future outlook , 2016, Comput. Ind..

[24]  Ju Wang,et al.  Windows Azure Storage: a highly available cloud storage service with strong consistency , 2011, SOSP.

[25]  John A. Chandy,et al.  An object interface storage node for clustered file systems , 2013, 2013 IEEE International Conference on Cluster Computing (CLUSTER).

[26]  Samuel Kounev,et al.  Automated Modeling of I/O Performance and Interference Effects in Virtualized Storage Systems , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[27]  Geoffrey C. Fox,et al.  Building a Distributed Block Storage System for Cloud Infrastructure , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[28]  Putchong Uthayopas,et al.  Enhancing Cloud Object Storage Performance Using Dynamic Replication Approach , 2012, 2012 IEEE 18th International Conference on Parallel and Distributed Systems.

[29]  Victor I. Chang,et al.  A model to compare cloud and non-cloud storage of Big Data , 2016, Future Gener. Comput. Syst..

[30]  Sangjin Lee,et al.  Forensic investigation framework for the document store NoSQL DBMS: MongoDB as a case study , 2016, Digit. Investig..

[31]  Wenying Zeng,et al.  Research on cloud storage architecture and key technologies , 2009, ICIS.