Effective replica management for improving reliability and availability in edge-cloud computing environment

Abstract The multi-replica strategy can create multiple data replicas for the edge cloud system and store them in different DataNodes, which improves data availability and data service quality. However, the storage resources of DataNodes are limited and the user demand for data is time-varying, the unreasonable number of data replicas will cause a high storage burden on the file system or low data service quality. Therefore, the number of data replicas needs to be dynamically adjusted according to the actual situation. Based on this, a dynamic replica creation strategy based on the gray Markov chain is proposed. If the number of replicas needs to be increased, the newly added replicas need to be placed on the DataNodes. Considering the problem of load balancing of the DataNode during replica placement, this paper proposes a replica placement strategy based on the Fast Non-dominated Sorting Genetic algorithm. In addition, considering the problem of data replica synchronization and the data recovery of failed DataNodes in the edge cloud system, this paper proposes a delay-adaptive replica synchronization strategy and a load-balancing based replica recovery strategy. Finally, the experiments prove the effectiveness of the proposed strategies.

[1]  Huan Guo,et al.  The modeling mechanism, extension and optimization of grey GM (1, 1) model , 2014 .

[2]  Marc Sánchez Artigas,et al.  Vertigo: Programmable Micro-controllers for Software-Defined Object Storage , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[3]  Wu Xiuguo.  A security-aware data replica placement strategy based on fuzzy evaluation in the cloud , 2018 .

[4]  Yonggang Wen,et al.  Toward Cost-Efficient Content Placement in Media Cloud: Modeling and Analysis , 2016, IEEE Transactions on Multimedia.

[5]  Tolga Ovatman,et al.  A Decentralized Replica Placement Algorithm for Edge Computing , 2018, IEEE Transactions on Network and Service Management.

[6]  Suman Banerjee,et al.  A vehicle-based edge computing platform for transit and human mobility analytics , 2017, SEC.

[7]  Saeed Farokhi,et al.  New replica server placement strategies using clustering algorithms and SOM neural network in CDNs , 2017, Int. Arab J. Inf. Technol..

[8]  Antonio Pescapè,et al.  Integration of Cloud computing and Internet of Things: A survey , 2016, Future Gener. Comput. Syst..

[9]  Mohamed Faten Zhani,et al.  On achieving high data availability in heterogeneous cloud storage systems , 2017, 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[10]  Zhenlong Li,et al.  Big Data and cloud computing: innovation opportunities and challenges , 2017, Int. J. Digit. Earth.

[11]  Chuan Li,et al.  Enabling Campus Edge Computing Using GENI Racks and Mobile Resources , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[12]  Yan Zhang,et al.  Mobile Edge Computing: A Survey , 2018, IEEE Internet of Things Journal.

[13]  Pi-Chung Wang,et al.  An adaptable replication scheme in mobile online system for mobile-edge cloud computing , 2017, 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[14]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[15]  Wenbin Yao,et al.  DARS: A dynamic adaptive replica strategy under high load Cloud-P2P , 2018, Future Gener. Comput. Syst..

[16]  Madhuri Bhavsar,et al.  Efficient Resource Monitoring and Prediction Techniques in an IaaS Level of Cloud Computing: Survey , 2017 .

[17]  Rodrigo Roman,et al.  Mobile Edge Computing, Fog et al.: A Survey and Analysis of Security Threats and Challenges , 2016, Future Gener. Comput. Syst..

[18]  Veerabhadra Rao Chandakanna.  REHDFS: A random read/write enhanced HDFS , 2018, J. Netw. Comput. Appl..

[19]  Tarik Taleb,et al.  On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration , 2017, IEEE Communications Surveys & Tutorials.

[20]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[21]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[22]  Elizabeth Sherly,et al.  A Dynamic Replica Factor Calculator for Weighted Dynamic Replication Management in Cloud Storage Systems , 2018 .

[23]  Sarbjeet Singh,et al.  A dynamic, cost-aware, optimized data replication strategy for heterogeneous cloud data centers , 2016, Future Gener. Comput. Syst..

[24]  Ram G. Athreya,et al.  A Public Cloud Based SOA Workflow for Machine Learning Based Recommendation Algorithms , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[25]  Bin Zhang,et al.  A replicas placement approach of component services for service-based cloud application , 2016, Cluster Computing.

[26]  T. T. Mirnalinee,et al.  A novel dynamic data replication strategy to improve access efficiency of cloud storage , 2020, Inf. Syst. E Bus. Manag..

[27]  Charles J. Geyer,et al.  Practical Markov Chain Monte Carlo , 1992 .

[28]  Hassan Hajabdollahi,et al.  Multi-objective optimization of shell and tube heat exchangers , 2010 .

[29]  X. Xu,et al.  Data Replica Placement Mechanism for Open Heterogeneous Storage Systems , 2017, ANT/SEIT.

[30]  Lihui Liu,et al.  A group based genetic algorithm data replica placement strategy for scientific workflow , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).

[31]  D. S. Jayalakshmi,et al.  Dynamic Data Replication Strategy in Cloud Environments , 2015, 2015 Fifth International Conference on Advances in Computing and Communications (ICACC).

[32]  Ujjwal Kumar,et al.  Time series models (Grey-Markov, Grey Model with rolling mechanism and singular spectrum analysis) to forecast energy consumption in India , 2010 .

[33]  Andrei Palade,et al.  An Evaluation of Open Source Serverless Computing Frameworks Support at the Edge , 2019, 2019 IEEE World Congress on Services (SERVICES).