Improving reliability and reducing cost of task execution on preemptible VM instances using machine learning approach

Cloud users can acquire resources in the form of virtual machines (VMs) instances for computing. These instances can be on-demand, reserved and spot instances. Spot-priced virtual machines are offered at the reduced cost compared to on-demand and reserved but are unreliable to use as their availability depends on user’s bid. To use spot instances (preemptible VMs), users have to bid for resources and trade-off between monetary cost and reliability as reliability increases with the increase in cost of execution. The cost of execution can be reduced significantly with the use of preemptible VM instances. These instances are only available until users bid higher in comparison with spot price that is fixed by the cloud providers. Hence, it becomes a critical challenge to minimize the associated cost and increases the reliability for a given deadline. In this article, an algorithm has been designed for predicting the spot price to facilitate the users in bidding. Further, a checkpointing algorithm has been proposed for saving the task’s progress at optimal time intervals by the use of the proposed spot price prediction algorithm. The proposed algorithms in the article emphasize the use of preprocessed data for prediction of prices in short intervals. The prediction algorithm is based on machine learning techniques. It predicts the price and provides a comprehensive comparison for prediction of the prices for long term (12 h) as well as short term (10 min). For predicting the long-term and short-term prices, different machine learning techniques have been used on the basis of least error in prediction. The best suitable machine learning algorithm with least error is selected for prediction as well as checkpointing. Using these algorithms, one can improve reliability and reduce cost of computing on preemptible VM instances significantly. To the best of our knowledge, this is the first attempt of its kind in this field.

[1]  Daeyong Jung,et al.  An Efficient Checkpointing Scheme Using Price History of Spot Instances in Cloud Computing Environment , 2011, NPC.

[2]  Shafii Muhammad Abdulhamid,et al.  Fault tolerance aware scheduling technique for cloud computing environment using dynamic clustering algorithm , 2016, Neural Computing and Applications.

[3]  Kishan Bhushan Sahay,et al.  An analysis of short-term price forecasting of power market by using ANN , 2014 .

[4]  Ghalem Belalem,et al.  Optimization of checkpointing/recovery strategy in cloud computing with adaptive storage management , 2018, Concurr. Comput. Pract. Exp..

[5]  Hossein Deldari,et al.  An online valuation-based sealed winner-bid auction game for resource allocation and pricing in clouds , 2017, The Journal of Supercomputing.

[6]  Shaojie Tang,et al.  A Framework for Amazon EC2 Bidding Strategy under SLA Constraints , 2014, IEEE Transactions on Parallel and Distributed Systems.

[7]  Kaushik Dutta,et al.  Dynamic Price Prediction for Amazon Spot Instances , 2015, 2015 48th Hawaii International Conference on System Sciences.

[8]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[9]  Ryszard Kowalczyk,et al.  Towards Efficient and Truthful Market Mechanisms for Double-Sided Cloud Markets , 2017, IEEE Transactions on Services Computing.

[10]  G. Ram Mohana Reddy,et al.  An efficient cost optimized scheduling for spot instances in heterogeneous cloud environment , 2018, Future Gener. Comput. Syst..

[11]  Artur Andrzejak,et al.  Reducing Costs of Spot Instances via Checkpointing in the Amazon Elastic Compute Cloud , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[12]  Volodymyr Turchenko,et al.  SPOT PRICE PREDICTION FOR CLOUD COMPUTINGUSING NEURAL NETWORKS , 2014 .

[13]  Tugrul U. Daim,et al.  Using artificial neural network models in stock market index prediction , 2011, Expert Syst. Appl..

[14]  Shafii Muhammad Abdulhamid,et al.  A checkpointed league championship algorithm-based cloud scheduling scheme with secure fault tolerance responsiveness , 2017, Appl. Soft Comput..

[15]  Sowmya Karunakaran,et al.  Bidding Strategies for Spot Instances in Cloud Computing Markets , 2015, IEEE Internet Computing.

[16]  Volodymyr Turchenko,et al.  Applications of neural-based spot market prediction for cloud computing , 2013, 2013 IEEE 7th International Conference on Intelligent Data Acquisition and Advanced Computing Systems (IDAACS).

[17]  Muli Ben-Yehuda,et al.  Deconstructing Amazon EC2 Spot Instance Pricing , 2011, CloudCom.

[18]  Ashish Kumar Mishra,et al.  A survey on optimal utilization of preemptible VM instances in cloud computing , 2018, The Journal of Supercomputing.

[19]  Major Singh Goraya,et al.  Fault tolerance in cloud computing environment: A systematic survey , 2018, Comput. Ind..

[20]  Kyungyong Lee,et al.  Time-Series Analysis for Price Prediction of Opportunistic Cloud Computing Resources , 2018 .

[21]  Nandini Mukherjee,et al.  A Novel Checkpointing Scheme for Amazon EC2 Spot Instances , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.