A new strategy based on approximate dynamic programming to maximize the net revenue of IaaS cloud providers with limited resources

Abstract With rapid development of cloud computing, more conventional Internet Data Centers get involved into this business model. Providers of small and medium sized data centers have relatively limited computing resources compared to global IaaS providers such as Amazon. The demand for computing at these service providers may be above the available capacity especially during peak shopping periods (e.g. mother’s day or singles’ day). However, it is undesirable to blindly expand capacity, which will not only incur the purchase cost of new machines but also the maintenance costs associated with resource over-provisioning. For these service providers, the most important thing is how to effectively manage resources during peak demand periods to maximize their net revenue. In this context, we focus on the joint admission control and virtual machine placement problem, and propose a dynamic optimization model considering that customers dynamically create and terminate virtual machines in cloud computing environment. In terms of problem complexity, the developed dynamic optimization model typically suffers from “curse of dimensionality” and is computationally intractable. So we resort to approximate dynamic programming framework and propose a new strategy to yield a tractable model for real-time decision-making. Extensive simulations are conducted to compare our proposed strategy with other strategies including existing methods of virtual machine placement. The simulation results demonstrate that our customized strategy achieves substantial revenue improvements and the improvement is more significant as resource provisioning is tighter. In addition, it can be scalable to solve large cases up to 1000 physical machines and yield a real-time decision in a reasonable time.

[1]  Jorge Ejarque,et al.  Dynamic energy-aware scheduling for parallel task-based application in cloud computing , 2018, Future Gener. Comput. Syst..

[2]  Enzo Baccarelli,et al.  Energy performance of heuristics and meta-heuristics for real-time joint resource scaling and consolidation in virtualized networked data centers , 2018, The Journal of Supercomputing.

[3]  Hassan Taheri,et al.  Novel fuzzy multi objective DVFS-aware consolidation heuristics for energy and SLA efficient resource management in cloud data centers , 2017, J. Netw. Comput. Appl..

[4]  Rajkumar Buyya,et al.  SLA-based virtual machine management for heterogeneous workloads in a cloud datacenter , 2014, J. Netw. Comput. Appl..

[5]  Eugenio Gianniti,et al.  An optimization framework for the capacity allocation and admission control of MapReduce jobs in cloud systems , 2018, The Journal of Supercomputing.

[6]  Warren B. Powell,et al.  An Approximate Dynamic Programming Algorithm for Large-Scale Fleet Management: A Case Application , 2009, Transp. Sci..

[7]  Guangjie Han,et al.  A Multiqueue Interlacing Peak Scheduling Method Based on Tasks’ Classification in Cloud Computing , 2018, IEEE Systems Journal.

[8]  Deo Prakash Vidyarthi,et al.  Admission control in cloud computing using game theory , 2015, The Journal of Supercomputing.

[9]  Daniel A. Menascé,et al.  Capacity planning for IaaS cloud providers offering multiple service classes , 2017, Future Gener. Comput. Syst..

[10]  Daniel A. Menascé,et al.  Prediction-Based Admission Control for IaaS Clouds with Multiple Service Classes , 2015, 2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom).

[11]  Javad Akbari Torkestani,et al.  A learning automata-based algorithm for energy and SLA efficient consolidation of virtual machines in cloud data centers , 2018, J. Parallel Distributed Comput..

[12]  Henri Casanova,et al.  Energy-aware service allocation , 2012, Future Gener. Comput. Syst..

[13]  Ankit Jain,et al.  Power and resource-aware virtual machine placement for IaaS cloud , 2018, Sustain. Comput. Informatics Syst..

[14]  Yurdaer N. Doganata,et al.  Configuring Cloud Admission Policies under Dynamic Demand , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[15]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[16]  Rajkumar Buyya,et al.  SLA-based admission control for a Software-as-a-Service provider in Cloud computing environments , 2012, J. Comput. Syst. Sci..

[17]  Mahammad Shareef Mekala,et al.  Energy-efficient virtual machine selection based on resource ranking and utilization factor approach in cloud computing for IoT , 2019, Comput. Electr. Eng..

[18]  Chen Liang,et al.  Novel Resource Allocation Model and Algorithms for Cloud Computing , 2013, 2013 Fourth International Conference on Emerging Intelligent Data and Web Technologies.

[19]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.

[20]  José Luis Vázquez-Poletti,et al.  SaaS enabled admission control for MCMC simulation in cloud computing infrastructures , 2017, Comput. Phys. Commun..

[21]  Hannu Tenhunen,et al.  Using Ant Colony System to Consolidate VMs for Green Cloud Computing , 2015, IEEE Transactions on Services Computing.

[22]  Keqin Li,et al.  Minimizing SLA violation and power consumption in Cloud data centers using adaptive energy-aware algorithms , 2017, Future Gener. Comput. Syst..

[23]  Ítalo S. Cunha,et al.  Joint admission control and resource allocation in virtualized servers , 2010, J. Parallel Distributed Comput..

[24]  Tao Chen,et al.  Improving Resource Utilization via Virtual Machine Placement in Data Center Networks , 2018, Mob. Networks Appl..

[25]  Massoud Pedram,et al.  Hierarchical Virtual Machine Consolidation in a Cloud Computing System , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[26]  Warren B. Powell,et al.  An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, I: Single Period Travel Times , 2002, Transp. Sci..

[27]  Verena Schmid,et al.  Solving the dynamic ambulance relocation and dispatching problem using approximate dynamic programming , 2012, Eur. J. Oper. Res..

[28]  Saeed Sharifian,et al.  A distributed load balancing and admission control algorithm based on Fuzzy type-2 and Game theory for large-scale SaaS cloud architectures , 2018, Future Gener. Comput. Syst..

[29]  Yurdaer N. Doganata,et al.  Cloud overbooking through stochastic admission controller , 2014, 10th International Conference on Network and Service Management (CNSM) and Workshop.

[30]  Liang Liu,et al.  A multi-objective ant colony system algorithm for virtual machine placement in cloud computing , 2013, J. Comput. Syst. Sci..

[31]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[32]  Asser N. Tantawi,et al.  Using approximate dynamic programming to optimize admission control in cloud computing environment , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[33]  Warren B. Powell,et al.  Minimizing total tardiness in a stochastic single machine scheduling problem using approximate dynamic programming , 2010, J. Sched..

[34]  Jie Wu,et al.  Energy efficient virtual machine placement algorithm with balanced and improved resource utilization in a data center , 2013, Math. Comput. Model..

[35]  Chita R. Das,et al.  Characterizing Network Traffic in a Cluster-based, Multi-tier Data Center , 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07).

[36]  Xiaomin Zhu,et al.  Towards energy-efficient scheduling for real-time tasks under uncertain cloud computing environment , 2015, J. Syst. Softw..

[37]  Liu Liu,et al.  Joint admission control and provisioning for virtual machines , 2015, 2015 IEEE International Conference on Communications (ICC).

[38]  Bernard Butler,et al.  Provisioning of requests for virtual machine sets with placement constraints in IaaS clouds , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[39]  Christoph Meinel,et al.  Energy efficient scheduling of HPC-jobs on virtualize clusters using host and VM dynamic configuration , 2012, OPSR.

[40]  David Breitgand,et al.  Improving consolidation of virtual machines with risk-aware bandwidth oversubscription in compute clouds , 2012, 2012 Proceedings IEEE INFOCOM.

[41]  Liang Liu,et al.  Energy efficient scheduling of virtual machines in cloud with deadline constraint , 2015, Future Gener. Comput. Syst..

[42]  Philip Samuel,et al.  Enhanced Bee Colony Algorithm for Efficient Load Balancing and Scheduling in Cloud , 2015, IBICA.

[43]  Qiushuang Chen,et al.  Dynamic Placement of Virtual Machines with Both Deterministic and Stochastic Demands for Green Cloud Computing , 2014 .

[44]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[45]  Tarachand Amgoth,et al.  Resource-aware virtual machine placement algorithm for IaaS cloud , 2017, The Journal of Supercomputing.

[46]  Haipeng Luo,et al.  Adaptive Resource Provisioning for the Cloud Using Online Bin Packing , 2014, IEEE Transactions on Computers.