An autonomic resource provisioning approach for service-based cloud applications: A hybrid approach

Abstract In cloud computing environment, resources can be dynamically provisioned on deman for cloud services The amount of the resources to be provisioned is determined during runtime according to the workload changes. Deciding the right amount of resources required to run the cloud services is not trivial, and it depends on the current workload of the cloud services. Therefore, it is necessary to predict the future demands to automatically provision resources in order to deal with fluctuating demands of the cloud services. In this paper, we propose a hybrid resource provisioning approach for cloud services that is based on a combination of the concept of the autonomic computing and the reinforcement learning (RL). Also, we present a framework for autonomic resource provisioning which is inspired by the cloud layer model. Finally, we evaluate the effectiveness of our approach under two real world workload traces. The experimental results show that the proposed approach reduces the total cost by up to 50%, and increases the resource utilization by up to 12% compared with the other approaches.

[1]  Md. Abu Naser Bikas,et al.  How Elasticity Property Plays an Important Role in the Cloud: A Survey , 2016, Adv. Comput..

[2]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[3]  Abbie Barbir,et al.  Comparative Analysis of SOA and Cloud Computing Architectures Using Fact Based Modeling , 2013, OTM Workshops.

[4]  Hassan Haghighi,et al.  An adaptive RL based approach for dynamic resource provisioning in Cloud virtualized data centers , 2015, Computing.

[5]  Mahmoud Al-Ayyoub,et al.  Multi-agent based dynamic resource provisioning and monitoring for cloud computing systems infrastructure , 2015, Cluster Computing.

[6]  P. Venkata Krishna,et al.  Learning Automata-Based QoS Framework for Cloud IaaS , 2014, IEEE Transactions on Network and Service Management.

[7]  Cheng-Zhong Xu,et al.  URL: A unified reinforcement learning approach for autonomic cloud management , 2012, J. Parallel Distributed Comput..

[8]  Rajkumar Rajavel,et al.  Adaptive Probabilistic Behavioural Learning System for the effective behavioural decision in cloud trading negotiation market , 2016, Future Gener. Comput. Syst..

[9]  Bo Cheng,et al.  A cost-aware auto-scaling approach using the workload prediction in service clouds , 2014, Inf. Syst. Frontiers.

[10]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[11]  Aniruddha S. Gokhale,et al.  Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[12]  Rajkumar Buyya,et al.  Dynamic resource demand prediction and allocation in multi‐tenant service clouds , 2016, Concurr. Comput. Pract. Exp..

[13]  Siegfried Benkner,et al.  Design of an Adaptive Framework for Utility-Based Optimization of Scientific Applications in the Cloud , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.

[14]  Paulo F. Pires,et al.  Energy‐efficient task allocation with quality of service provisioning for concurrent applications in multi‐functional wireless sensor network systems , 2014, Concurr. Comput. Pract. Exp..

[15]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[16]  Eladio Sanz,et al.  Cloud Computing Integrated into Service-Oriented Multi-Agent Architecture , 2010, BASYS.

[17]  Inderveer Chana,et al.  Q-aware: Quality of service based cloud resource provisioning , 2015, Comput. Electr. Eng..

[18]  Yaoxue Zhang,et al.  Aggressive Resource Provisioning for Ensuring QoS in Virtualized Environments , 2015, IEEE Transactions on Cloud Computing.

[19]  Yong Woon Park,et al.  Simulation framework of ubiquitous network environments for designing diverse network robots , 2017, Future Gener. Comput. Syst..

[20]  Rajkumar Buyya,et al.  Mastering Cloud Computing: Foundations and Applications Programming , 2013 .

[21]  Enda Barrett,et al.  Applying reinforcement learning towards automating resource allocation and application scalability in the cloud , 2013, Concurr. Comput. Pract. Exp..

[22]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[23]  Ivona Brandic,et al.  Revealing the MAPE loop for the autonomic management of Cloud infrastructures , 2011, 2011 IEEE Symposium on Computers and Communications (ISCC).

[24]  Emanuel Ferreira Coutinho,et al.  Elasticity in cloud computing: a survey , 2014, annals of telecommunications - annales des télécommunications.

[25]  Emiliano Casalicchio,et al.  Mechanisms for SLA provisioning in cloud-based service providers , 2013, Comput. Networks.

[26]  Amir Hayat,et al.  Resource management in cloud computing: Taxonomy, prospects, and challenges , 2015, Comput. Electr. Eng..

[27]  Rizos Sakellariou,et al.  Adaptive resource configuration for Cloud infrastructure management , 2013, Future Gener. Comput. Syst..

[28]  Schahram Dustdar,et al.  Cloud resource provisioning and SLA enforcement via LoM2HiS framework , 2013, Concurr. Comput. Pract. Exp..

[29]  Samuel Kounev,et al.  Elasticity in Cloud Computing: What It Is, and What It Is Not , 2013, ICAC.

[30]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[31]  Mohammad Kazem Akbari,et al.  Dynamic Resource Provisioning in Cloud Computing: A Heuristic Markovian Approach , 2013, CloudComp.

[32]  José Antonio Lozano,et al.  A Review of Auto-scaling Techniques for Elastic Applications in Cloud Environments , 2014, Journal of Grid Computing.

[33]  K. Chandrasekaran,et al.  Essentials of Cloud Computing , 2014 .

[34]  Gábor Terstyánszky,et al.  Buttressing volatile desktop grids with cloud resources within a reconfigurable environment service for workflow orchestration , 2014, Journal of Cloud Computing.

[35]  Sunilkumar S. Manvi,et al.  Resource management for Infrastructure as a Service (IaaS) in cloud computing: A survey , 2014, J. Netw. Comput. Appl..

[36]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[37]  Xiaobo Zhou,et al.  Multi-tier service differentiation by coordinated learning-based resource provisioning and admission control , 2014, J. Parallel Distributed Comput..

[38]  Kok-Lim Alvin Yau,et al.  Reinforcement learning for context awareness and intelligence in wireless networks: Review, new features and open issues , 2012, J. Netw. Comput. Appl..

[39]  Julie A. McCann,et al.  A survey of autonomic computing—degrees, models, and applications , 2008, CSUR.

[40]  Pengcheng Zhang,et al.  A novel multi-agent reinforcement learning approach for job scheduling in Grid computing , 2011, Future Gener. Comput. Syst..

[41]  Marie-Pierre Gleizes,et al.  Principles and experimentations of self-organizing embedded agents allowing learning from demonstration in ambient robotics , 2016, Future Gener. Comput. Syst..

[42]  Maria Gradinariu Potop-Butucaru,et al.  ARMCO: Advanced topics in resource management for ubiquitous cloud computing: An adaptive approach , 2016, Future Gener. Comput. Syst..

[43]  Mike P. Papazoglou,et al.  Service oriented architectures: approaches, technologies and research issues , 2007, The VLDB Journal.

[44]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[45]  Bernhard Mitschang,et al.  Dynamic Provisioning of System Topologies in the Cloud , 2012, I-ESA.