A Cooperative Multi Agent Learning Approach to Manage Physical Host Nodes for Dynamic Consolidation of Virtual Machines

One of the most important challenges in a virtualized cloud data center is to optimize the energy-performance tradeoff, i.e., finding the right balance between saving energy and attaining best possible performance.Distributed dynamic virtual machine (VM) consolidation (DDVMC) is a virtual machine management strategy that uses a distributed rather than a centralized algorithm for finding such optimums, here also aiming at increasing scalability by avoiding a central bottleneck.The general goal of DDVMC in data centers is to (1) manage physical host nodes in order to avoid overloading and underloading, and (2) to optimize the placement of VMs.However, the optimality of this strategy is highly dependent on the quality of the decision-making process. In this paper we concentrate on managing physical host nodes in DDVMC strategy and propose a cooperative multi-agent learning paradigm to make optimal decisions towards energy and performance efficiency in cloud data centers. Our approach is also able to assure scalability due to increasing the number of hosts in the data center. The experimental results show that our approach yields far better results w.r.t. the energy-performance tradeoff in cloud data centers in comparison to state-of-the-art algorithms.

[1]  Kourosh Meshgi,et al.  FQL‐RED: an adaptive scalable schema for active queue management , 2010, Int. J. Netw. Manag..

[2]  Raquel Barco,et al.  Optimization of load balancing using fuzzy Q-Learning for next generation wireless networks , 2013, Expert Syst. Appl..

[3]  Helmut Hlavacs,et al.  An Intelligent and Adaptive Threshold-Based Schema for Energy and Performance Efficient Dynamic VM Consolidation , 2013, EE-LSDS.

[4]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[5]  Zwi Altman,et al.  A cooperative Reinforcement Learning approach for Inter-Cell Interference Coordination in OFDMA cellular networks , 2010, 8th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks.

[6]  Helmut Hlavacs,et al.  Integrating VM selection criteria in distributed dynamic VM consolidation using Fuzzy Q-Learning , 2013, Proceedings of the 9th International Conference on Network and Service Management (CNSM 2013).

[7]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[8]  Helmut Hlavacs,et al.  Genetic algorithms for energy efficient virtualized data centers , 2012, 2012 8th international conference on network and service management (cnsm) and 2012 workshop on systems virtualiztion management (svm).

[9]  Christine Morin,et al.  Energy-Aware Ant Colony Based Workload Placement in Clouds , 2011, 2011 IEEE/ACM 12th International Conference on Grid Computing.

[10]  Pierre Yves Glorennec,et al.  Reinforcement Learning: an Overview , 2000 .

[11]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Jianhua Gu,et al.  A New Resource Scheduling Strategy Based on Genetic Algorithm in Cloud Computing Environment , 2012, J. Comput..

[14]  Yantao Tian,et al.  Cooperative Q Learning Based on Blackboard Architecture , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[15]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[16]  KyoungSoo Park,et al.  CoMon: a mostly-scalable monitoring system for PlanetLab , 2006, OPSR.

[17]  Rajkumar Buyya,et al.  Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation , 2009, CloudCom.