Self-Adaptive Capacity Controller: A Reinforcement Learning Approach

Interference between co-located VMs may lead to performance fluctuations and degradation. To limit this problem, VMs access to physical resources needs to be controlled to ensure certain degree of isolation among them. This mapping between virtual and physical resources must be performed in a dynamic way so that it can be adaptive to the changing applications requirements, as well as to the different set of co-located VMs. To address this problem we propose a self-adaptive fuzzy Q-learning capacity controller that proactively readjusts the isolation degree based on applications performance. Our evaluation demonstrates a reduction into VMs interference and an increment on the overall utilization, while still ensuring critical applications performance, and providing more resources to non-critical applications.

[1]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[2]  Johan Tordsson,et al.  The Straw that Broke the Camel's Back: Safe Cloud Overbooking with Application Brownout , 2014, 2014 International Conference on Cloud and Autonomic Computing.

[3]  Johan Tordsson,et al.  Cloud Service Differentiation in Overbooked Data Centers , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[4]  Johan Tordsson,et al.  Reducing Noisy-Neighbor Impact with a Fuzzy Affinity-Aware Scheduler , 2015, 2015 International Conference on Cloud and Autonomic Computing.

[5]  Rachel Householder,et al.  On Cloud-based Oversubscription , 2014, ArXiv.

[6]  김재현,et al.  Fuzzy-Q learning , 1996 .