An Adaptive Resource Provisioning Method Using Job History Learning Technique in Hybrid Infrastructure

Cloud computing technology enables scientists to dynamically expand their environments for scientific experiments. However, to maximize performance and satisfy user requirements it is difficult to quickly provide hybrid resources suitable to application characteristics. In this paper, we design a resource provisioning model based on application characteristic profiles and job history analysis in hybrid computing infrastructure consisting of cluster and cloud environments. In addition to the multi-layer perceptron machine learning method, error backpropagation technique is used to analyze job history to re-learn the error of the output value. Also, we propose an adaptive resource provisioning method for horizontal/vertical scaling of VMs in accordance with the state of the system. We experiment CPU-intensive applications according to the proposed model and algorithms, in a hybrid infrastructure. The experimental results show that using the proposed method, we satisfy user-specified SLA (cost and execution time) and improve the efficiency of resource usage.

[1]  Abul Bashar,et al.  Autonomic scaling of Cloud Computing resources using BN-based prediction models , 2013, 2013 IEEE 2nd International Conference on Cloud Networking (CloudNet).

[2]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[3]  Soonwook Hwang,et al.  A Job Dispatch Optimization Method on Cluster and Cloud for Large-Scale High-Throughput Computing Service , 2015, 2015 International Conference on Cloud and Autonomic Computing.

[4]  Brandon M. Malone,et al.  A Learning-based Selection for Portfolio Scheduling of Scientific Applications on Heterogeneous Computing Systems , 2014, CloudCom 2014.

[5]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[6]  Calvin J. Ribbens,et al.  Hybrid Computing - Where HPC meets grid and Cloud Computing , 2011, Future Gener. Comput. Syst..

[7]  Yong Zhao,et al.  Many-task computing for grids and supercomputers , 2008, 2008 Workshop on Many-Task Computing on Grids and Supercomputers.

[8]  Jae-Kwon Kim,et al.  Fuzzy Logic-driven Virtual Machine Resource Evaluation Method for Cloud Provisioning Service , 2013 .

[9]  Gilles Fedak,et al.  Multi-criteria and satisfaction oriented scheduling for hybrid distributed computing infrastructures , 2016, Future Gener. Comput. Syst..

[10]  Peter Skands,et al.  A brief introduction to PYTHIA 8.1 , 2007, Comput. Phys. Commun..

[11]  Soonwook Hwang,et al.  Abstract: HTCaaS: A Large-Scale High-Throughput Computing by Leveraging Grids, Supercomputers and Cloud , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[12]  Chung-Horng Lung,et al.  Cloud Resource Auto-scaling System Based on Hidden Markov Model (HMM) , 2014, 2014 IEEE International Conference on Semantic Computing.

[13]  Kun Wang,et al.  A Distributed Self-Learning Approach for Elastic Provisioning of Virtualized Cloud Resources , 2011, 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems.

[14]  S. Mrenna,et al.  Pythia 6.3 physics and manual , 2003, hep-ph/0308153.