Probabilistic provisioning and scheduling in uncertain Cloud environments

Resource provisioning and task scheduling in Cloud environments are quite challenging because of the fluctuating workload patterns and of the unpredictable behaviors and unstable performance of the infrastructure. It is therefore important to properly master the uncertainties associated with Cloud workloads and infrastructure. In this paper, we propose a probabilistic approach for resource provisioning and task scheduling that allows users to estimate in advance, i.e., offline, the resources to be provisioned, thus reducing the risk and the impact of overprovisioning or underprovisioning. In particular, we formulate an optimization problem whose objective is to identify scheduling plans that minimize the overall monetary cost for leasing Cloud resources subject to some workload constraints. This cost-aware model ensures that the execution time of an application does not exceed with a given probability a specified deadline, even in presence of uncertainties. To evaluate the behavior and sensitivity to uncertainties of the proposed approach, we simulate a simple batch workload consisting of MapReduce jobs. The experimental results show that, despite the provisioning and scheduling approaches that do not take into account the uncertainties in their decision process, our probabilistic approach nicely adapts to workload and Cloud uncertainties.

[1]  Rajkumar Buyya,et al.  SLA-Aware Provisioning and Scheduling of Cloud Resources for Big Data Analytics , 2014, 2014 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM).

[2]  Kyong Hoon Kim,et al.  Minimizing Cost of Virtual Machines for Deadline-Constrained MapReduce Applications in the Cloud , 2012, 2012 ACM/IEEE 13th International Conference on Grid Computing.

[3]  Matthias Kohl,et al.  General Purpose Convolution Algorithm in S4 Classes by Means of FFT , 2010, 1006.0764.

[4]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[5]  Dana Petcu,et al.  Workloads in the clouds , 2016 .

[6]  Jan Broeckhove,et al.  Cost-Optimal Scheduling in Hybrid IaaS Clouds for Deadline Constrained Workloads , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[7]  Bu-Sung Lee,et al.  Optimization of Resource Provisioning Cost in Cloud Computing , 2012, IEEE Transactions on Services Computing.

[8]  Jean G. Vaucher,et al.  SSJ: a framework for stochastic simulation in Java , 2002, Proceedings of the Winter Simulation Conference.

[9]  Qingbo Wu,et al.  Workflow scheduling in cloud: a survey , 2015, The Journal of Supercomputing.

[10]  Keke Chen,et al.  Towards Optimal Resource Provisioning for Running MapReduce Programs in Public Clouds , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[11]  Jorge-Arnulfo Quiané-Ruiz,et al.  Runtime measurements in the cloud , 2010, Proc. VLDB Endow..

[12]  Uwe Schwiegelshohn,et al.  Towards Understanding Uncertainty in Cloud Computing Resource Provisioning , 2015, ICCS.

[13]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[14]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..