On the Performance-Cost Tradeoff for Workflow Scheduling in Hybrid Clouds

The use of public clouds to extend the capacity of private resources has become a popular manner to achieve elasticity in the available in-house computational power to meet deadlines. Schedulers for such hybrid clouds have the role of deciding which types of instances should be leased in a pay-per-use basis to fulfill application demands. Often these schedulers assume a costless private cloud, which may not be a real scenario: aggregated costs can come from maintenance, energy consumption, administrative staff, and, more recently, from leasing a private data center from hardware manufacturers or a virtual private cloud from public providers. Based on these more realistic assumptions, we assess the behavior of a cloud scheduling algorithm in the face of different pricing relation between private and public resources. We show there exist a trade-off between using local resources to maximize the utilization of private cloud to minimize the monetary cost with outsourced resources and using leased resources from public cloud to satisfy deadlines, which can lead to idleness in the private cloud. Preliminary results indicate that application deadlines and the cost of private cloud can influence in the private cloud utilization, sometimes outsourcing most executions to public clouds, which leads to increased costs to run the application. We then argue that utilization-aware schedulers are also important to be developed when considering hybrid clouds.

[1]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[2]  Ewa Deelman,et al.  The cost of doing science on the cloud: the Montage example , 2008, HiPC 2008.

[3]  Rajkumar Buyya,et al.  A cost-benefit analysis of using cloud computing to extend the capacity of clusters , 2010, Cluster Computing.

[4]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[5]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[6]  Dick H. J. Epema,et al.  Cost-driven scheduling of grid workflows using Partial Critical Paths , 2010, 2010 11th IEEE/ACM International Conference on Grid Computing.

[7]  Luiz Fernando Bittencourt,et al.  HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds , 2011, Journal of Internet Services and Applications.

[8]  Nelson Luis Saldanha da Fonseca,et al.  Scheduling in hybrid clouds , 2012, IEEE Communications Magazine.

[9]  Rajkumar Buyya,et al.  Future Generation Computer Systems Deadline-driven Provisioning of Resources for Scientific Applications in Hybrid Clouds with Aneka , 2022 .

[10]  Luiz Fernando Bittencourt,et al.  Using Time Discretization to Schedule Scientific Workflows in Multiple Cloud Providers , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[11]  Israel Cidon,et al.  Optimal scheduling in the hybrid-cloud , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).