SLA-Based Resource Scheduling for Big Data Analytics as a Service in Cloud Computing Environments

Data analytics plays a significant role in gaining insight of big data that can benefit in decision making and problem solving for various application domains such as science, engineering, and commerce. Cloud computing is a suitable platform for Big Data Analytic Applications (BDAAs) that can greatly reduce application cost by elastically provisioning resources based on user requirements and in a pay as you go model. BDAAs are typically catered for specific domains and are usually expensive. Moreover, it is difficult to provision resources for BDAAs with fluctuating resource requirements and reduce the resource cost. As a result, BDAAs are mostly used by large enterprises. Therefore, it is necessary to have a general Analytics as a Service (AaaS) platform that can provision BDAAs to users in various domains as consumable services in an easy to use way and at lower price. To support the AaaS platform, our research focuses on efficiently scheduling Cloud resources for BDAAs to satisfy Quality of Service (QoS) requirements of budget and deadline for data analytic requests and maximize profit for the AaaS platform. We propose an admission control and resource scheduling algorithm, which not only satisfies QoS requirements of requests as guaranteed in Service Level Agreements (SLAs), but also increases the profit for AaaS providers by offering a cost-effective resource scheduling solution. We propose the architecture and models for the AaaS platform and conduct experiments to evaluate the proposed algorithm. Results show the efficiency of the algorithm in SLA guarantee, profit enhancement, and cost saving.

[1]  Rajkumar Buyya,et al.  SLA-Aware Provisioning and Scheduling of Cloud Resources for Big Data Analytics , 2014, 2014 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM).

[2]  H. Isermann Linear lexicographic optimization , 1982 .

[3]  Ion Stoica,et al.  Blink and It's Done: Interactive Queries on Very Large Data , 2012, Proc. VLDB Endow..

[4]  Jorge-Arnulfo Quiané-Ruiz,et al.  Runtime measurements in the cloud , 2010, Proc. VLDB Endow..

[5]  Patrick Martin,et al.  Towards Cloud-Based Analytics-as-a-Service (CLAaaS) for Big Data Analytics in the Cloud , 2013, 2013 IEEE International Congress on Big Data.

[6]  Rajkumar Buyya,et al.  Scaling MapReduce Applications Across Hybrid Clouds to Meet Soft Deadlines , 2013, 2013 IEEE 27th International Conference on Advanced Information Networking and Applications (AINA).

[7]  Rajkumar Buyya,et al.  Cost-Effective Provisioning and Scheduling of Deadline-Constrained Applications in Hybrid Clouds , 2012, WISE.

[8]  Rajkumar Buyya,et al.  Big Data computing and clouds: Trends and future directions , 2013, J. Parallel Distributed Comput..

[9]  G. Ribiere,et al.  Experiments in mixed-integer linear programming , 1971, Math. Program..

[10]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[11]  José Luis Vázquez-Poletti,et al.  Provisioning data analytic workloads in a cloud , 2013, Future Gener. Comput. Syst..

[12]  Bo Gao,et al.  A Cost-Effective Approach to Delivering Analytics as a Service , 2012, 2012 IEEE 19th International Conference on Web Services.

[13]  Wei Lu,et al.  Project Daytona: Data Analytics as a Cloud Service , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[14]  Qiming Chen,et al.  Experience in Continuous analytics as a Service (CaaaS) , 2011, EDBT/ICDT '11.

[15]  Rajkumar Buyya,et al.  SLA-Based Resource Provisioning for Heterogeneous Workloads in a Virtualized Cloud Datacenter , 2011, ICA3PP.

[16]  Vipin Kumar,et al.  Trends in big data analytics , 2014, J. Parallel Distributed Comput..

[17]  R. Benayoun,et al.  Linear programming with multiple objective functions: Step method (stem) , 1971, Math. Program..

[18]  Ming Mao,et al.  A Performance Study on the VM Startup Time in the Cloud , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.