Automatic provisioning of multi-tier applications in cloud computing environments

Provisioning of multi-tier applications in cloud environments raises new challenges not addressed by prior work on provisioning single-tier applications, on dynamic balancing or on resource allocation in other types of distributed systems. Flexible and general automatic mechanisms are needed to determine how much virtual resources need to be allocated to each tier of the application minimizing resources consumption and meeting the service level agreement. Both the research community and the main cloud providers are proposing this kind of solutions but most of them are application-specific, provider-specific, centralized and focused only on batch applications. This paper presents an automatic provisioning solution for multi-tier applications called AutoMAP. The proposed mechanism is general (application and provider independent), it can be implemented with different architectures from centralized to distributed even being provided as a service, and it is able to deal with both batch and interactive applications allowing horizontal and vertical scaling (based on replication and on resizing respectively). A first prototype of AutoMAP has been implemented to demonstrate its efficiency with experimental results using a widely used benchmark, RUBiS, on a real cloud architecture.

[1]  Ayman G. Fayoumi,et al.  Cloud Resource Provisioning and Bursting Approaches , 2013, 2013 14th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing.

[2]  Balaji Viswanathan,et al.  SmartScale: Automatic Application Scaling in Enterprise Clouds , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[3]  Fabio Panzieri,et al.  QoS–Aware Clouds , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[4]  Marta Beltrán,et al.  How to Balance the Load on Heterogeneous Clusters , 2009, Int. J. High Perform. Comput. Appl..

[5]  Junliang Chen,et al.  Workload Predicting-Based Automatic Scaling in Service Clouds , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[6]  Calton Pu,et al.  Empirical analysis of database server scalability using an N-tier benchmark with read-intensive workload , 2010, SAC '10.

[7]  Derek L. Eager,et al.  Bound hierarchies for multiple-class queuing networks , 1986, JACM.

[8]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[9]  Marty Humphrey,et al.  Auto-scaling to minimize cost and meet application deadlines in cloud workflows , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[10]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[11]  Yudi Wei,et al.  Dynamic Balanced Configuration of Multi-resources in Virtualized Clusters , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[12]  Albert Y. Zomaya,et al.  Profit-Driven Service Request Scheduling in Clouds , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[13]  John Zahorjan,et al.  Balanced job bound analysis of queueing networks , 1982, CACM.

[14]  Stephen S. Lavenberg,et al.  Mean-Value Analysis of Closed Multichain Queuing Networks , 1980, JACM.

[15]  Moustafa Ghanem,et al.  Lightweight Resource Scaling for Cloud Applications , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[16]  Rajkumar Buyya,et al.  Cloud Computing Principles and Paradigms , 2011 .

[17]  Zhiliang Zhu,et al.  Dynamic Provisioning Modeling for Virtualized Multi-tier Applications in Cloud Data Center , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[18]  Prashant J. Shenoy,et al.  Agile dynamic provisioning of multi-tier Internet applications , 2008, TAAS.

[19]  Muli Ben-Yehuda,et al.  The Reservoir model and architecture for open federated cloud computing , 2009, IBM J. Res. Dev..

[20]  E. Hossny,et al.  Towards automated user-centric cloud provisioning: Job provisioning and scheduling on heterogeneous virtual machines , 2012, 2012 8th International Conference on Informatics and Systems (INFOS).

[21]  Hamid Ahmadi,et al.  Equivalent Capacity and Its Application to Bandwidth Allocation in High-Speed Networks , 1991, IEEE J. Sel. Areas Commun..

[22]  Ajay Mohindra,et al.  Dynamic Scaling of Web Applications in a Virtualized Cloud Computing Environment , 2009, 2009 IEEE International Conference on e-Business Engineering.

[23]  Moreno Marzolla,et al.  Dynamic resource provisioning for cloud-based gaming infrastructures , 2012, CIE.

[24]  Daniel A. Menascé,et al.  Autonomic resource provisioning in cloud systems with availability goals , 2013, CAC.

[25]  Rajkumar Buyya,et al.  Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation , 2009, CloudCom.

[26]  Calton Pu,et al.  Economical and Robust Provisioning of N-Tier Cloud Workloads: A Multi-level Control Approach , 2011, 2011 31st International Conference on Distributed Computing Systems.

[27]  MarzollaMoreno,et al.  Dynamic resource provisioning for cloud-based gaming infrastructures , 2012 .

[28]  Marta Beltrán,et al.  Solving Queueing Network Models in Cloud Provisioning Contexts , 2014, VALUETOOLS.

[29]  Dana Petcu,et al.  DEPAS: a decentralized probabilistic algorithm for auto-scaling , 2012, Computing.

[30]  Rajkumar Buyya,et al.  Virtual Machine Provisioning Based on Analytical Performance and QoS in Cloud Computing Environments , 2011, 2011 International Conference on Parallel Processing.

[31]  Yu Zhou,et al.  Cost-Aware Automatic Virtual Machine Scaling in Fine Granularity for Cloud Applications , 2013, 2013 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[32]  Marta Beltrán,et al.  An automatic machine scaling solution for cloud systems , 2012, 2012 19th International Conference on High Performance Computing.

[33]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[34]  Calton Pu,et al.  Mistral: Dynamically Managing Power, Performance, and Adaptation Cost in Cloud Infrastructures , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[35]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[36]  Jano I. van Hemert,et al.  Managing dynamic enterprise and urgent workloads on clouds using layered queuing and historical performance models , 2011, Simul. Model. Pract. Theory.

[37]  Prashant J. Shenoy,et al.  Provisioning multi-tier cloud applications using statistical bounds on sojourn time , 2012, ICAC '12.

[38]  Martin Fowler,et al.  Patterns of Enterprise Application Architecture , 2002 .