Real-Time Soft Resource Allocation in Multi-Tier Web Service Systems

Soft resource allocation is an important factor of system configuration which plays a critical role in guaranteeing the performance of multi-tier web service systems. There is a tradeoff between real-time performance and resource consumption, and thus the real-time adjustment of soft resource allocation in response to dynamic workload is quite challenging. In this paper, we propose a real-time soft resource allocation method that integrates both model-based analysis and real-time optimization. Specifically, a multi-tier web service system is firstly formulated by a queueing network model, and theoretical analyses are provided. Then, an optimization approach for real-time soft resource allocation is designed by applying sliding window techniques, in order to cope with dynamic workloads and performance demands. Based on the RUBiS benchmark system, model parameters are obtained by measurements and the efficacy of our approach is finally validated.

[1]  Prashant J. Shenoy,et al.  Dynamic Provisioning of Multi-tier Internet Applications , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[2]  Kuo-Chan Huang,et al.  Efficient Resource Allocation Mechanism for Federated Clouds , 2015, Int. J. Grid High Perform. Comput..

[3]  Edward Chlebus,et al.  Nonstationary Poisson modeling of web browsing session arrivals , 2007, Inf. Process. Lett..

[4]  Ana Pont,et al.  Analyzing web server performance under dynamic user workloads , 2013, Comput. Commun..

[5]  Yixin Diao,et al.  Controlling Quality of Service in Multi-Tier Web Applications , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[6]  Gang Cui,et al.  Self-Adaptive QoS-Aware Web Service Discovery using Ontology Approach , 2015, Int. J. Grid High Perform. Comput..

[7]  Asser N. Tantawi,et al.  An analytical model for multi-tier internet services and its applications , 2005, SIGMETRICS '05.

[8]  Thomas J. Hacker,et al.  Predictive Model for Dynamically Provisioning Resources in Multi-Tier Web Applications , 2016, 2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom).

[9]  Cristina Cervello-Pastor,et al.  On the optimal allocation of virtual resources in cloud computing networks , 2013, IEEE Transactions on Computers.

[10]  Ching-Hsien Hsu,et al.  Multi-user web service selection based on multi-QoS prediction , 2014, Inf. Syst. Frontiers.

[11]  Suresh Veluru,et al.  Optimal allocation of virtual resources using genetic algorithm in cloud environments , 2015, Conf. Computing Frontiers.

[12]  Satish Narayana Srirama,et al.  Optimal Resource Provisioning for Scaling Enterprise Applications on the Cloud , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[13]  Jie Lu,et al.  Optimal Cloud Resource Auto-Scaling for Web Applications , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[14]  Calton Pu,et al.  The Impact of Soft Resource Allocation on n-Tier Application Scalability , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[15]  MengChu Zhou,et al.  Stochastic Modeling and Performance Analysis of Migration-Enabled and Error-Prone Clouds , 2015, IEEE Transactions on Industrial Informatics.

[16]  MengChu Zhou,et al.  Stochastic Modeling and Quality Evaluation of Infrastructure-as-a-Service Clouds , 2015, IEEE Transactions on Automation Science and Engineering.

[17]  Shijun Liu,et al.  Integrating Theoretical Modeling and Experimental Measurement for Soft Resource Allocation in Multi-tier Web Systems , 2016, 2016 IEEE International Conference on Web Services (ICWS).

[18]  Calton Pu,et al.  Economical and Robust Provisioning of N-Tier Cloud Workloads: A Multi-level Control Approach , 2011, 2011 31st International Conference on Distributed Computing Systems.

[19]  Ching-Hsien Hsu,et al.  A Highly Accurate Prediction Algorithm for Unknown Web Service QoS Values , 2016, IEEE Transactions on Services Computing.

[20]  Thiruselvan Subramanian,et al.  Application based brokering algorithm for optimal resource provisioning in multiple heterogeneous clouds , 2016, Vietnam Journal of Computer Science.