Optimization of virtual resource management for cloud applications to cope with traffic burst

Being the latest computing paradigm, cloud computing has proliferated as many IT giants started to deliver resources as services. Thus application providers are free from the burden of the low-level implementation and system administration. Meanwhile, the fact that we are in an era of information explosion brings certain challenges. Some websites may encounter a sharp rising workload due to some unexpected social concerns, which make these websites unavailable or even fail to provide services in time. Currently, a post-action method based on human experience and system alarm is widely used to handle this scenario in industry, which has shortcomings like reaction delay. In our paper, we want to solve this problem by deploying such websites on cloud, and use features of the cloud to tackle it. We present a framework of dynamic virtual resource management in clouds, to cope with traffic burst that applications might encounter. The framework implements a whole work-flow from prediction of the sharp rising workload to a customized resource management module which guarantees the high availability of web applications and cost-effectiveness of the cloud service providers. Our experiments show the accuracy of our workload forecasting method by comparing it with other methods. The 1998 World Cup workload dataset used in our experiment reveals the applicability of our model in the specific scenarios of traffic burst. Also, a simulation-based experiment is designed to indicate that the proposed management framework detects changes in workload intensity that occur over time and allocates multiple virtualized IT resources accordingly to achieve high availability and cost-effective targets. We present a framework of dynamic resource management to cope with traffic burst.The prediction of traffic burst is based on Gompertz Curve and Moving Average model.VM scheduler involves VM Provisioning, VM Placement and VM Recycling.High availability and cost-effectiveness are achieved by the proposed framework.

[1]  Carl M. Harris,et al.  Fundamentals of queueing theory , 1975 .

[2]  C. Winsor,et al.  The Gompertz Curve as a Growth Curve. , 1932, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Pankesh Patel,et al.  Service Level Agreement in Cloud Computing , 2009 .

[4]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[5]  Xi Chen,et al.  An Availability-Aware Virtual Machine Placement Approach for Dynamic Scaling of Cloud Applications , 2012, 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing.

[6]  Martin Arlitt,et al.  A workload characterization study of the 1998 World Cup Web site , 2000, IEEE Netw..

[7]  Xi Chen,et al.  Characterizing web application performance for maximizing service providers' profits in clouds , 2011, 2011 International Conference on Cloud and Service Computing.

[8]  Sergei Gorlatch,et al.  A Dynamic Resource Management System for Real-Time Online Applications on Clouds , 2011, Euro-Par Workshops.

[9]  Chen-Khong Tham,et al.  Evolutionary Optimal Virtual Machine Placement and Demand Forecaster for Cloud Computing , 2011, 2011 IEEE International Conference on Advanced Information Networking and Applications.

[10]  Rajkumar Buyya,et al.  Virtual Machine Provisioning Based on Analytical Performance and QoS in Cloud Computing Environments , 2011, 2011 International Conference on Parallel Processing.

[11]  Ajay Mohindra,et al.  Dynamic Scaling of Web Applications in a Virtualized Cloud Computing Environment , 2009, 2009 IEEE International Conference on e-Business Engineering.

[12]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[13]  A. Kivity,et al.  kvm : the Linux Virtual Machine Monitor , 2007 .

[14]  Moisés Goldszmidt,et al.  Short term performance forecasting in enterprise systems , 2005, KDD '05.

[15]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[16]  Athanasios Sfetsos,et al.  Univariate and multivariate forecasting of hourly solar radiation with artificial intelligence techniques , 2000 .

[17]  Borja Sotomayor,et al.  Virtual Infrastructure Management in Private and Hybrid Clouds , 2009, IEEE Internet Computing.

[18]  Joseph L. Hellerstein,et al.  Predictive models for proactive network management: application to a production Web server , 2000, NOMS 2000. 2000 IEEE/IFIP Network Operations and Management Symposium 'The Networked Planet: Management Beyond 2000' (Cat. No.00CB37074).

[19]  R. Kass.  Nonlinear Regression Analysis and its Applications , 1990 .

[20]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[21]  Min Li,et al.  CAM: a topology aware minimum cost flow based resource manager for MapReduce applications in the cloud , 2012, HPDC '12.

[22]  Jean-Marc Menaud,et al.  Autonomic virtual resource management for service hosting platforms , 2009, 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing.

[23]  Asser N. Tantawi,et al.  An analytical model for multi-tier internet services and its applications , 2005, SIGMETRICS '05.

[24]  ZhiHui Lv,et al.  Implementing a novel load-aware auto scale scheme for private cloud resource management platform , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[25]  Rajkumar Buyya,et al.  Energy Efficient Resource Management in Virtualized Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[26]  Yu Shyang Tan,et al.  'Time' for Cloud? Design and Implementation of a Time-Based Cloud Resource Management System , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[27]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .