Predictively booting nodes to minimize performance degradation of a power-aware web cluster

With the ever increasing trend of dynamic and static content web, clusters have been widely used for large-scale web servers to improve the system scalability. Dynamically switching the cluster nodes between different power states is one effective approach to save the energy in such clusters. Many research efforts have been invested in designing power-aware clusters by using this method. However, booting a cluster node from a low-power state to an active state takes a certain amount of time that depends on different configurations. This process incurs significant performance degradation. The existing work normally trades a certain amount of performance degradation for energy saving. This paper proposes a hybrid method to predict the number of requests per booting time of the web workloads. A power-aware web cluster scheduler is designed to divide the cluster nodes into an active group and a low-power group. The scheduler attempts to minimize the active group and maximize the low-power group, and boot the cluster nodes in the low-power group in advance to minimize/eliminate performance degradation by leveraging the prediction scheme. Furthermore, this paper integrates the power awareness into the conventional load balancers including Least Connections, Deficit Round Robin, and Skew. Comprehensive experiments are performed to explore the potential opportunities to minimize/eliminate the performance degradation of the power-aware web cluster.

[1]  Yuhui Deng,et al.  Conserving disk energy in virtual machine based environments by amplifying bursts , 2010, Computing.

[2]  Thomas F. Wenisch,et al.  Power management of online data-intensive services , 2011, 2011 38th Annual International Symposium on Computer Architecture (ISCA).

[3]  Wensong Zhang Linux Virtual Server for Scalable Network Services , 2000 .

[4]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[5]  Yuhui Deng,et al.  Self-similarity: Behind workload reshaping and prediction , 2012, Future Gener. Comput. Syst..

[6]  Vincent W. Freeh,et al.  Boosting Data Center Performance Through Non-Uniform Power Allocation , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[7]  Peter A. Dinda,et al.  Host load prediction using linear models , 2000, Cluster Computing.

[8]  E. N. Elnozahy,et al.  Energy-Efficient Server Clusters , 2002, PACS.

[9]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[10]  Randy H. Katz,et al.  NapSAC: design and implementation of a power-proportional web cluster , 2010, CCRV.

[11]  George Varghese,et al.  Efficient fair queueing using deficit round robin , 1995, SIGCOMM '95.

[12]  Robert R. Gianni,et al.  Thermal Stress Relief with Power Management , 1997 .

[13]  R. Gianni,et al.  Thermal stress relief with power management [desktop computer systems] , 1997, Proceedings of the 1997 IEEE International Symposium on Electronics and the Environment. ISEE-1997.

[14]  Karthick Rajamani,et al.  On evaluating request-distribution schemes for saving energy in server clusters , 2003, 2003 IEEE International Symposium on Performance Analysis of Systems and Software. ISPASS 2003..

[15]  Enrique V. Carrera,et al.  Load balancing and unbalancing for power and performance in cluster-based systems , 2001 .

[16]  David E. Irwin,et al.  Ensemble-level Power Management for Dense Blade Servers , 2006, 33rd International Symposium on Computer Architecture (ISCA'06).

[17]  MeisnerDavid,et al.  Power management of online data-intensive services , 2011 .

[18]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[19]  Daniel A. Menascé Web Performance Modeling Issues , 2000, Int. J. High Perform. Comput. Appl..

[20]  Scott A. Brandt,et al.  A Hybrid Disk-Aware Spin-Down Algorithm with I/O Subsystem Support , 2007, 2007 IEEE International Performance, Computing, and Communications Conference.

[21]  Anand Sivasubramaniam,et al.  Worth their watts? - an empirical study of datacenter servers , 2010, HPCA - 16 2010 The Sixteenth International Symposium on High-Performance Computer Architecture.

[22]  Allen C.-H. Wu,et al.  A predictive system shutdown method for energy saving of event-driven computation , 1997, 1997 Proceedings of IEEE International Conference on Computer Aided Design (ICCAD).

[23]  J. Koomey,et al.  Report to Congress on Server and Data Center Energy Efficiency: Public Law 109-431: Appendices , 2008 .

[24]  Suman Nath,et al.  Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services , 2008, NSDI.

[25]  Charles L. Seitz Recent advances in cluster networks , 2001, Proceedings 42nd IEEE Symposium on Foundations of Computer Science.

[26]  G. Pierre,et al.  Predictability of Web-server traffic congestion , 2005, 10th International Workshop on Web Content Caching and Distribution (WCW'05).

[27]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[28]  Yuhui Deng,et al.  What is the future of disk drives, death or rebirth? , 2011, ACM Comput. Surv..

[29]  Mark S. Squillante,et al.  Analysis and characterization of large‐scale Web server access patterns and performance , 1999, World Wide Web.

[30]  Fan Zhang,et al.  Blocking-aware processor voltage scheduling for real-time tasks , 2004, TECS.

[31]  Kevin Skadron,et al.  Power-aware QoS management in Web servers , 2003, RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003.

[32]  Yuanyuan Zhou,et al.  Hibernator: helping disk arrays sleep through the winter , 2005, SOSP '05.

[33]  AbdelzaherTarek,et al.  Dynamic Voltage Scaling in Multitier Web Servers with End-to-End Delay Control , 2007 .