A two-time-scale load balancing framework for minimizing electricity bills of Internet Data Centers

Internet Data Center (IDC) is one of important emerging cyber-physical systems. To guarantee the quality of service for their worldwide users, large Internet service providers usually operate multiple geographically distributed IDCs. The enormous power consumption of these data centers may lead to both huge electricity bills and considerable carbon emissions. To mitigate these problems, on-site renewable energy plants are emerging in recent years. Since the renewable energy is intermittent, greening geographical load balancing (GGLB for short) has been proposed to reduce both the electricity bills and carbon emissions by following the renewables. However, GGLB is not able to well deal with the wildly fluctuating wind power when applied into IDCs with on-site wind energy plants. It may either fail to minimize the total electricity bills or incur the costly frequent on–off switching of servers. In order to minimize the total electricity bills of geographically distributed IDCs with on-site wind energy plants, we formulate the total electricity bills minimization problem and propose a novel two-time-scale load balancing framework TLB to solve it. First, TLB models the runtime cooling efficiency for each IDC. Then it predicts the future fine-grained (e.g., 10-min) on-site wind power output at the beginning of each scheduling period (e.g., an hour). After that, TLB transforms the primal optimization problem into a typical mixed-integer linear programming problem and solves it to finally obtain the optimal scheduling policy including the open server number as well as the request routing policy. It is worth noting that the open server number of each IDC will remain the same during each scheduling period. As an application instance of TLB, we also design a two-time-scale load balancing algorithm TLB-ARMA for our experimental scenario. Evaluation results based on real-life traces show that TLB-ARMA is able to reduce the total electricity bills by as much as 12.58 % compared with the hourly executed GGLB without incurring the costly repeated on–off switching of servers.

[1]  Thomas Stützle,et al.  Ant colony optimization: artificial ants as a computational intelligence technique , 2006 .

[2]  Thu D. Nguyen,et al.  Parasol and GreenSwitch: managing datacenters powered by renewable energy , 2013, ASPLOS '13.

[3]  Anand Sivasubramaniam,et al.  Optimal power cost management using stored energy in data centers , 2011, PERV.

[4]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[5]  Yefu Wang,et al.  GreenWare: Greening Cloud-Scale Data Centers to Maximize the Use of Renewable Energy , 2011, Middleware.

[6]  Mor Harchol-Balter,et al.  Server farms with setup costs , 2010, Perform. Evaluation.

[7]  M. Milligan,et al.  Statistical Wind Power Forecasting Models: Results for U.S. Wind Farms; Preprint , 2003 .

[8]  Xue Liu,et al.  MEC-IDC: joint load balancing and power control for distributed Internet Data Centers , 2010, ICCPS '10.

[9]  Alan Scheller-Wolf,et al.  Exact analysis of the M/M/k/setup class of Markov chains via recursive renewal reward , 2013, SIGMETRICS '13.

[10]  Hai Jin,et al.  Lifetime or energy: Consolidating servers with reliability control in virtualized cloud datacenters , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[11]  Christopher Stewart,et al.  Some Joules Are More Precious Than Others: Managing Renewable Energy in the Datacenter∗ , 2009 .

[12]  L. Wang,et al.  GI/Geom/1 queue based on communication model for mesh networks , 2014, Int. J. Commun. Syst..

[13]  Xue Liu,et al.  Dynamic Voltage Scaling in Multitier Web Servers with End-to-End Delay Control , 2007, IEEE Transactions on Computers.

[14]  Yao Sun,et al.  Sacrificing Reliability for Energy Saving: Is it worthwhile for disk arrays? , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[15]  Navendu Jain,et al.  Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning , 2011, 2011 Proceedings IEEE INFOCOM.

[16]  Yunchuan Sun,et al.  An extensible and active semantic model of information organizing for the Internet of Things , 2014, Personal and Ubiquitous Computing.

[17]  Na Li,et al.  Solar generation prediction using the ARMA model in a laboratory-level micro-grid , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[18]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[19]  Baochun Li,et al.  Temperature Aware Workload Managementin Geo-Distributed Data Centers , 2013, IEEE Trans. Parallel Distributed Syst..

[20]  Junping Wang,et al.  A new online anomaly learning and detection for large-scale service of Internet of Thing , 2015, Personal and Ubiquitous Computing.

[21]  Thu D. Nguyen,et al.  CoolAir: Temperature- and Variation-Aware Management for Free-Cooled Datacenters , 2015, ASPLOS.

[22]  Xiao Liu,et al.  Power consumption prediction of web services for energy-efficient service selection , 2015, Personal and Ubiquitous Computing.

[23]  Chao Li,et al.  iSwitch: Coordinating and optimizing renewable energy powered server clusters , 2012, 2012 39th Annual International Symposium on Computer Architecture (ISCA).

[24]  Anand Sivasubramaniam,et al.  Carbon-Aware Energy Capacity Planning for Datacenters , 2012, 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[25]  Tajana Rosing,et al.  Utilizing green energy prediction to schedule mixed batch and service jobs in data centers , 2011, OPSR.

[26]  Yin Li,et al.  Joint study on optimizations of data center deployment, VM assignment and migration , 2013, 2013 IEEE/ACM 21st International Symposium on Quality of Service (IWQoS).

[27]  Ting Zhu,et al.  Leveraging weather forecasts in renewable energy systems , 2014, Sustain. Comput. Informatics Syst..

[28]  Xue Liu,et al.  Minimizing Electricity Cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment , 2010, 2010 Proceedings IEEE INFOCOM.

[29]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[30]  Srinivasan Keshav,et al.  It's not easy being green , 2012, CCRV.

[31]  WongBernard,et al.  It's not easy being green , 2012 .

[32]  Tao Xie,et al.  Improving software reliability and productivity via mining program source code , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[33]  Edward A. Lee.  Cyber Physical Systems: Design Challenges , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[34]  BalakrishnanHari,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[35]  Adam Wierman,et al.  Renewable and cooling aware workload management for sustainable data centers , 2012, SIGMETRICS '12.

[36]  Martin W. P. Savelsbergh,et al.  A Computational Study of Search Strategies for Mixed Integer Programming , 1999, INFORMS J. Comput..

[37]  Paras Mandal,et al.  A review of wind power and wind speed forecasting methods with different time horizons , 2010, North American Power Symposium 2010.

[38]  R. Inman,et al.  Solar forecasting methods for renewable energy integration , 2013 .

[39]  Lachlan L. H. Andrew,et al.  Greening geographical load balancing , 2011, PERV.

[40]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.