Joint Resource Provisioning for Internet Datacenters with Diverse and Dynamic Traffic

Demand proportional resource provisioning schemes have been proposed to achieve datacenter energy efficiency, where servers are turned on/off according to the load of requests. Most existing schemes focus on delay sensitive jobs (SENs) only. However, in datacenters, there exist a vast amount of delay-tolerant jobs (TOLs), such as background/maintenance jobs. Thus, we study joint SEN and TOL resource provisioning in this paper, with a focus on TOLs. We consider traffic dynamics of SENs and TOLs in different time scales, and electricity price temporal dynamics and location diversity. Our goal is to minimize total costs, while guaranteeing QoS for SENs and achieving a desirable delay performance for TOLs. Specifically, we propose a joint server provisioning, SEN load dispatching, TOL load shifting, and SEN/TOL capacity allocation scheme, which leverages TOL queue information and does not assume any system statistical information. We also design other benchmark schemes that leverage different system information. Both analytical results and extensive simulation results show the efficiency of the proposed scheme, named OrgQ, in reducing total costs and TOL queue delay.

[1]  Adam Wierman,et al.  Renewable and cooling aware workload management for sustainable data centers , 2012, SIGMETRICS '12.

[2]  Dan Xu,et al.  Geographic trough filling for internet datacenters , 2011, 2012 Proceedings IEEE INFOCOM.

[3]  Baochun Li,et al.  Temperature Aware Workload Managementin Geo-Distributed Data Centers , 2013, IEEE Transactions on Parallel and Distributed Systems.

[4]  Niv Buchbinder,et al.  Online Job-Migration for Reducing the Electricity Bill in the Cloud , 2011, Networking.

[5]  Athanasios V. Vasilakos,et al.  Energy-Efficient Flow Scheduling and Routing with Hard Deadlines in Data Center Networks , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems.

[6]  Anand Sivasubramaniam,et al.  Managing server energy and operational costs in hosting centers , 2005, SIGMETRICS '05.

[7]  Athanasios V. Vasilakos,et al.  GreenDCN: a General Framework for Achieving Network Energy Efficiency in Data Centers , 2014 .

[8]  Athanasios V. Vasilakos,et al.  Incentive-Compatible Online Mechanisms for Resource Provisioning and Allocation in Clouds , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[9]  Baochun Li,et al.  Pricing cloud bandwidth reservations under demand uncertainty , 2012, SIGMETRICS '12.

[10]  Robert Shorten,et al.  Distributed Dynamic Speed Scaling , 2010, 2010 Proceedings IEEE INFOCOM.

[11]  Suman Nath,et al.  Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services , 2008, NSDI.

[12]  Kirk Pruhs,et al.  Speed scaling for weighted flow time , 2007, SODA '07.

[13]  Ulas C. Kozat,et al.  Dynamic resource allocation and power management in virtualized data centers , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[14]  Athanasios V. Vasilakos,et al.  Thermal-Aware Scheduling of Batch Jobs in Geographically Distributed Data Centers , 2014, IEEE Transactions on Cloud Computing.

[15]  Yuan Yao,et al.  Data centers power reduction: A two time scale approach for delay tolerant workloads , 2012, 2012 Proceedings IEEE INFOCOM.

[16]  Traffic , 2004 .

[17]  Athanasios V. Vasilakos,et al.  A Framework for Truthful Online Auctions in Cloud Computing with Heterogeneous User Demands , 2016, IEEE Transactions on Computers.

[18]  Athanasios V. Vasilakos,et al.  GreenDCN: A General Framework for Achieving Energy Efficiency in Data Center Networks , 2013, IEEE Journal on Selected Areas in Communications.

[19]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[20]  Dan Xu,et al.  Efficient Server Provisioning and Offloading Policies for Internet Data Centers with Dynamic Load-Demand , 2015, IEEE Transactions on Computers.

[21]  Athanasios V. Vasilakos,et al.  Managing Performance Overhead of Virtual Machines in Cloud Computing: A Survey, State of the Art, and Future Directions , 2014, Proceedings of the IEEE.

[22]  Minghua Chen,et al.  Simple and effective dynamic provisioning for power-proportional data centers , 2011, 2012 46th Annual Conference on Information Sciences and Systems (CISS).

[23]  Lachlan L. H. Andrew,et al.  Greening Geographical Load Balancing , 2015, IEEE/ACM Transactions on Networking.

[24]  Lachlan L. H. Andrew,et al.  Power-Aware Speed Scaling in Processor Sharing Systems , 2009, IEEE INFOCOM 2009.

[25]  Athanasios V. Vasilakos,et al.  Joint virtual machine assignment and traffic engineering for green data center networks , 2014, PERV.

[26]  Minghua Chen,et al.  Dynamic provisioning in next-generation data centers with on-site power production , 2013, e-Energy '13.

[27]  Lachlan L. H. Andrew,et al.  Online algorithms for geographical load balancing , 2012, 2012 International Green Computing Conference (IGCC).

[28]  Dan Xu,et al.  Green internet datacenters with dynamic and diverse traffic , 2011 .

[29]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[30]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[31]  Xue Liu,et al.  Minimizing Electricity Cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment , 2010, 2010 Proceedings IEEE INFOCOM.

[32]  Deep Medhi,et al.  Server Operational Cost Optimization for Cloud Computing Service Providers over a Time Horizon , 2011, Hot-ICE.

[33]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[34]  Dan Xu,et al.  Minimizing energy cost for Internet-scale datacenters with dynamic traffic , 2011, 2011 IEEE Nineteenth IEEE International Workshop on Quality of Service.

[35]  Navendu Jain,et al.  Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning , 2011, 2011 Proceedings IEEE INFOCOM.

[36]  Baochun Li,et al.  Cost efficient datacenter selection for cloud services , 2012, 2012 1st IEEE International Conference on Communications in China (ICCC).

[37]  Minghua Chen,et al.  Intra-data-center traffic engineering with ensemble routing , 2013, 2013 Proceedings IEEE INFOCOM.

[38]  Peter Varman,et al.  Workload decomposition for power efficient storage systems , 2008, CLUSTER 2008.