Scalable System-level Active Low-Power Mode with Bounded Latency

Many system-level inactive low power modes exploit idle periods to obtain energy savings. With the emergence of multicore servers, idle periods are becoming increasingly rare. In order to save energy in multicore servers, low-utilization periods, which remains with increasing core count, must be exploited. Server-level heterogenous servers, such as KnightShift, have been shown to significantly improve the energy proportionality of datacenter servers through exploiting lowutilization periods. However, previous switching policies, which decides when to switch between a high-power highperformance node and a low-power lower-performance node, are simplistic and easily fooled by server utilization patterns, leading to false switches and thrashing causing unbounded latency impact. In this paper, we propose Hueristic-based Switching Policies (HSP), which uses utilization history to predict when future high utilization periods will occur. We show that HSP can significantly reduce thrashing and false switches, bounding latency while still maintaining significant energy savings. Furthermore, we show that active low-power modes that exploit low utilization periods are able to sustain energylatency tradeoffs as core count increases and offer superior energy savings compared to idleness scheduling algorithms.

[1]  Junjie Wu,et al.  BigHouse: A simulation infrastructure for data center systems , 2012, 2012 IEEE International Symposium on Performance Analysis of Systems & Software.

[2]  Qingyuan Deng,et al.  MemScale: active low-power modes for main memory , 2011, ASPLOS XVI.

[3]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[4]  Mehul A. Shah,et al.  Analyzing the energy efficiency of a database server , 2010, SIGMOD Conference.

[5]  E. N. Elnozahy,et al.  Energy Conservation Policies for Web Servers , 2003, USENIX Symposium on Internet Technologies and Systems.

[6]  Thomas F. Wenisch,et al.  Power management of online data-intensive services , 2011, 2011 38th Annual International Symposium on Computer Architecture (ISCA).

[7]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[8]  John Paul Shen,et al.  Mitigating Amdahl's law through EPI throttling , 2005, 32nd International Symposium on Computer Architecture (ISCA'05).

[9]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

[10]  Tao Yang,et al.  Energy Conservation in Datacenters through Cluster Memory Management and Barely-Alive Memory Servers , 2009 .

[11]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[12]  Ricardo Bianchini,et al.  Conserving disk energy in network servers , 2003, ICS '03.

[13]  Prashant J. Shenoy,et al.  Blink: managing server clusters on intermittent power , 2011, ASPLOS XVI.

[14]  Paramvir Bahl,et al.  Somniloquy: Augmenting Network Interfaces to Reduce PC Energy Usage , 2009, NSDI.

[15]  Suman Nath,et al.  Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services , 2008, NSDI.

[16]  Thomas F. Wenisch,et al.  DreamWeaver: architectural support for deep sleep , 2012, ASPLOS XVII.

[17]  Mark Redekopp,et al.  KnightShift: shifting the I/O burden in datacenters to management processor for energy efficiency , 2010, ISCA'10.

[18]  Margaret Martonosi,et al.  An Analysis of Efficient Multi-Core Global Power Management Policies: Maximizing Performance for a Given Power Budget , 2006, 2006 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'06).

[19]  Mor Harchol-Balter,et al.  Power Capping Via Forced Idleness , 2009 .

[20]  Diana Marculescu,et al.  Analysis of dynamic voltage/frequency scaling in chip-multiprocessors , 2007, Proceedings of the 2007 international symposium on Low power electronics and design (ISLPED '07).

[21]  Kushagra Vaid,et al.  Web search using mobile cores: quantifying and mitigating the price of efficiency , 2010, ISCA.

[22]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.

[23]  Xiaorui Wang,et al.  Power capping: a prelude to power shifting , 2008, Cluster Computing.