Network Packet Processing Mode-Aware Power Management for Data Center Servers

In data center servers, power management (PM) exploiting Dynamic Voltage and Frequency Scaling (DVFS) for processors can play a crucial role to improve energy efficiency. However, we observe that current PM policies (i.e., governors) not only considerably increase tail response time (i.e., violate a given Service Level Objective (SLO)) but also hurt energy efficiency. Tackling limitations of current PM governors, we propose <monospace>NMAP</monospace>, <bold>N</bold>etwork packet processing <bold>M</bold>ode-<bold>A</bold>ware <bold>P</bold>ower management. <monospace>NMAP</monospace> improves energy efficiency while satisfying given SLOs, considering packet processing status on a core for PM by monitoring transitions between network packet processing modes – interrupt and polling. Tracking the transitions, <monospace>NMAP</monospace> detects moments that a core cannot process packets fast enough and forces the core to immediately raise the voltage and frequency (V/F) state. As a result, <monospace>NMAP</monospace> can provide not only low response time but also low energy consumption. Our experiment shows that <monospace>NMAP</monospace> improves tail response time by up to 4.1× compared with the <monospace>ondemand</monospace> governor, reducing energy by up to 44.6 percent compared with the <monospace>performance</monospace> governor.

[1]  Mohammad Alian,et al.  NCAP: Network-Driven, Packet Context-Aware Power Management for Client-Server Architecture , 2017, 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[2]  Jamal Hadi Salim,et al.  Beyond Softnet , 2001, Annual Linux Showcase & Conference.

[3]  Christoforos E. Kozyrakis,et al.  Towards energy proportionality for large-scale latency-critical workloads , 2014, 2014 ACM/IEEE 41st International Symposium on Computer Architecture (ISCA).

[4]  Luiz André Barroso,et al.  The tail at scale , 2013, CACM.

[5]  Daniel Sánchez,et al.  Rubik: Fast analytical power management for latency-critical systems , 2015, 2015 48th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[6]  Babak Falsafi,et al.  Clearing the clouds: a study of emerging scale-out workloads on modern hardware , 2012, ASPLOS XVII.