A multicore vacation scheme for thermal-aware packet processing

As processor power density increases, thermal and power control becomes critical for application processing. In this paper, we consider network applications which feature ON/OFF execution pattern, that causes frequent temperature and power consumption changes in the processor. A novel power aware thermal management algorithm is designed to achieve power saving in multicore processors by employing a vacation scheme. We implement the scheme through the idle states (C-state) provided by the OS in the CPU and show their effectiveness both through analysis and experimental data. Then, we apply our scheme with the thermal constraint and propose a heterogeneous load distribution, which creates more opportunities for power saving. Besides maintaining processor temperature below the temperature constraint, our technique achieves higher sustainable load and better power saving with minimum latency increase compared to existing thermal management techniques. To the best of our knowledge, this is the first work to discuss and develop vacation algorithm considering power, temperature and latency for network application on a general purpose multicore processor.

[1]  Sarma B. K. Vrudhula,et al.  Temperature-Aware DVFS for Hard Real-Time Applications on Multicore Processors , 2012, IEEE Transactions on Computers.

[2]  Laxmi N. Bhuyan,et al.  Thermal-aware vacation and rate adaptation for network packet processing , 2014, 2014 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[3]  Katerina J. Argyraki,et al.  RouteBricks: exploiting parallelism to scale software routers , 2009, SOSP '09.

[4]  Marco D. Santambrogio,et al.  ThermOS: System support for dynamic thermal management of chip multi-processors , 2013, Proceedings of the 22nd International Conference on Parallel Architectures and Compilation Techniques.

[5]  Naishuo Tian,et al.  Vacation Queueing Models Theory and Applications , 2006 .

[6]  Kevin Skadron,et al.  Control-theoretic techniques and thermal-RC modeling for accurate and localized dynamic thermal management , 2002, Proceedings Eighth International Symposium on High Performance Computer Architecture.

[7]  Laxmi N. Bhuyan,et al.  Optimizing Throughput and Latency under Given Power Budget for Network Packet Processing , 2010, 2010 Proceedings IEEE INFOCOM.

[8]  Pradip Bose,et al.  The case for lifetime reliability-aware microprocessors , 2004, Proceedings. 31st Annual International Symposium on Computer Architecture, 2004..

[9]  Bin Liu,et al.  An Efficient Parallelized L7-Filter Design for Multicore Servers , 2012, IEEE/ACM Transactions on Networking.

[10]  Kin K. Leung,et al.  A single-server queue with vacations and non-gated time-limited service , 1990, Proceedings. IEEE INFOCOM '90: Ninth Annual Joint Conference of the IEEE Computer and Communications Societies@m_The Multiple Facets of Integration.

[11]  Mustaque Ahamad,et al.  Packet scheduling for deep packet inspection on multi-core architectures , 2010, 2010 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[12]  Seungyeop Han,et al.  SSLShader: Cheap SSL Acceleration with Commodity Processors , 2011, NSDI.

[13]  Laxmi N. Bhuyan,et al.  Traffic-aware power optimization for network applications on multicore servers , 2012, DAC Design Automation Conference 2012.

[14]  Lizy Kurian John,et al.  Efficient traffic aware power management for multicore communications processors , 2012, 2012 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[15]  Wendong Hu,et al.  NetBench: a benchmarking suite for network processors , 2001, IEEE/ACM International Conference on Computer Aided Design. ICCAD 2001. IEEE/ACM Digest of Technical Papers (Cat. No.01CH37281).

[16]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[17]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.

[18]  Bianca Schroeder,et al.  Temperature management in data centers: why some (might) like it hot , 2012, SIGMETRICS '12.

[19]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[20]  Sergiu Nedevschi,et al.  Reducing Network Energy Consumption via Sleeping and Rate-Adaptation , 2008, NSDI.

[21]  Shan Lu,et al.  Leveraging parallelism for multi-dimensional packetclassification on software routers , 2010, SIGMETRICS '10.

[22]  Robin Kravets,et al.  Application‐driven power management for mobile communication , 2000, Wirel. Networks.

[23]  Kevin Skadron,et al.  Recent thermal management techniques for microprocessors , 2012, CSUR.