Learning Based Power Management for Periodic Real-Time Tasks

With the extensive use of portable battery powered devices in the new computing era, the power consumption problem of embedded devices has received a lot of attention in order to gain long battery life for enormous prospective. In modern processors, dynamic voltage and frequency scaling (DVFS) has been commonly used for energy reduction and temperature control. But with the variety of processor configurations, a DVFS arrangement that is energy efficient for one processor might not be appropriate for others. Furthermore, the efficiency of DVFS is also affected by the CPU intensiveness of the underlying tasks of the applications. In this paper, we propose a novel reinforcement learning based algorithm that dynamically controls the voltage and frequency of real-time systems and adjusts itself with diverse environments for optimal use of energy. Experimental results show that our proposed method can save significant amount of energy compared to other approaches.

[1]  Wei Liu,et al.  Adaptive power management using reinforcement learning , 2009, 2009 IEEE/ACM International Conference on Computer-Aided Design - Digest of Technical Papers.

[2]  Margaret Martonosi,et al.  Live, Runtime Phase Monitoring and Prediction on Real Systems with Application to Dynamic Power Management , 2006, 2006 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'06).

[3]  Massoud Pedram,et al.  Supervised Learning Based Power Management for Multicore Processors , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[4]  Rami G. Melhem,et al.  Power-aware scheduling for periodic real-time tasks , 2004, IEEE Transactions on Computers.

[5]  Margaret Martonosi,et al.  Coordinated, distributed, formal energy management of chip multiprocessors , 2005, ISLPED '05. Proceedings of the 2005 International Symposium on Low Power Electronics and Design, 2005..

[6]  Yao Guo,et al.  Energy-Aware Fixed-Priority Multi-core Scheduling for Real-Time Systems , 2011, 2011 IEEE 17th International Conference on Embedded and Real-Time Computing Systems and Applications.

[7]  Massoud Pedram,et al.  Fine-grained dynamic voltage and frequency scaling for precise energy and performance trade-off based on the ratio of off-chip access to on-chip computation times , 2004, Proceedings Design, Automation and Test in Europe Conference and Exhibition.

[8]  Gerhard Wellein,et al.  LIKWID: A Lightweight Performance-Oriented Tool Suite for x86 Multicore Environments , 2010, 2010 39th International Conference on Parallel Processing Workshops.

[9]  Kang G. Shin,et al.  Real-time dynamic voltage scaling for low-power embedded operating systems , 2001, SOSP.

[10]  Qiang Xu,et al.  Learning-based power management for multi-core processors via idle period manipulation , 2012, 17th Asia and South Pacific Design Automation Conference.

[11]  Laurence T. Yang,et al.  Integrating Preemption Threshold to Fixed Priority DVS Scheduling Algorithms , 2009, 2009 15th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications.

[12]  Weisong Shi,et al.  pTop : A Process-level Power Profiling Tool , 2009 .

[13]  Qiang Xu,et al.  Learning-Based Power Management for Multicore Processors via Idle Period Manipulation , 2014, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[14]  Tsung-Yi Wu,et al.  High Performance and Low Leakage Design Using Cell Replacement and Hybrid V t Standard Cell Libraries , 2008 .

[15]  Amin Vahdat,et al.  ECOSystem: managing energy as a first class operating system resource , 2002, ASPLOS X.

[16]  Laurence T. Yang,et al.  Multi-core Fixed Priority DVS Scheduling , 2012, ICA3PP.

[17]  Xiaodong Wu,et al.  Energy-Efficient Scheduling of Real-Time Periodic Tasks in Multicore Systems , 2010, NPC.

[18]  Joonwon Lee,et al.  Energy Efficient Scheduling of Real-Time Tasks on Multicore Processors , 2008, IEEE Transactions on Parallel and Distributed Systems.

[19]  Wan Yeon Lee,et al.  Energy-Saving DVFS Scheduling of Multiple Periodic Real-Time Tasks on Multi-core Processors , 2009, 2009 13th IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications.

[20]  Trevor Mudge,et al.  Dynamic voltage scaling on a low-power microprocessor , 2001 .

[21]  W. Knight.  Two heads are better than one [dual-core processors] , 2005 .

[22]  Ranveer Chandra,et al.  Empowering developers to estimate app energy consumption , 2012, Mobicom '12.

[23]  Bruce Jacob,et al.  A control-theoretic approach to dynamic voltage scheduling , 2003, CASES '03.

[24]  Gerhard Wellein,et al.  LIKWID: Lightweight Performance Tools , 2011, CHPC.

[25]  Sang Lyul Min,et al.  Dynamic voltage scaling algorithm for fixed-priority real-time systems using work-demand analysis , 2003, ISLPED '03.

[26]  Ben H. H. Juurlink,et al.  Leakage-Aware Multiprocessor Scheduling , 2009, J. Signal Process. Syst..

[27]  Chandra Krintz,et al.  Predicting Program Power Consumption , 2002 .

[28]  Ying Tan,et al.  Achieving autonomous power management using reinforcement learning , 2013, TODE.

[29]  Hao Shen,et al.  Learning based DVFS for simultaneous temperature, performance and energy management , 2012, Thirteenth International Symposium on Quality Electronic Design (ISQED).

[30]  Lizy Kurian John,et al.  Complete System Power Estimation Using Processor Performance Events , 2012, IEEE Transactions on Computers.

[31]  Tajana Simunic,et al.  System-Level Power Management Using Online Learning , 2009, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[32]  Rajesh K. Gupta,et al.  Leakage aware dynamic voltage scaling for real-time embedded systems , 2004, Proceedings. 41st Design Automation Conference, 2004..

[33]  Frank Bellosa,et al.  Process cruise control: event-driven clock scaling for dynamic power management , 2002, CASES '02.