Task aware hybrid DVFS for multi-core real-time systems using machine learning

Abstract There have been renewed interest in embedded battery powered devices due to their widespread applications in sectors such as automotive, industrial, and health care. In order to reduce energy consumption and enhance battery life, dynamic voltage and frequency scaling (DVFS) techniques have been applied to processors (one of the most energy consuming components). In order to keep pace with advancements in fabrication technologies, it is important to scale voltage and frequency intelligently; otherwise, DVFS techniques could result in a higher energy consumption. In our previous work, depending on the execution characteristics of real-time tasks, DVFS decisions were made using machine learning method in unicore processors. We also used learning-based approach to select the best real-time DVFS technique for the situation from a set of techniques and proposed a framework that integrates the selection of various scheduling policies and the optimization of existing real-time DVFS techniques in multi-core processors. In this paper, we describe the design of the framework to make an effective learning-based DVFS system, and demonstrate the utility of the generalized learning-based framework using experiments on multi-core real-time systems for both synthetic tasks and benchmark tasks from real applications. Our findings show that the framework is computationally lightweight and effective in reducing energy consumption.

[1]  Wei Liu,et al.  Adaptive power management using reinforcement learning , 2009, 2009 IEEE/ACM International Conference on Computer-Aided Design - Digest of Technical Papers.

[2]  Binoy Ravindran,et al.  An experimental evaluation of real-time DVFS scheduling algorithms , 2012, SYSTOR '12.

[3]  Giuseppe Lipari,et al.  Minimizing CPU energy in real-time systems with discrete speed management , 2009, TECS.

[4]  Qiang Xu,et al.  Learning-based power management for multi-core processors via idle period manipulation , 2012, 17th Asia and South Pacific Design Automation Conference.

[5]  Heonshik Shin,et al.  Visual assessment of a real-time system design: a case study on a CNC controller , 1996, 17th IEEE Real-Time Systems Symposium.

[6]  Kang G. Shin,et al.  Real-time dynamic voltage scaling for low-power embedded operating systems , 2001, SOSP.

[7]  Luca Benini,et al.  Dynamic power management using adaptive learning tree , 1999, 1999 IEEE/ACM International Conference on Computer-Aided Design. Digest of Technical Papers (Cat. No.99CH37051).

[8]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[9]  Man Lin,et al.  A Framework for Learning Based DVFS Technique Selection and Frequency Scaling for Multi-core Real-Time Systems , 2015, 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems.

[10]  Sang Lyul Min,et al.  Dynamic voltage scaling algorithm for fixed-priority real-time systems using work-demand analysis , 2003, ISLPED '03.

[11]  Tajana Simunic,et al.  System-Level Power Management Using Online Learning , 2009, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[12]  Margaret Martonosi,et al.  Coordinated, distributed, formal energy management of chip multiprocessors , 2005, ISLPED '05. Proceedings of the 2005 International Symposium on Low Power Electronics and Design, 2005..

[13]  Christopher D. Gill,et al.  Real-Time Scheduling via Reinforcement Learning , 2010, UAI.

[14]  Rajesh K. Gupta,et al.  Leakage aware dynamic voltage scaling for real-time embedded systems , 2004, Proceedings. 41st Design Automation Conference, 2004..

[15]  Miodrag Potkonjak,et al.  Energy minimization for real-time systems with non-convex and discrete operation modes , 2009, 2009 Design, Automation & Test in Europe Conference & Exhibition.

[16]  Man Lin,et al.  Hybrid DVFS Scheduling for Real-Time Systems Based on Reinforcement Learning , 2017, IEEE Systems Journal.

[17]  Rami G. Melhem,et al.  Integrated CPU and l2 cache voltage scaling using machine learning , 2007, LCTES '07.

[18]  David B. Whalley,et al.  Parametric timing analysis and its application to dynamic voltage scaling , 2011, TECS.

[19]  Frank Bellosa,et al.  Process cruise control: event-driven clock scaling for dynamic power management , 2002, CASES '02.

[20]  Dakai Zhu,et al.  System-Level Energy Management for Periodic Real-Time Tasks , 2006, 2006 27th IEEE International Real-Time Systems Symposium (RTSS'06).

[21]  Cécile Belleudy,et al.  Hybrid power management in real time embedded systems: an interplay of DVFS and DPM techniques , 2011, Real-Time Systems.

[22]  Sang Lyul Min,et al.  Dynamic voltage scaling algorithm for dynamic-priority hard real-time systems using slack time analysis , 2002, Proceedings 2002 Design, Automation and Test in Europe Conference and Exhibition.

[23]  Moonju Park,et al.  A dual speed scheme for dynamic voltage scaling on real-time multiprocessor systems , 2014, The Journal of Supercomputing.

[24]  Tsung-Yi Wu,et al.  High Performance and Low Leakage Design Using Cell Replacement and Hybrid V t Standard Cell Libraries , 2008 .

[25]  Roy Chaoming Hsu,et al.  Adaptive Power Management Based on Reinforcement Learning for Embedded System , 2008, IEA/AIE.

[26]  Ying Tan,et al.  Achieving autonomous power management using reinforcement learning , 2013, TODE.

[27]  Qing Wu,et al.  An adaptive scheduling and voltage/frequency selection algorithm for real-time energy harvesting systems , 2009, 2009 46th ACM/IEEE Design Automation Conference.

[28]  Xiaodong Wu,et al.  Energy-Efficient Scheduling of Real-Time Periodic Tasks in Multicore Systems , 2010, NPC.

[29]  Wan Yeon Lee,et al.  Energy-Efficient Scheduling of Periodic Real-Time Tasks on Lightly Loaded Multicore Processors , 2012, IEEE Transactions on Parallel and Distributed Systems.

[30]  Tulika Mitra,et al.  Temperature aware task sequencing and voltage scaling , 2008, ICCAD 2008.

[31]  Tao Wang,et al.  Q-Learning Based Dynamic Voltage Scaling for Designs with Graceful Degradation , 2015, ISPD.

[32]  Joonwon Lee,et al.  Energy Efficient Scheduling of Real-Time Tasks on Multicore Processors , 2008, IEEE Transactions on Parallel and Distributed Systems.

[33]  Trevor Mudge,et al.  MiBench: A free, commercially representative embedded benchmark suite , 2001 .

[34]  Rami G. Melhem,et al.  Power-aware scheduling for periodic real-time tasks , 2004, IEEE Transactions on Computers.

[35]  Massoud Pedram,et al.  Supervised Learning Based Power Management for Multicore Processors , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[36]  Sang Lyul Min,et al.  Energy-centric DVFS controlling method for multi-core platforms , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[37]  Hao Shen,et al.  Learning based DVFS for simultaneous temperature, performance and energy management , 2012, Thirteenth International Symposium on Quality Electronic Design (ISQED).

[38]  Qinru Qiu,et al.  Introduction to the special section on adaptive power management for energy and temperature-aware computing systems , 2013, TODE.

[39]  Man Lin,et al.  Learning Based Power Management for Periodic Real-Time Tasks , 2014, 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS).

[40]  Shuai Li,et al.  Low-power scheduling with DVFS for common RTOS on multicore platforms , 2014, SIGBED.

[41]  Laurence T. Yang,et al.  Integrating the enriched feature with machine learning algorithms for human movement and fall detection , 2013, The Journal of Supercomputing.