Power optimization using Markov decision process based on multi-parameter constraint modeling

Power optimization based on intelligent algorithm draws more and more attention. This article presents a novel low power optimization strategy based on the high level software power management employing Markov Process for charactering the real running workload. This article formulates workload characterization and selection with stochastic process method, and solves the formula using dynamic voltage frequency scaling base on microprocessor. Based on Markov process, the multi-parameter constraints has been employed to exploit the optimization space. Comparing with existing power optimization algorithm, our proposed power optimization algorithm doesn't need any prior data and maintains a value function representing expected reward. As many hardware events can be effectively captured and modeled, this optimization technique is capable to explore an ideal tradeoff in the constraint space.

[1]  Jayant Baliga,et al.  Energy Consumption in Access Networks , 2008, OFC/NFOEC 2008 - 2008 Conference on Optical Fiber Communication/National Fiber Optic Engineers Conference.

[2]  Laurent Lefèvre,et al.  A survey on techniques for improving the energy efficiency of large-scale distributed systems , 2014, ACM Comput. Surv..

[3]  Kaustav Banerjee,et al.  Simultaneous optimization of supply and threshold voltages for low-power and high-performance circuits in the leakage dominant era , 2004, Proceedings. 41st Design Automation Conference, 2004..

[4]  Cécile Belleudy,et al.  Power Consumption Modeling for DVFS Exploitation , 2010, 2010 13th Euromicro Conference on Digital System Design: Architectures, Methods and Tools.

[5]  Frank Mueller,et al.  Feedback EDF Scheduling of Real-Time Tasks Exploiting Dynamic Voltage Scaling , 2005, Real-Time Systems.

[6]  Tajana Simunic,et al.  System-Level Power Management Using Online Learning , 2009, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[7]  Sudhanva Gurumurthi,et al.  Accelerating enterprise solid-state disks with non-volatile merge caching , 2010, International Conference on Green Computing.

[8]  Massoud Pedram,et al.  Dynamic Power Management under Uncertain Information , 2007, 2007 Design, Automation & Test in Europe Conference & Exhibition.

[9]  Paramvir Bahl,et al.  Somniloquy: Augmenting Network Interfaces to Reduce PC Energy Usage , 2009, NSDI.

[10]  Marco Polverini,et al.  A Survey on Energy-Aware Design and Operation of Core Networks , 2016, IEEE Communications Surveys & Tutorials.

[11]  Rajesh Gupta,et al.  SleepServer: A Software-Only Approach for Reducing the Energy Consumption of PCs within Enterprise Environments , 2010, USENIX Annual Technical Conference.

[12]  Ben H. H. Juurlink,et al.  Leakage-aware multiprocessor scheduling for low power , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.