Reinforcement Learning-Based Dynamic Power Management for Energy Harvesting Wireless Sensor Network

In this study, a dynamic power management method based on reinforcement learning is proposed to improve the energy utilization for energy harvesting wireless sensor networks. Simulations of the proposed method on wireless sensor nodes powered by solar power are performed. Experimental results demonstrate that the proposed method outperforms the other power management method in achieving longer sustainable operations for energy harvesting wireless sensor network.

[1]  Luca Benini,et al.  A survey of design techniques for system-level dynamic power management , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[2]  Allen C.-H. Wu,et al.  A predictive system shutdown method for energy saving of event-driven computation , 1997, ICCAD 1997.

[3]  Mani B. Srivastava,et al.  Design considerations for solar energy harvesting wireless embedded systems , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[4]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[5]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[6]  Chaitali Chakrabarti,et al.  Dynamic Power Management with Hybrid Power Sources , 2007, 2007 44th ACM/IEEE Design Automation Conference.

[7]  Luca Benini,et al.  Dynamic power management for nonstationary service requests , 1999, Design, Automation and Test in Europe Conference and Exhibition, 1999. Proceedings (Cat. No. PR00078).

[8]  Chang-Soo Kim,et al.  Energy management strategies of a fuel cell/battery hybrid system using fuzzy logics , 2005 .

[9]  Vijay Raghunathan,et al.  Design and Power Management of Energy Harvesting Embedded Systems , 2006, ISLPED'06 Proceedings of the 2006 International Symposium on Low Power Electronics and Design.

[10]  Pai H. Chou,et al.  Maximizing efficiency of solar-powered systems by load matching , 2004, Proceedings of the 2004 International Symposium on Low Power Electronics and Design (IEEE Cat. No.04TH8758).

[11]  Luca Benini,et al.  Adaptive Power Management in Energy Harvesting Systems , 2007, 2007 Design, Automation & Test in Europe Conference & Exhibition.

[12]  Luca Benini,et al.  Dynamic Power Management for Nonstationary Service Requests , 2002, IEEE Trans. Computers.

[13]  Mani B. Srivastava,et al.  Power management in energy harvesting sensor networks , 2007, TECS.

[14]  Luca Benini,et al.  Policy optimization for dynamic power management , 1999, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[15]  Massoud Pedram,et al.  Dynamic power management based on continuous-time Markov decision processes , 1999, DAC '99.

[16]  Mani B. Srivastava,et al.  Harvesting aware power management for sensor networks , 2006, 2006 43rd ACM/IEEE Design Automation Conference.