A bird's eye view on reinforcement learning approaches for power management in WSNs

This paper presents a survey on the adoption of Reinforcement Learning (RL) approaches for power management in Wireless Sensor Networks (WSNs). The survey has been carried out after a review expressly focused on the most relevant and the most recent contributions for the topic. Moreover, the analysis encompassed proposals at every methodological level, from dynamic power management to adaptive autonomous middleware, from self learning scheduling to energy efficient routing protocols.

[1]  Amy L. Murphy,et al.  An Efficient Implementation of Reinforcement Learning Based Routing on Real WSN Hardware , 2008, 2008 IEEE International Conference on Wireless and Mobile Computing, Networking and Communications.

[2]  Amy L. Murphy,et al.  Froms: A failure tolerant and mobility enabled multicast routing paradigm with reinforcement learning for WSNs , 2011, Ad Hoc Networks.

[3]  Mario Di Francesco,et al.  Energy conservation in wireless sensor networks: A survey , 2009, Ad Hoc Networks.

[4]  Zhenzhen Liu,et al.  RL-MAC: a reinforcement learning based MAC protocol for wireless sensor networks , 2006, Int. J. Sens. Networks.

[5]  Ann Nowé,et al.  Reinforcement Learning for Self-organizing Wake-Up Scheduling in Wireless Sensor Networks , 2011, ICAART.

[6]  Kok-Lim Alvin Yau,et al.  Reinforcement learning for context awareness and intelligence in wireless networks: Review, new features and open issues , 2012, J. Netw. Comput. Appl..

[7]  Zhenzhen Liu,et al.  RL-MAC: A QoS-Aware Reinforcement Learning based MAC Protocol for Wireless Sensor Networks , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[8]  Bernhard Rinner,et al.  Resource coordination in wireless sensor networks by cooperative reinforcement learning , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications Workshops.

[9]  Curt Schurgers,et al.  Wakeup Strategies in Wireless Sensor Networks , 2008 .

[10]  Mohan Kumar,et al.  Reinforcement learning based strategies for adaptive wireless sensor network management , 2010 .

[11]  Jianjun Niu,et al.  Self-learning scheduling approach for wireless sensor network , 2010, 2010 2nd International Conference on Future Computer and Communication.

[12]  A. Forstert,et al.  FROMS: Feedback Routing for Optimizing Multiple Sinks in WSN with Reinforcement Learning , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[13]  Anna Förster,et al.  Balancing Energy Expenditure in WSNs through Reinforcement Learning: A Study , 2008 .

[14]  Ganesh K. Venayagamoorthy,et al.  Computational Intelligence in Wireless Sensor Networks: A Survey , 2011, IEEE Communications Surveys & Tutorials.

[15]  Kuan-Chieh Wang,et al.  QoS-Aware Power Management for Energy Harvesting Wireless Sensor Network Utilizing Reinforcement Learning , 2009, 2009 International Conference on Computational Science and Engineering.

[16]  Ann Nowé,et al.  Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks , 2012, Int. J. Commun. Networks Distributed Syst..

[17]  Roy Chaoming Hsu,et al.  Adaptive Power Management Based on Reinforcement Learning for Embedded System , 2008, IEA/AIE.

[18]  Mohan Kumar,et al.  Distributed Independent Reinforcement Learning (DIRL) Approach to Resource Management in Wireless Sensor Networks , 2007, 2007 IEEE Internatonal Conference on Mobile Adhoc and Sensor Systems.

[19]  Krishna M. Sivalingam,et al.  Reinforcement Learning Based Geographic Routing Protocol for UWB Wireless Sensor Network , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[20]  Ann Nowé,et al.  Self-organizing Synchronicity and Desynchronicity using Reinforcement Learning , 2011, ICAART.

[21]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[22]  Ting Wang,et al.  Adaptive Routing for Sensor Networks using Reinforcement Learning , 2006, The Sixth IEEE International Conference on Computer and Information Technology (CIT'06).

[23]  Kagan Tumer,et al.  Collective Intelligence, Data Routing and Braess' Paradox , 2002, J. Artif. Intell. Res..