Reinforcement Learning for a Novel Mobile Charging Strategy in Wireless Rechargeable Sensor Networks

The charging strategy for the mobile charger (MC) has been a hot research topic in wireless rechargeable sensor networks. We focus on the charging path for the MC, since the MC stops at each sensor node until the sensor node is fully charged. Most of the existing reports have designed optimization methods to obtain the charging path, with the target like minimizing the charging cost. However, the autonomous charging path planning for the MC in a changeable network is not taken into consideration. In this paper, Reinforcement Learning (RL) is introduced into the charging path planning for the MC in WRSNs. Considering the influences of the energy variation and the locations of the sensor nodes, a novel Charging Strategy in WRSNs based on RL (CSRL) is proposed so that the autonomy of the MC is improved. Simulation experiments show that CSRL can effectively prolong the lifetime of the network and improve the driving efficiency of the MC.

[1]  Zhipeng Cai,et al.  A Private and Efficient Mechanism for Data Uploading in Smart Cyber-Physical Systems , 2020, IEEE Transactions on Network Science and Engineering.

[2]  Yi Liang,et al.  Deep Learning Based Inference of Private Information Using Embedded Sensors in Smart Devices , 2018, IEEE Network.

[3]  Weifa Liang,et al.  Maintaining Large-Scale Rechargeable Sensor Networks Perpetually via Multiple Mobile Charging Vehicles , 2016, ACM Trans. Sens. Networks.

[4]  Hanif D. Sherali,et al.  On renewable sensor networks with wireless energy transfer , 2011, 2011 Proceedings IEEE INFOCOM.

[5]  Mohammad Hossein Anisi,et al.  MDP-Based Network Selection Scheme by Genetic Algorithm and Simulated Annealing for Vertical-Handover in Heterogeneous Wireless Networks , 2017, Wirel. Pers. Commun..

[6]  Kok-Lim Alvin Yau,et al.  Application of reinforcement learning to wireless sensor networks: models and algorithms , 2014, Computing.

[7]  Ian F. Akyildiz,et al.  A resource estimation and call admission algorithm for wireless multimedia networks using the shadow cluster concept , 1997, TNET.

[8]  M. Soljačić,et al.  Wireless Power Transfer via Strongly Coupled Magnetic Resonances , 2007, Science.

[9]  Jiming Chen,et al.  Optimal Charging in Wireless Rechargeable Sensor Networks , 2016, IEEE Transactions on Vehicular Technology.

[10]  Jianzhong Li,et al.  Exploring Connected Dominating Sets in Energy Harvest Networks , 2017, IEEE/ACM Transactions on Networking.

[11]  Weifa Liang,et al.  Approximation Algorithms for Charging Reward Maximization in Rechargeable Sensor Networks via a Mobile Charger , 2017, IEEE/ACM Transactions on Networking.

[12]  Yubo Yan,et al.  Optimal Recharging With Practical Considerations in Wireless Rechargeable Sensor Network , 2017, IEEE Access.

[13]  Jianzhong Li,et al.  Energy-Collision Aware Data Aggregation Scheduling for Energy Harvesting Sensor Networks , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[14]  Lei Shi,et al.  A Wireless Sensor Network Recharging Strategy by Balancing Lifespan of Sensor Nodes , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).