Optimal Wireless Charging Inclusive of Intellectual Routing Based on SARSA Learning in Renewable Wireless Sensor Networks

The next generation’s sensor nodes will be more intelligent, energy conservative, and perpetual lifetime in the set-up of wireless sensor networks (WSNs). These sensors nodes are facing the overwhelming challenge of energy consumption which gradually decreases the lifetime of overall network. The wireless power transfer (WPT) is one of the most emerging technologies of energy harvesting that deploys at the heart of sensor nodes for efficient lifetime solution. A wireless portable charging device (WPCD) is drifting inside the WSN to recharge all the nodes which are questing for the eternal life. In this paper, we aspire to optimize a multi-objective function for charging trail of WPCD, and self-learning algorithm for data routing jointly. We formulated that the objective functions can optimize the fair energy consumption as well as maximize the routing efficiency of WPCD. The fundamental challenge of the problem is, to integrate the novel path for WPCD by applying the Nodal A* algorithm. We proposed a novel method of sensor node’s training for intellectual data transmission by using of clustering and reinforcement learning (SARSA) defined as clustering SARSA (C-SARSA) along with an optimal solution of objective functions. The whole mechanism outperforms in terms of trade-off between energy consumption and stability (fair energy consumption among all nodes) of the WSN; moreover, it prolongs the lifetime of the WSN. The simulated results demonstrate that our proposed method did better than compared literature in terms of energy consumption, stability, and lifetime of the WSN.

[1]  Prasun Sinha,et al.  Joint Energy Management and Resource Allocation in Rechargeable Sensor Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[2]  Wei-Kuan Shih,et al.  Extending sensor network lifetime via wireless charging vehicle with an efficient routing protocol , 2016, SoutheastCon 2016.

[3]  Xiaojun Cao,et al.  Ubiquitous WSN for Healthcare: Recent Advances and Future Prospects , 2014, IEEE Internet of Things Journal.

[4]  Mohamed Hassan,et al.  Wireless power transfer (Wireless lighting) , 2015, 2015 5th International Conference on Information & Communication Technology and Accessibility (ICTA).

[5]  Daji Qiao,et al.  Prolonging Sensor Network Lifetime Through Wireless Charging , 2010, 2010 31st IEEE Real-Time Systems Symposium.

[6]  Martijn Warnier,et al.  Green Wireless Power Transfer Networks , 2015, IEEE Journal on Selected Areas in Communications.

[7]  Weiming Shen,et al.  Agent-Oriented Cooperative Smart Objects: From IoT System Design to Implementation , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Sangman Moh,et al.  An Energy-Efficient Topology Control Algorithm Based on Reinforcement Learning for Wireless Sensor Networks , 2017 .

[9]  Cong Wang,et al.  Wireless Rechargeable Sensor Networks , 2015, SpringerBriefs in Electrical and Computer Engineering.

[10]  Ganesh K. Venayagamoorthy,et al.  Computational Intelligence in Wireless Sensor Networks: A Survey , 2011, IEEE Communications Surveys & Tutorials.

[11]  Jing Gong,et al.  ZigBee WSN Applied in Intelligent Monitoring Systems of Agricultural Environment , 2017 .

[12]  David Linden,et al.  Linden's Handbook of Batteries , 2010 .

[13]  Nelofar Aslam,et al.  Energy-Aware Adaptive Weighted Grid Clustering Algorithm for Renewable Wireless Sensor Networks , 2017, Future Internet.

[14]  Naser Khosro Pour,et al.  Fully Integrated Solar Energy Harvester and Sensor Interface Circuits for Energy-Efficient Wireless Sensing Applications , 2013 .

[15]  Yuanyuan Yang,et al.  A Framework of Joint Mobile Energy Replenishment and Data Gathering in Wireless Rechargeable Sensor Networks , 2014, IEEE Transactions on Mobile Computing.

[16]  Cong Wang,et al.  NETWRAP: An NDN Based Real-TimeWireless Recharging Framework for Wireless Sensor Networks , 2014, IEEE Transactions on Mobile Computing.

[17]  Xianghua Xu,et al.  A Study on Wireless Charging for Prolonging the Lifetime of Wireless Sensor Networks , 2017, Sensors.

[18]  Dong Han,et al.  The dynamic routing algorithm for renewable wireless sensor networks with wireless power transfer , 2014, Comput. Networks.

[19]  Raúl Santos-Rodríguez,et al.  Energy Efficiency in Reinforcement Learning for Wireless Sensor Networks , 2018, ArXiv.

[20]  M. Soljačić,et al.  Simultaneous mid-range power transfer to multiple devices , 2010 .

[21]  Diego S. Benítez,et al.  Determining the Main CSMA Parameters for Adequate Performance of WSN for Real-Time Volcano Monitoring System Applications , 2017, IEEE Sensors Journal.

[22]  M. Soljačić,et al.  Wireless Power Transfer via Strongly Coupled Magnetic Resonances , 2007, Science.

[23]  Jianping Pan,et al.  ESync: Energy Synchronized Mobile Charging in Rechargeable Wireless Sensor Networks , 2016, IEEE Transactions on Vehicular Technology.

[24]  Chaitanya Vijaykumar Mahamuni,et al.  A military surveillance system based on wireless sensor networks with extended coverage life , 2016, 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC).

[25]  Juan-Carlos Cano,et al.  Power-aware routing based on the energy drain rate for mobile ad hoc networks , 2002, Proceedings. Eleventh International Conference on Computer Communications and Networks.

[26]  Cristian Rotariu,et al.  A wireless sensor network for remote monitoring of bioimpedance , 2015, 2015 38th International Spring Seminar on Electronics Technology (ISSE).

[27]  Weifa Liang,et al.  Efficient Scheduling of Multiple Mobile Chargers for Wireless Sensor Networks , 2016, IEEE Transactions on Vehicular Technology.

[28]  Farid Ullah Khan,et al.  Electromagnetic based acoustic energy harvester for low power wireless autonomous sensor applications , 2018 .

[29]  Nelofar Aslam,et al.  Adaptive TCP-ICCW Congestion Control Mechanism for QoS in Renewable Wireless Sensor Networks , 2017, IEEE Sensors Letters.

[30]  Kok-Lim Alvin Yau,et al.  Application of reinforcement learning to wireless sensor networks: models and algorithms , 2014, Computing.

[31]  Olav N. Østerbø,et al.  RF Energy Harvesting and Information Transmission Based on NOMA for Wireless Powered IoT Relay Systems , 2018, Sensors.

[32]  Sherali Zeadally,et al.  Performance Evaluation of Energy-Autonomous Sensors Using Power-Harvesting Beacons for Environmental Monitoring in Internet of Things (IoT) , 2018, Sensors.

[33]  Antonio Lázaro,et al.  A Survey of NFC Sensors Based on Energy Harvesting for IoT Applications , 2018, Sensors.

[34]  D. PraveenKumar,et al.  Machine learning algorithms for wireless sensor networks: A survey , 2019, Inf. Fusion.

[35]  Ibrahim Khalil,et al.  A Novel Congestion Avoidance Technique for Simultaneous Real-Time Medical Data Transmission , 2016, IEEE Journal of Biomedical and Health Informatics.

[36]  Tran Duc Chung,et al.  Solar Energy Harvester for Industrial Wireless Sensor Nodes , 2017 .

[37]  Antonio Liotta,et al.  Self-Learning Power Control in Wireless Sensor Networks , 2018, Sensors.

[38]  Giancarlo Fortino,et al.  WSNs-assisted opportunistic network for low-latency message forwarding in sparse settings , 2019, Future Gener. Comput. Syst..