An adaptive learning scheme for load balancing with zone partition in multi-sink wireless sensor network

Highlights? We propose an adaptive learning scheme for load balancing scheme in multi-sink WSN. ? The mobile anchor adaptively partitions the network into several zones. ? The agent learns to balance the load in the way of reallocate the collection zones. ?The agent applies the residual energy of hotspots around sink nodes. ?The proposed QAZP scheme prolongs the lifetime of the wireless sensor network. In many researches on load balancing in multi-sink WSN, sensors usually choose the nearest sink as destination for sending data. However, in WSN, events often occur in specific area. If all sensors in this area all follow the nearest-sink strategy, sensors around nearest sink called hotspot will exhaust energy early. It means that this sink is isolated from network early and numbers of routing paths are broken. In this paper, we propose an adaptive learning scheme for load balancing scheme in multi-sink WSN. The agent in a centralized mobile anchor with directional antenna is introduced to adaptively partition the network into several zones according to the residual energy of hotspots around sink nodes. In addition, machine learning is applied to the mobile anchor to make it adaptable to any traffic pattern. Through interactions with the environment, the agent can discovery a near-optimal control policy for movement of mobile anchor. The policy can achieve minimization of residual energy's variance among sinks, which prevent the early isolation of sink and prolong the network lifetime.

[1]  Steven Fortune,et al.  Voronoi Diagrams and Delaunay Triangulations , 2004, Handbook of Discrete and Computational Geometry, 2nd Ed..

[2]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[3]  A. Forster,et al.  Machine Learning Techniques Applied to Wireless Ad-Hoc Networks: Guide and Survey , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[4]  Andreas Klappenecker,et al.  Energy efficient data management for wireless sensor networks with data sink failure , 2005, IEEE International Conference on Mobile Adhoc and Sensor Systems Conference, 2005..

[5]  Masayuki Murata,et al.  Self-Organized Data-Gathering Scheme for Multi-Sink Sensor Networks Inspired by Swarm Intelligence , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[6]  Yunyue Lin,et al.  Energy-Conserving Dynamic Routing in Multi-sink Heterogeneous Sensor Networks , 2010, 2010 International Conference on Communications and Mobile Computing.

[7]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[8]  M. Soyturk,et al.  A Novel Stateless Energy-Efficient Routing Algorithm for Large-Scale Wireless Sensor Networks with Multiple Sinks , 2006, 2006 IEEE Annual Wireless and Microwave Technology Conference.

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Anna Förster.  Machine Learning Techniques Applied to Wireless Ad-Hoc Networks: Guide and Survey , 2007 .

[11]  A. Yildiz,et al.  An Approach to a Real World Dynamic Route Guidance Problem , 2007 .

[12]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[13]  U. Rieder,et al.  Markov Decision Processes , 2010 .

[14]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[15]  Min Meng,et al.  Energy Efficient Routing in Multiple Sink Sensor Networks , 2007 .

[16]  Young-Koo Lee,et al.  Energy Efficient Routing in Multiple Sink Sensor Networks , 2007, 2007 International Conference on Computational Science and its Applications (ICCSA 2007).

[17]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[18]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[19]  Takashi Watanabe,et al.  DispersiveCast: Dispersive Packets Transmission to Multiple sinks for Energy Saving in Sensor Networks , 2006, 2006 IEEE 17th International Symposium on Personal, Indoor and Mobile Radio Communications.

[20]  Wei Wu,et al.  A Load-Balance Routing Algorithm for Multi-Sink Wireless Sensor Networks , 2009, 2009 International Conference on Communication Software and Networks.

[21]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..