Erratum to: MRL-SCSO: Multi-agent Reinforcement Learning-Based Self-Configuration and Self-Optimization Protocol for Unattended Wireless Sensor Networks

Resource-constrained nodes in unattended wireless sensor network (UWSN) operate in a hostile environment with less human intervention. Achieving the optimal quality of service (QoS) in terms of packet delivery ratio, delay, energy, and throughput is crucial. In this paper, we propose a topology control and data dissemination protocol that uses multi-agent reinforcement learning (MRL) and energy-aware convex-hull algorithm, for effective self-configuration and self-optimization (SCSO) in UWSN, called MRL-SCSO. MRL-SCSO maintains a reliable topology in which the effective active neighbor nodes are selected using MRL. The network boundary is determined using convex-hull algorithm to maintain the connectivity and coverage of the network. The boundary nodes transmit data under high traffic load conditions. The performance of MRL-SCSO is evaluated for various nodes count and under different load conditions by using the Contiki’s Cooja simulator. The results showed that MRL-SCSO stabilizes the performance and improves QoS.

[1]  Mo Li,et al.  A Survey on Topology Control in Wireless Sensor Networks: Taxonomy, Comparative Study, and Open Issues , 2013, Proc. IEEE.

[2]  Geng Wu,et al.  M2M: From mobile to embedded internet , 2011, IEEE Communications Magazine.

[3]  Salim Hariri,et al.  The Autonomic Computing Paradigm , 2006, Cluster Computing.

[4]  Y. A. Sekercioglu,et al.  A distributed topology control method for improving energy efficiency of wireless sensor networks , 2012, 2012 4th International Conference on Intelligent and Advanced Systems (ICIAS2012).

[5]  Ivan Stojmenovic,et al.  On calculating power-aware connected dominating sets for efficient routing in ad hoc wireless networks , 2002, J. Commun. Networks.

[6]  Peng Jiang,et al.  Research on Wireless Sensor Networks Routing Protocol for Wetland Water Environment Monitoring , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[7]  Renjie Huang,et al.  Real-World Sensor Network for Long-Term Volcano Monitoring: Design and Findings , 2012, IEEE Transactions on Parallel and Distributed Systems.

[8]  David E. Culler,et al.  Telos: enabling ultra-low power wireless research , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[9]  Yang Yang,et al.  Reinforcement learning based spectrum-aware routing in multi-hop cognitive radio networks , 2009, 2009 4th International Conference on Cognitive Radio Oriented Wireless Networks and Communications.

[10]  Mitsuo Gen,et al.  Genetic algorithms and engineering optimization , 1999 .

[11]  Anna Förster Machine Learning Techniques Applied to Wireless Ad-Hoc Networks: Guide and Survey , 2007 .

[12]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[13]  Ronghua Xu,et al.  A Convex Hull Based Optimization to Reduce the Data Delivery Latency of the Mobile Elements in Wireless Sensor Networks , 2013, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing.

[14]  Adam Dunkels,et al.  An adaptive communication architecture for wireless sensor networks , 2007, SenSys '07.

[15]  Chunming Qiao,et al.  Medium access control with a dynamic duty cycle for sensor networks , 2004, 2004 IEEE Wireless Communications and Networking Conference (IEEE Cat. No.04TH8733).

[16]  Mohamed F. Younis,et al.  Connectivity restoration in a partitioned wireless sensor network with assured fault tolerance , 2015, Ad Hoc Networks.

[17]  Deborah Estrin,et al.  Geography-informed energy conservation for Ad Hoc routing , 2001, MobiCom '01.

[18]  Deborah Estrin,et al.  Statistical model of lossy links in wireless sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[19]  Konrad Wrona,et al.  Wireless Sensor Networks for Military Purposes , 2012 .

[20]  Elif Uysal-Biyikoglu,et al.  Measurement and characterization of link quality metrics in energy constrained wireless sensor networks , 2003, GLOBECOM '03. IEEE Global Telecommunications Conference (IEEE Cat. No.03CH37489).

[21]  Koen Langendoen,et al.  An adaptive energy-efficient MAC protocol for wireless sensor networks , 2003, SenSys '03.

[22]  David E. Culler,et al.  Versatile low power media access for wireless sensor networks , 2004, SenSys '04.

[23]  Katia Obraczka,et al.  Energy-Efficient, Collision-Free Medium Access Control for Wireless Sensor Networks , 2006 .

[24]  Sudip Misra,et al.  Policy controlled self-configuration in unattended wireless sensor networks , 2011, J. Netw. Comput. Appl..

[25]  Mani Srivastava,et al.  Energy efficient routing in wireless sensor networks , 2001, 2001 MILCOM Proceedings Communications for Network-Centric Operations: Creating the Information Force (Cat. No.01CH37277).

[26]  Y. Ahmet Sekercioglu,et al.  A Survey on Distributed Topology Control Techniques for Extending the Lifetime of Battery Powered Wireless Sensor Networks , 2013, IEEE Communications Surveys & Tutorials.

[27]  Eric Anderson,et al.  X-MAC: a short preamble MAC protocol for duty-cycled wireless sensor networks , 2006, SenSys '06.

[28]  Anis Koubaa,et al.  Radio link quality estimation in wireless sensor networks , 2012, ACM Trans. Sens. Networks.

[29]  Jiannong Cao,et al.  Distributed Topological Convex Hull Estimation of Event Region in Wireless Sensor Networks without Location Information , 2015, IEEE Transactions on Parallel and Distributed Systems.

[30]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[31]  Robert Tappan Morris,et al.  a high-throughput path metric for multi-hop wireless routing , 2003, MobiCom '03.

[32]  Renjie Huang,et al.  Air-dropped sensor network for real-time high-fidelity volcano monitoring , 2009, MobiSys '09.

[33]  Xiaohua Jia,et al.  Energy efficient distributed connected dominating sets construction in wireless sensor networks , 2006, IWCMC '06.

[34]  Deborah Estrin,et al.  An energy-efficient MAC protocol for wireless sensor networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[35]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[36]  Thomas H. Cormen,et al.  Introduction to algorithms [2nd ed.] , 2001 .

[37]  Mohamed F. Younis,et al.  Bio-Inspired Relay Node Placement Heuristics for Repairing Damaged Wireless Sensor Networks , 2011, IEEE Transactions on Vehicular Technology.

[38]  Adam Dunkels,et al.  Accurate Network-Scale Power Profiling for Sensor Network Simulators , 2009, EWSN.

[39]  P. Pardalos,et al.  Handbook of Combinatorial Optimization , 1998 .

[40]  Hwee Pink Tan,et al.  Survey on wakeup scheduling for environmentally-powered wireless sensor networks , 2014, Comput. Commun..

[41]  S. Chandrakala,et al.  Survey on state scheduling-based topology control in unattended wireless sensor networks , 2016, Comput. Electr. Eng..

[42]  Adam Dunkels,et al.  Software-based on-line energy estimation for sensor nodes , 2007, EmNets '07.

[43]  Songwu Lu,et al.  PEAS: a robust energy conserving protocol for long-lived sensor networks , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[44]  Bruce H. Krogh,et al.  Energy-efficient surveillance system using wireless sensor networks , 2004, MobiSys '04.

[45]  Rajesh K. Gupta,et al.  Path Planning of Data Mules in Sensor Networks , 2011, TOSN.

[46]  Deborah Estrin,et al.  ASCENT : Adaptive Self-Configuring sEnsor Networks Topologies . , 2002 .

[47]  Philip Levis,et al.  Collection tree protocol , 2009, SenSys '09.

[48]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[49]  Xin-Ping Guan,et al.  Topology control based on optimally rigid graph in wireless sensor networks , 2013, Comput. Networks.