Enhanced Route Discovery Mechanism Using Improved CH Selection Using Q-Learning to Minimize Delay

With the technological advancements, practical challenges of establishing long-distance communication should be addressed using hop-oriented routing networks. However, long-distance data transmissions usually deteriorate the quality of service (QoS) especially in terms of considerable communication delay. Therefore, in the presented work, a reward-based routing mechanism is proposed that aims at minimizing the overall delay which is evaluated under various scenarios. The routing process involved a refined CH selection mechanism based on a mathematical model until a threshold simulation is not attained. The illustrations for the coverage calculations of CH in the route discovery are also provided for possible routes between the source and the destination to deliver quality service. Based on this information, the data gathered from the past simulations is passed to the learning mechanism using the Q-learning model. The work is evaluated in terms of throughput, PDR, and first dead node in order to achieve minimal transmission delay. Furthermore, area variation is also involved to investigate the effect of an increase in the deployment area and number of nodes on a Q-learning-based mechanism aimed to minimize the delay. The comparative analysis against four existing studies justifies the success of the proposed mechanism in terms of throughput, first dead node, and delay analysis.

[1]  Mohammad Shabaz,et al.  Design and implementation of intelligent monitoring system for platform security gate based on wireless communication technology using ML , 2021, International Journal of System Assurance Engineering and Management.

[2]  Mohammad Shabaz,et al.  Taxonomy of Adaptive Neuro-Fuzzy Inference System in Modern Engineering Sciences , 2021, Comput. Intell. Neurosci..

[3]  Chaya Shivalingegowda,et al.  Rendezvous points based energy-aware routing using hybrid neural network for mobile sink in wireless sensor networks , 2021, Wireless Networks.

[4]  Chongjie Zhang,et al.  Towards Understanding Cooperative Multi-Agent Q-Learning with Value Factorization , 2020, NeurIPS.

[5]  Revathi Venkataraman,et al.  EUCOR: An Efficient Unequal Clustering and Optimal Routing in wireless sensor networks for energy conservation , 2021, J. Intell. Fuzzy Syst..

[6]  D. Sridharan,et al.  A performance overview of contemporary hierarchical clustering algorithms in wireless sensor networks , 2021, Int. J. Commun. Networks Distributed Syst..

[7]  Turki Ali Alghamdi,et al.  Energy efficient protocol in wireless sensor network: optimized cluster head selection model , 2020, Telecommunication Systems.

[8]  Byeong-Hee Roh,et al.  An Energy Proficient Load Balancing Routing Scheme for Wireless Sensor Networks to Maximize Their Lifespan in an Operational Environment , 2020, IEEE Access.

[9]  Janakiraman Sengathir,et al.  An Energy-Proficient Clustering-Inspired Routing Protocol using Improved Bkd-tree for Enhanced Node Stability and Network Lifetime in Wireless Sensor Networks , 2020, Int. J. Commun. Syst..

[10]  Paul Rodrigues,et al.  MOTCO: Multi-objective Taylor Crow Optimization Algorithm for Cluster Head Selection in Energy Aware Wireless Sensor Network , 2019, Mobile Networks and Applications.

[11]  Cairong Yan,et al.  Optimizing the lifetime of wireless sensor networks via reinforcement-learning-based routing , 2019, Int. J. Distributed Sens. Networks.

[12]  Baoqing Li,et al.  Machine-Learning-Based Parallel Genetic Algorithms for Multi-Objective Optimization in Ultra-Reliable Low-Latency WSNs , 2019, IEEE Access.

[13]  Jilong Li,et al.  A clustering based routing algorithm in IoT aware Wireless Mesh Networks , 2018, Sustainable Cities and Society.

[14]  Marc St-Hilaire,et al.  A Pareto optimization-based approach to clustering and routing in Wireless Sensor Networks , 2018, J. Netw. Comput. Appl..

[15]  K. Ilamathi,et al.  Intelligent computation techniques for optimization of the shortest path in an asynchronous network-on-chip , 2018, Cluster Computing.

[16]  Suchismita Chinara,et al.  Survivable Path Routing in WSN for IoT applications , 2018, Pervasive Mob. Comput..

[17]  Sariga Arjunan,et al.  Lifetime maximization of wireless sensor network using fuzzy based unequal clustering and ACO based routing hybrid protocol , 2017, Applied Intelligence.

[18]  Zhigang Jin,et al.  A Q-Learning-Based Delay-Aware Routing Algorithm to Extend the Lifetime of Underwater Sensor Networks , 2017, Sensors.

[19]  Yangmin Lee,et al.  Classification of node degree based on deep learning and routing method applied for virtual route assignment , 2017, Ad Hoc Networks.

[20]  Nadeem Javaid,et al.  A Balanced Energy Consuming and Hole Alleviating Algorithm for Wireless Sensor Networks , 2017, 2017 31st International Conference on Advanced Information Networking and Applications Workshops (WAINA).

[21]  Lajos Hanzo,et al.  A Survey of Multi-Objective Optimization in Wireless Sensor Networks: Metrics, Algorithms, and Open Problems , 2016, IEEE Communications Surveys & Tutorials.

[22]  Byungkyu Park,et al.  Route choice modeling with Support Vector Machine , 2017 .

[23]  Trong-Thua Huynh,et al.  Delay-constrained energy-efficient cluster-based multi-hop routing in wireless sensor networks , 2016, Journal of Communications and Networks.

[24]  Lawrence Wai-Choong Wong,et al.  Routing, power control and rate adaptation: A Q-learning-based cross-layer design , 2016, Comput. Networks.

[25]  Rajeev Kumar,et al.  Hybrid Swarm Intelligence Energy Efficient Clustered Routing Algorithm for Wireless Sensor Networks , 2016, J. Sensors.

[26]  Seema Bawa,et al.  Peer Clouds: A P2P-Based Resource Discovery Mechanism for the Intercloud , 2015, Int. J. Next Gener. Comput..

[27]  Yourong Chen,et al.  Lifetime Optimization Algorithm with Mobile Sink Nodes for Wireless Sensor Networks Based on Location Information , 2015, Int. J. Distributed Sens. Networks.

[28]  Xiaoping Wu,et al.  An Energy-Efficient Multipath Routing Algorithm Based on Ant Colony Optimization for Wireless Sensor Networks , 2015, Int. J. Distributed Sens. Networks.

[29]  J Levendovszky,et al.  Quality-of-service routing protocol for wireless sensor networks , 2015 .

[30]  Guangjie Han,et al.  A Comparative Study of Routing Protocols of Heterogeneous Wireless Sensor Networks , 2014, TheScientificWorldJournal.

[31]  Hwee Pink Tan,et al.  Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications , 2014, IEEE Communications Surveys & Tutorials.

[32]  B. Kaarthick,et al.  An Energy Efficient Data Gathering in Dense Mobile Wireless Sensor Networks , 2014 .

[33]  Vijanth S. Asirvadam,et al.  Accurate Delay Analysis in Prioritised Wireless Sensor Networks for Generalized Packet Arrival , 2014, IEEE Wireless Communications Letters.

[34]  Anna Förster,et al.  Machine Learning across the WSN Layers , 2011 .

[35]  Anna Foerster,et al.  Emerging Communications for Wireless Sensor Networks , 2011 .