FQ-MEC: Fuzzy-Based Q-Learning Approach for Mobility-Aware Energy-Efficient Clustering in MANET

Different schemes have been proposed for increasing network lifetime in mobile ad hoc networks (MANETs) where nodes move uncertainly in any direction. Mobility awareness and energy efficiency are two inescapable optimization problems in such networks. Clustering is an important technique to improve scalability and network lifetime, as it relies on grouping mobile nodes into logical subgroups, called clusters, to facilitate network management. One of the challenging issues in this domain is to design a real-time routing protocol that efficiently prolongs the network lifetime in MANET. In this paper, a novel fuzzy-based Q-learning approach for mobility-aware energy-efficient clustering (FQMEC) is proposed that relies on deciding the behavioral pattern of the nodes based on their stability and residual energy. Also, Chebyshev’s inequality principle is applied to get node connectivity for load balancing by taking history from the monitoring phase to increase the learning accuracy. Extensive simulations are performed using the NS-2 network simulator, and the proposed scheme is compared with reinforcement learning (RL). The obtained results show the effectiveness of the proposed protocol regarding network lifetime, packet delivery ratio, average end-to-end delay, and energy consumption.

[1]  Soubhik Chakraborty,et al.  A new cipher system using semi-natural composition in Indian raga , 2020, Soft Comput..

[2]  Iain Murray,et al.  A Reinforcement Learning Approach to Enhance the Trust Level of MANETs , 2018, 2018 National Information Technology Conference (NITC).

[3]  Abdelfettah Belghith,et al.  A Node Quality based Clustering Algorithm in Wireless Mobile Ad Hoc Networks , 2014, ANT/SEIT.

[4]  Salim Chikhi,et al.  Routing in Mobile Ad-hoc Networks as a Reinforcement Learning Task , 2011, NDT.

[5]  Mehdi Dehghan,et al.  A Model-Based Reinforcement Learning Algorithm for Routing in Energy Harvesting Mobile Ad-Hoc Networks , 2017, Wirel. Pers. Commun..

[6]  Prasanta K. Jana,et al.  Genetic algorithm approach for k-coverage and m-connected node placement in target based wireless sensor networks , 2016, Comput. Electr. Eng..

[7]  Ali Ghaffari,et al.  Real-time routing algorithm for mobile ad hoc networks using reinforcement learning and heuristic algorithms , 2017, Wirel. Networks.

[8]  Amritanjali,et al.  Mobility Aware Energy Efficient Clustering for MANET: A Bio-Inspired Approach with Particle Swarm Optimization , 2017, Wirel. Commun. Mob. Comput..

[9]  Min Tong,et al.  Intelligent Routing Control for MANET Based on Reinforcement Learning , 2018 .

[11]  Fekher Khelifi,et al.  A new fuzzy logic based node localization mechanism for Wireless Sensor Networks , 2017, Future Gener. Comput. Syst..

[12]  Haifeng Jiang,et al.  Fuzzy-Logic-Based Energy Optimized Routing for Wireless Sensor Networks , 2013, Int. J. Distributed Sens. Networks.