An Efficient and Reliable Routing Method for Hybrid Mobile Ad Hoc Networks Using Deep Reinforcement Learning

With the reliance of humans on mobile smart devices that have wireless communication, modules have significantly increased in recent years. Using these devices to communicate with the survivors during a disaster or its aftermath can significantly increase the chances of locating and saving them. Accordingly, a method is proposed in this study to extend the lifetime of the nodes in a Mobile Ad Hoc Network (MANET) while maintaining communications with the nearest base station (BS). Such a methodology allows the rapid establishment of temporary communications with these survivors, as restoring the complex infrastructure is a time-consuming process. The proposed method achieves the longer lifetime of the network by balancing the load throughout the nodes and avoids exhausting those with limited remaining energy. The proposed method has shown significant improvement in the lifetime of the MANET while maintaining similar Packet Delivery Rate (PDR) and route generation time, compared to existing methods.

[1]  Theyazn H. H. Aldhyani,et al.  An Integrated Model for Prediction of Loading Packets in Network Traffic , 2016, ICTCS '16.

[2]  Faustine Anthony,et al.  Open Source Cellular Technologies for Cost Effective Cellular Connectivity in Rural Areas , 2016 .

[3]  Kaveri Kadam,et al.  Application of machine learning (reinforcement learning) for routing in Wireless Sensor Networks (WSNs) , 2012, 2012 1st International Symposium on Physics and Technology of Sensors (ISPTS-1).

[4]  Ashlyn Antoo,et al.  Enhanced hybrid drive scheme for power saving in wireless ad-hoc networks , 2013, 2013 International Conference on Control Communication and Computing (ICCC).

[5]  Tom Schaul,et al.  Dueling Network Architectures for Deep Reinforcement Learning , 2015, ICML.

[6]  Yangmin Lee,et al.  Classification of node degree based on deep learning and routing method applied for virtual route assignment , 2017, Ad Hoc Networks.

[7]  Philippe Jacquet,et al.  Internet Engineering Task Force (ietf) the Optimized Link State Routing Protocol Version 2 , 2022 .

[8]  Rostislav Fojtik The Use of Mobile Devices in Education , 2017 .

[9]  Joseph Kee-Yin Ng,et al.  Cooperative Data Scheduling in Hybrid Vehicular Ad Hoc Networks: VANET as a Software Defined Network , 2016, IEEE/ACM Transactions on Networking.

[10]  Nyein Aye Maung Maung,et al.  Hybrid RSS-SOM localization scheme for wireless ad hoc and sensor networks , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[11]  Jon Legarda,et al.  Cross-over-net: An energy-aware coordination algorithm for WANETs based on software-defined networking , 2015, 2015 23rd International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[12]  Manish Joshi,et al.  A Review of Network Traffic Analysis and Prediction Techniques , 2015, ArXiv.

[13]  Husam Ibrahiem Alsaadi,et al.  Computational Intelligence Algorithms to Handle Dimensionality Reduction for Enhancing Intrusion Detection System , 2020, J. Inf. Sci. Eng..

[14]  Ahmed Jawad Kadhim,et al.  Multicast routing strategy for SDN-cluster based MANET , 2020 .

[15]  Zhang Li,et al.  A Wireless Ad Hoc Overlay Networks Indexing Mechanism Based on Petri Nets Theory , 2010, 2010 International Conference on Computational Aspects of Social Networks.

[16]  Yue Cao,et al.  A comprehensive survey on mobile data offloading in heterogeneous network , 2019, Wirel. Networks.

[17]  Zygmunt J. Haas,et al.  The zone routing protocol (zrp) for ad hoc networks" intemet draft , 2002 .

[18]  Prasant Mohapatra,et al.  QRON: QoS-aware routing in overlay networks , 2004, IEEE Journal on Selected Areas in Communications.

[19]  Konstantinos Poularakis,et al.  SDN-Enabled Tactical Ad Hoc Networks: Extending Programmable Control to the Edge , 2018, IEEE Communications Magazine.

[20]  Konstantinos Poularakis,et al.  Flexible SDN control in tactical ad hoc networks , 2019, Ad Hoc Networks.

[21]  Noor Zaman,et al.  Enhancing routing energy efficiency of Wireless Sensor Networks , 2015, 2015 17th International Conference on Advanced Communication Technology (ICACT).

[22]  Himadri Nath Saha,et al.  Energy efficient routing in mobile ad-hoc networks , 2015, 2015 International Conference and Workshop on Computing and Communication (IEMCON).

[23]  Xiaodai Dong,et al.  Cellular and WiFi Co-design for 5G User Equipment , 2018, 2018 IEEE 5G World Forum (5GWF).

[24]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[25]  Yingji Zhong Cross Layer Power Efficient Cooperative Diversity Scheme for Wireless Hybrid Ad Hoc Networks , 2010, 2010 Second International Conference on Communication Software and Networks.

[26]  Zhang Li,et al.  A Hybrid Routing Algorithm based on Overlay Network for Wireless Ad Hoc Network , 2012, 2012 International Conference on Industrial Control and Electronics Engineering.

[27]  Muhammad Sharif,et al.  Energy Consumption in Mobile Phones , 2017 .

[28]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[29]  Melfi Alrasheedi,et al.  Intelligent Hybrid Model to Enhance Time Series Models for Predicting Network Traffic , 2020, IEEE Access.

[30]  Arun Prakash,et al.  A hybrid wireless Ad-hoc network model for critical services , 2010, 2010 Sixth International conference on Wireless Communication and Sensor Networks.