Deep Reinforcement Learning Methods for Energy-Efficient Underwater Wireless Networking

The wireless sensor networks have been developed and extended to more expanded environments, and the underwater environment needs to develop more applications in different fields, such as sea animals monitoring, predict the natural disasters, and data exchanging between underwater and ground environments. The underwater environment has almost the same infrastructure and functions with ground environment with some limitations, such as processing, communications, and battery limits. In terms of battery limits, many techniques have been proposed; in this chapter, the authors will focus in deep reinforcement learning techniques.

[1]  Yunyoung Nam,et al.  Underwater Wireless Sensor Networks: A Review of Recent Issues and Challenges , 2019, Wirel. Commun. Mob. Comput..

[2]  Fang Zhu,et al.  An Energy Efficient Routing Protocol Based on Layers and Unequal Clusters in Underwater Wireless Sensor Networks , 2018, J. Sensors.

[3]  Damla Turgut,et al.  Path Finding for Maximum Value of Information in Multi-Modal Underwater Wireless Sensor Networks , 2018, IEEE Transactions on Mobile Computing.

[4]  Zhigang Jin,et al.  A Q-Learning-Based Delay-Aware Routing Algorithm to Extend the Lifetime of Underwater Sensor Networks , 2017, Sensors.

[5]  Peng Xie,et al.  VBF: Vector-Based Forwarding Protocol for Underwater Sensor Networks , 2006, Networking.

[6]  Cherry Wakayama,et al.  Utilizing kinematics and selective sweeping in reinforcement learning-based routing algorithms for underwater networks , 2015, Ad Hoc Networks.

[7]  Stefano Basagni,et al.  Finding MARLIN: Exploiting multi-modal communications for reliable and low-latency underwater networking , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[8]  M. Dosaranian-Moghadam,et al.  Energy Efficiency and Reliability in Underwater Wireless Sensor Networks Using Cuckoo Optimizer Algorithm , 2018 .

[9]  Samy S. Abu-Naser,et al.  The Availability of the Focus Standards on Human Resources and Processes as a Potential for Excellence in Palestinian Universities According to the European Model , 2018 .

[10]  Yunsi Fei,et al.  QELAR: A Machine-Learning-Based Adaptive Routing Protocol for Energy-Efficient and Lifetime-Extended Underwater Sensor Networks , 2010, IEEE Transactions on Mobile Computing.