Reinforcement Learning Based Energy Efficient Underwater Localization

Underwater localization with limited bandwidth and long propagation latency has to magnificently improve the localization accuracy and energy efficiency for applications such as resource reconnaissance and tactical monitoring. In this paper, we propose a reinforcement learning based energy efficient underwater localization scheme to improve the accuracy and energy efficiency, which depends on the two-way travel time of underwater acoustic signal and uses reinforcement learning to optimize the beacon selection policy without relying on the channel model between the beacon and the target. Simulation results based on the depth-dependent sound speed profile model verify the efficiency of the proposed scheme and provide the performance over existing time-based localization scheme.

[1]  Cailian Chen,et al.  Energy-Efficient Data Collection Over AUV-Assisted Underwater Acoustic Sensor Network , 2018, IEEE Systems Journal.

[2]  Jun Liu,et al.  Suave: Swarm underwater autonomous vehicle localization , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[3]  Fumiyuki Adachi,et al.  Deep Reinforcement Learning for UAV Navigation Through Massive MIMO Technique , 2019, IEEE Transactions on Vehicular Technology.

[4]  Geert Leus,et al.  Target Localization and Tracking for an Isogradient Sound Speed Profile , 2013, IEEE Transactions on Signal Processing.

[5]  Yunsi Fei,et al.  QELAR: A Machine-Learning-Based Adaptive Routing Protocol for Energy-Efficient and Lifetime-Extended Underwater Sensor Networks , 2010, IEEE Transactions on Mobile Computing.

[6]  Kaishun Wu,et al.  Localization for Drifting Restricted Floating Ocean Sensor Networks , 2016, IEEE Transactions on Vehicular Technology.

[7]  Xu Bo,et al.  Cooperative Localisation of AUVs based on Huber-based Robust Algorithm and Adaptive Noise Estimation , 2019 .

[8]  Xinping Guan,et al.  AUV-Aided Localization for Internet of Underwater Things: A Reinforcement-Learning-Based Method , 2020, IEEE Internet of Things Journal.

[9]  Liang Xiao,et al.  Cloud-Based Malware Detection Game for Mobile Devices with Offloading , 2017, IEEE Transactions on Mobile Computing.

[10]  Stefano Basagni,et al.  Finding MARLIN: Exploiting multi-modal communications for reliable and low-latency underwater networking , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[11]  H. Vincent Poor,et al.  Asymmetrical Round Trip Based Synchronization-Free Localization in Large-Scale Underwater Sensor Networks , 2010, IEEE Transactions on Wireless Communications.

[12]  Xiaoning Zhang,et al.  Asynchronous Localization With Mobility Prediction for Underwater Acoustic Sensor Networks , 2018, IEEE Transactions on Vehicular Technology.

[13]  Yiming Pi,et al.  TDoA for Passive Localization: Underwater versus Terrestrial Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[14]  Zeshen Tang,et al.  Localization and Tracking for AUVs in Marine Information Networks: Research Directions, Recent Advances, and Challenges , 2019, IEEE Network.