Quality of service based radar resource management using deep reinforcement learning

An intelligent radar resource management is an essential milestone in the development of a cognitive radar system. The quality of service based resource allocation model (Q-RAM) is a framework allowing for intelligent decision making but classical solutions seem insufficient for real-time application in a modern radar system. In this paper, we present a solution for the Q-RAM radar resource management problem using deep reinforcement learning considerably improving on runtime performance.

[1]  John P. Lehoczky,et al.  Integrated QoS-aware resource management and scheduling with multi-resource constraints , 2006, Real-Time Systems.

[2]  Liu Hongwei,et al.  Reinforcement Learning based Anti-jamming Frequency Hopping Strategies Design for Cognitive Radar , 2018, 2018 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC).

[3]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[4]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  Chen Lee,et al.  An Approach for Quality of Service Management , 1998 .

[7]  Daniel P. Siewiorek,et al.  On quality of service optimization with discrete QoS options , 1999, Proceedings of the Fifth IEEE Real-Time Technology and Applications Symposium.

[8]  Branka Vucetic,et al.  Deep Learning for Radio Resource Allocation With Diverse Quality-of-Service Requirements in 5G , 2020, IEEE Transactions on Wireless Communications.

[9]  Serkan Ak,et al.  Avoiding Jammers: A Reinforcement Learning Approach , 2019, 2020 IEEE International Radar Conference (RADAR).

[10]  Daniel P. Siewiorek,et al.  A resource allocation model for QoS management , 1997, Proceedings Real-Time Systems Symposium.

[11]  Srikanth Kandula,et al.  Resource Management with Deep Reinforcement Learning , 2016, HotNets.

[12]  Fulvio Gini,et al.  Reinforcement Learning based Beamforming for Massive MIMO Radar Multi-target Detection , 2020, ArXiv.

[13]  Richard Evans,et al.  Deep Reinforcement Learning in Large Discrete Action Spaces , 2015, 1512.07679.

[14]  Raviraj S. Adve,et al.  Multifunction Cognitive Radar Task Scheduling Using Monte Carlo Tree Search and Policy Networks , 2018, IET Radar, Sonar & Navigation.

[15]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[16]  Tianyao Huang,et al.  Cognitive Radar Using Reinforcement Learning in Automotive Applications , 2019, 1904.10739.

[17]  Richard F. Lyon,et al.  Neural Networks for Machine Learning , 2017 .

[18]  S. Haykin,et al.  Cognitive radar: a way of the future , 2006, IEEE Signal Processing Magazine.

[19]  Alexander Charlish,et al.  Autonomous agents for multi-function radar resource management , 2011 .

[20]  Parul Parashar,et al.  Neural Networks in Machine Learning , 2014 .