Cooperative Radar and Communications Coexistence Using Reinforcement Learning

The growing population of radar and communications systems poses a challenge to spectral coexistence. In this preliminary study, we investigate the utility of reinforcement learning in facilitating cooperative radar and communications coexistence. We also highlight subtleties and challenges associated with employing reinforcement learning in this context. We simulate a small joint radar-communications network whose members communicate while tracking a moving target’s range. A network management system must learn how to distribute allotted bandwidth to jointly maximize communications and radar performance. Considering several constraints and assumptions in the simulation, the agent sensibly chooses actions that accomplish the required performance behavior.

[1]  Cheng Wu,et al.  Spectrum management of cognitive radio using multi-agent reinforcement learning , 2010, AAMAS.

[2]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[3]  Christian Sturm,et al.  Waveform Design and Signal Processing Aspects for Fusion of Wireless Communications and Radar Sensing , 2011, Proceedings of the IEEE.

[4]  Yuhong Yang Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[5]  Shabnam Sodagari,et al.  A projection based approach for radar and telecommunication systems coexistence , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[6]  Awais Khawar,et al.  Spectrum sharing between S-band radar and LTE cellular system: A spatial approach , 2014, 2014 IEEE International Symposium on Dynamic Spectrum Access Networks (DYSPAN).

[7]  Shannon D. Blunt,et al.  Radar Spectrum Engineering and Management: Technical and Regulatory Issues , 2015, Proceedings of the IEEE.

[8]  Bryan Paul,et al.  Inner Bounds on Performance of Radar and Communications Co-Existence , 2016, IEEE Transactions on Signal Processing.

[9]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[10]  Yuanwei Jin,et al.  Range and velocity estimation of radar targets by weighted OFDM modulation , 2014, 2014 IEEE Radar Conference.

[11]  François Gagnon,et al.  Performance of distributed multi-agent multi-state reinforcement spectrum management using different exploration schemes , 2013, Expert Syst. Appl..

[12]  Bryan Paul,et al.  Survey of RF Communications and Sensing Convergence Research , 2017, IEEE Access.

[13]  Daniel W. Bliss,et al.  Cooperative radar and communications signaling: The estimation and information theory odd couple , 2014, 2014 IEEE Radar Conference.

[14]  Chen Bing,et al.  Radar-Communication Integration Based on DSSS Techniques , 2006, 2006 8th international Conference on Signal Processing.