Convert Harm Into Benefit: A Coordination-Learning Based Dynamic Spectrum Anti-Jamming Approach

This paper mainly investigates the multi-user anti-jamming spectrum access problem. Using the idea of “converting harm into benefit,” the malicious jamming signals projected by the enemy are utilized by the users as the coordination signals to guide spectrum coordination. An “internal coordination-external confrontation” multi-user anti-jamming access game model is constructed, and the existence of Nash equilibrium (NE) as well as correlated equilibrium (CE) is demonstrated. A coordination-learning based anti-jamming spectrum access algorithm (CLASA) is designed to achieve the CE of the game. Simulation results show the convergence, and effectiveness of the proposed CLASA algorithm, and indicate that our approach can help users confront the malicious jammer, and coordinate internal spectrum access simultaneously without information exchange. Last but not least, the fairness of the proposed approach under different jamming attack patterns is analyzed, which illustrates that this approach provides fair anti-jamming spectrum access opportunities under complicated jamming pattern.

[1]  Liang Xiao,et al.  Jamming Games in Underwater Sensor Networks with Reinforcement Learning , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[2]  David B. Smith,et al.  Flexible Resource Allocation in Device-to-Device Communications Using Stackelberg Game Theory , 2019, IEEE Transactions on Communications.

[3]  Dong In Kim,et al.  Stackelberg Game for Distributed Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks , 2018, IEEE Transactions on Wireless Communications.

[4]  Symeon Papavassiliou,et al.  Exploiting prospect theory and risk-awareness to protect UAV-assisted network operation , 2019, EURASIP J. Wirel. Commun. Netw..

[5]  Jeffrey H. Reed,et al.  Antifragile Communications , 2018, IEEE Systems Journal.

[6]  Eryk Dutkiewicz,et al.  “Jam Me If You Can:” Defeating Jammer With Deep Dueling Neural Network Architecture and Ambient Backscattering Augmented Communications , 2019, IEEE Journal on Selected Areas in Communications.

[7]  Wenbo Wang,et al.  Interference Management in Ultradense Networks: A User-Centric Coalition Formation Game Approach , 2018, IEEE Transactions on Vehicular Technology.

[8]  Pietro Tedeschi,et al.  Leveraging Jamming to Help Drones Complete Their Mission , 2020, IEEE Access.

[9]  Alagan Anpalagan,et al.  Dynamic Spectrum Access in Time-Varying Environment: Distributed Learning Beyond Expectation Optimization , 2015, IEEE Transactions on Communications.

[10]  Amir Leshem,et al.  Game Theoretic Dynamic Channel Allocation for Frequency-Selective Interference Channels , 2017, IEEE Transactions on Information Theory.

[11]  Xiaojun Jing,et al.  Anti-Intelligent UAV Jamming Strategy via Deep Q-Networks , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[12]  Alagan Anpalagan,et al.  Decision-Theoretic Distributed Channel Selection for Opportunistic Spectrum Access: Strategies, Challenges and Solutions , 2013, IEEE Communications Surveys & Tutorials.

[13]  Sudharman K. Jayaweera,et al.  Multi-Agent Reinforcement Learning Based Cognitive Anti-Jamming , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[14]  S. Hart,et al.  A simple adaptive procedure leading to correlated equilibrium , 2000 .

[15]  Mehdi Dehghan,et al.  Learning Stationary Correlated Equilibria in Constrained General-Sum Stochastic Games , 2014, IEEE Transactions on Cybernetics.

[16]  Lajos Hanzo,et al.  A Survey on Wireless Security: Technical Challenges, Recent Advances, and Future Trends , 2015, Proceedings of the IEEE.

[17]  Symeon Papavassiliou,et al.  Data Offloading in UAV-Assisted Multi-Access Edge Computing Systems: A Resource-Based Pricing and User Risk-Awareness Approach , 2020, Sensors.

[18]  Jin Chen,et al.  A One-Leader Multi-Follower Bayesian-Stackelberg Game for Anti-Jamming Transmission in UAV Communication Networks , 2018, IEEE Access.

[19]  Walid Saad,et al.  Prospect theory for enhanced cyber-physical security of drone delivery systems: A network interdiction game , 2017, 2017 IEEE International Conference on Communications (ICC).

[20]  Walid Saad,et al.  A Game of Drones: Cyber-Physical Security of Time-Critical UAV Applications With Cumulative Prospect Theory Perceptions and Valuations , 2019, IEEE Transactions on Communications.

[21]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Unknown Dynamic Environment: A Game-Theoretic Stochastic Learning Solution , 2012, IEEE Transactions on Wireless Communications.

[22]  H. Vincent Poor,et al.  Cloud Storage Defense Against Advanced Persistent Threats: A Prospect Theoretic Study , 2017, IEEE Journal on Selected Areas in Communications.

[23]  Liang Xiao,et al.  Anti-Jamming Transmission Stackelberg Game With Observation Errors , 2015, IEEE Communications Letters.

[24]  Hang Su,et al.  Clustering-Based Multichannel MAC Protocols for QoS Provisionings Over Vehicular Ad Hoc Networks , 2007, IEEE Transactions on Vehicular Technology.

[25]  Zhu Han,et al.  A Stackelberg Game Approach to Proactive Caching in Large-Scale Mobile Edge Networks , 2018, IEEE Transactions on Wireless Communications.

[26]  Lu Wang,et al.  Attachment-Learning for Multi-Channel Allocation in Distributed OFDMA-Based Networks , 2013, IEEE Transactions on Wireless Communications.

[27]  Boi Faltings,et al.  Reaching correlated equilibria through multi-agent learning , 2011, AAMAS.

[28]  Pramod K. Varshney,et al.  Strategic Power Allocation With Incomplete Information in the Presence of a Jammer , 2016, IEEE Transactions on Communications.

[29]  Swades De,et al.  Resource Allocation in Next-Generation Broadband Wireless Access Networks , 2017 .

[30]  Yide Wang,et al.  Distributed Interference-Aware Cooperative MAC Based on Stackelberg Pricing Game , 2015, IEEE Transactions on Vehicular Technology.

[31]  Victor O. K. Li,et al.  Stabilized multi-channel ALOHA for wireless OFDM networks , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[32]  Alagan Anpalagan,et al.  Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach , 2017, IEEE Communications Letters.

[33]  R. Aumann Correlated Equilibrium as an Expression of Bayesian Rationality Author ( s ) , 1987 .

[34]  Keqin Li,et al.  Spectrum Resource Sharing in Heterogeneous Vehicular Networks: A Noncooperative Game-Theoretic Approach With Correlated Equilibrium , 2018, IEEE Transactions on Vehicular Technology.

[35]  Jawad A. Salehi,et al.  Using game theory to battle jammer in control channels of cognitive radio ad hoc networks , 2016, 2016 IEEE International Conference on Communications (ICC).

[36]  Yang Yang,et al.  Self-Organizing Slot Access for Neighboring Cooperation in UAV Swarms , 2020, IEEE Transactions on Wireless Communications.

[37]  Alagan Anpalagan,et al.  Stackelberg Game Approaches for Anti-Jamming Defence in Wireless Networks , 2018, IEEE Wireless Communications.

[38]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[39]  Chungang Yang,et al.  A Survey of Game Theory in Unmanned Aerial Vehicles Communications , 2019, IEEE Communications Surveys & Tutorials.