Learning-based framework for policy-aware cognitive radio emergency networking

Uncertainties in the wireless communication medium do not allow for guarantees in network performance for cognitive radio applications envisaged for mobile ad hoc emergency networking. The novel concept of mission policies, which specify the Quality of Service (QoS) requirements of the incumbent network as well as the cognitive radio networks, is introduced. The use of mission policies, which vary over time and space, enables graceful degradation in the QoS of incumbent network (only when necessary) based on mission-policy specifications. A Multi-Agent Reinforcement Learning (MARL)-based cross-layer communication framework, RescueNet, is proposed for self-adaptation of nodes in cognitive radio networks. Also, the novel idea of knowledge sharing among the agents (nodes) is introduced to significantly improve the performance of the proposed solution.

[1]  Ana Galindo-Serrano,et al.  Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks , 2010, IEEE Transactions on Vehicular Technology.

[2]  David S. Broomhead,et al.  Codes for spread spectrum applications generated using chaotic dynamical systems , 1999 .

[3]  Victor C. M. Leung,et al.  Cooperative Communications with Relay Selection for QoS Provisioning in Wireless Sensor Networks , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.

[4]  Luciano Bononi,et al.  Adaptive Sensing Scheduling and Spectrum Selection in Cognitive Wireless Mesh Networks , 2011, 2011 Proceedings of 20th International Conference on Computer Communications and Networks (ICCCN).

[5]  Andrew W. Moore,et al.  Distributed Value Functions , 1999, ICML.

[6]  Dario Pompili,et al.  A Multimedia Cross-Layer Protocol for Underwater Acoustic Sensor Networks , 2010, IEEE Transactions on Wireless Communications.

[7]  Lei Ding,et al.  Cross-Layer Routing and Dynamic Spectrum Allocation in Cognitive Radio Ad Hoc Networks , 2010, IEEE Transactions on Vehicular Technology.

[8]  J.-C. Renaud,et al.  Multi-Agent Systems on Sensor Networks: A Distributed Reinforcement Learning Approach , 2005, 2005 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[9]  Leonard Kleinrock,et al.  Optimal Transmission Ranges for Randomly Distributed Packet Radio Terminals , 1984, IEEE Trans. Commun..

[10]  Victor C. M. Leung,et al.  A novel cooperative communication protocol for QoS provisioning in wireless sensor networks , 2009, 2009 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities and Workshops.

[11]  Michael L. Littman,et al.  Value-function reinforcement learning in Markov games , 2001, Cognitive Systems Research.

[12]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Chen-Khong Tham,et al.  Coordinated Sensing Coverage in Sensor Networks using Distributed Reinforcement Learning , 2006, 2006 14th IEEE International Conference on Networks.