Cooperative Communications with Relay Selection for QoS Provisioning in Wireless Sensor Networks

Cooperative communications have been demonstrated to be effective in combating the multiple fading effects in wireless networks, and improving the network performance in terms of adaptivity, reliability and network throughput. In this paper, we investigate the use of cooperative communications with adaptive relay selection for resource-constrained wireless sensor networks, and propose QoS-RSCC, a QoS-support multi-agent reinforcement learning based relay selection scheme for cooperative communications. In QoS-RSCC, optimal relays, in terms of outage probability and channel efficiency, are selected distributedly from multiple relaying candidates for the intermediate routers along the multi-hop route, without the needs of prior knowledge of the wireless network model and centralized control. We compare the network performance of QoS-RSCC with CRP [1], and investigate the impacts of network traffic load, channel bit error rate, and node's mobility on the network performance. Simulation results show that QoS-RSCC can achieve a near-optimal performance on both diversity gains and channel efficiency, and fits well in dynamic environments.

[1]  Gregory W. Wornell,et al.  Cooperative diversity in wireless networks: Efficient protocols and outage behavior , 2004, IEEE Transactions on Information Theory.

[2]  Vincent W. S. Wong,et al.  Cooperative Protocols Design for Wireless Ad-Hoc Networks with Multi-hop Routing , 2008, QShine '08.

[3]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[4]  Pei Liu,et al.  Cooperative wireless communications: a cross-layer approach , 2006, IEEE Wireless Communications.

[5]  Shuguang Cui,et al.  Energy-Efficient Cooperative Communication Based on Power Control and Selective Single-Relay in Wireless Sensor Networks , 2008, IEEE Transactions on Wireless Communications.

[6]  Elza Erkip,et al.  User cooperation diversity. Part I. System description , 2003, IEEE Trans. Commun..

[7]  D. G. Brennan.  Linear Diversity Combining Techniques , 1959, Proceedings of the IRE.

[8]  K. J. Ray Liu,et al.  Cooperative communications with relay-selection: when to cooperate and whom to cooperate with? , 2008, IEEE Transactions on Wireless Communications.

[9]  Hyundong Shin,et al.  Cooperative Communications with Outage-Optimal Opportunistic Relaying , 2007, IEEE Transactions on Wireless Communications.

[10]  Aria Nosratinia,et al.  Distributed protocols for user cooperation in multi-user wireless networks , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[11]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[12]  Aria Nosratinia,et al.  Cooperative communication in wireless networks , 2004, IEEE Communications Magazine.

[13]  Aggelos Bletsas,et al.  A simple Cooperative diversity method based on network path selection , 2005, IEEE Journal on Selected Areas in Communications.

[14]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[15]  Aria Nosratinia,et al.  Cooperation diversity through coding , 2002, Proceedings IEEE International Symposium on Information Theory,.

[16]  Andrew W. Moore,et al.  Distributed Value Functions , 1999, ICML.

[17]  C.-C. Jay Kuo,et al.  Cooperative Communications in Resource-Constrained Wireless Networks , 2007, IEEE Signal Processing Magazine.

[18]  Zhu Han,et al.  Distributed Energy-Efficient Cooperative Routing in Wireless Networks , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.