A flexible framework based on reinforcement learning for adaptive modulation and coding in OFDM wireless systems

This paper presents a machine learning approach for link adaptation in orthogonal frequency-division multiplexing systems through adaptive modulation and coding. Although machine learning techniques have attracted attention for link adaptation, most of the the schemes proposed so far are based on off-line training algorithms, which make them not well suited for real time operation. The proposed solution, based on the reinforcement learning technique, learns the best modulation and coding scheme for a given signal-to-noise ratio by interacting with the radio channel and it does not rely on an off-line training mode. Simulation results show that under specific conditions, the proposed technique can outperform the well-known solution based on look-up tables for adaptive modulation and coding, and it can potentially adapt itself to distinct characteristics of the radio environment.

[1]  M. Lamarca,et al.  Indicators for PER prediction in wireless systems: A comparative study , 2005, 2005 IEEE 61st Vehicular Technology Conference.

[2]  Zhenyu Zhang,et al.  Intelligent cognitive radio: Research on learning and evaluation of CR based on Neural Network , 2007, 2007 ITI 5th International Conference on Information and Communications Technology.

[3]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[4]  H. Yanikomeroglu,et al.  Investigating the Gaussian Convergence of the Distribution of the Aggregate Interference Power in Large Wireless Networks , 2010, IEEE Transactions on Vehicular Technology.

[5]  Rajarathnam Chandramouli,et al.  Adaptive stochastic iterative rate selection for wireless channels , 2004, IEEE Communications Letters.

[6]  Robert W. Heath,et al.  Online adaptive modulation and coding with support vector machines , 2010, 2010 European Wireless Conference (EW).

[7]  Robert W. Heath,et al.  Adaptation in Convolutionally Coded MIMO-OFDM Wireless Systems Through Supervised Learning and SNR Ordering , 2010, IEEE Transactions on Vehicular Technology.

[8]  Marceau Coupechoux,et al.  SMDP approach for JRRM analysis in heterogeneous networks , 2008, 2008 14th European Wireless Conference.

[9]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[10]  Framework and overall objectives of the future development of IMT-2000 and systems beyond IMT , .

[11]  Kaijie Zhou,et al.  Robust Cross-Layer Design with Reinforcement Learning for IEEE 802.11n Link Adaptation , 2011, 2011 IEEE International Conference on Communications (ICC).

[12]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.

[13]  Pekka Kyosti,et al.  MATLAB implementation of the 3GPP spatial channel model (3GPP TR 25.996) , 2005 .

[14]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  Fei Peng,et al.  Adaptive Modulation and Coding for IEEE 802.11n , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[17]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[18]  Robert W. Heath,et al.  A Supervised Learning Approach to Adaptation in Practical MIMO-OFDM Wireless Systems , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.