Online Learning for Joint Beam Tracking and Pattern Optimization in Massive MIMO Systems

In this paper, we consider a joint beam tracking and pattern optimization problem for massive multiple input multiple output (MIMO) systems in which the base station (BS) selects a beamforming codebook and performs adaptive beam tracking taking into account the user mobility. A joint adaptation scheme is developed in a two-phase reinforcement learning framework which utilizes practical signaling and feedback information. In particular, an inner agent adjusts the transmission beam index for a given beamforming codebook based on short-term instantaneous signal-to-noise ratio (SNR) rewards. In addition, an outer agent selects the beamforming codebook based on long-term SNR rewards. Simulation results demonstrate that the proposed online learning outperforms conventional codebook-based beamforming schemes using the same number of feedback information. It is further shown that joint beam tracking and beam pattern adaptation provides a significant SNR gain compared to the beam tracking only schemes, especially as the user mobility increases.

[1]  Tao Jiang,et al.  Deep learning for wireless physical layer: Opportunities and challenges , 2017, China Communications.

[2]  Robert W. Heath,et al.  5G MIMO Data for Machine Learning: Application to Beam-Selection Using Deep Learning , 2018, 2018 Information Theory and Applications Workshop (ITA).

[3]  Anja Klein,et al.  FML: Fast Machine Learning for 5G mmWave Vehicular Communications , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[4]  Ahmed Alkhateeb,et al.  MACHINE LEARNING FOR RELIABLE MMWAVE SYSTEMS: BLOCKAGE PREDICTION AND PROACTIVE HANDOFF , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[5]  Robert W. Heath,et al.  Towards Robustness: Machine Learning for MmWave V2X with Situational Awareness , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[6]  Ness B. Shroff,et al.  Efficient Beam Alignment in Millimeter Wave Systems Using Contextual Bandits , 2017, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[7]  Robert W. Heath,et al.  Beam design for beam switching based millimeter wave vehicle-to-infrastructure communications , 2016, 2016 IEEE International Conference on Communications (ICC).

[8]  Mohamed Ibnkahla,et al.  Applications of neural networks to digital communications - a survey , 2000, Signal Process..

[9]  Ahmed Alkhateeb,et al.  Generative Adversarial Estimation of Channel Covariance in Vehicular Millimeter Wave Systems , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[10]  Leonel Sousa,et al.  Beamformed Fingerprint Learning for Accurate Millimeter Wave Positioning , 2018, 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).

[11]  Timothy J. O'Shea,et al.  Deep Learning Based MIMO Communications , 2017, ArXiv.

[12]  Osvaldo Simeone,et al.  A Very Brief Introduction to Machine Learning With Applications to Communication Systems , 2018, IEEE Transactions on Cognitive Communications and Networking.

[13]  Ying Li,et al.  Deep Learning Coordinated Beamforming for Highly-Mobile Millimeter Wave Systems , 2018, IEEE Access.

[14]  Youngchul Sung,et al.  Training Beam Sequence Design for Millimeter-Wave MIMO Systems: A POMDP Framework , 2014, IEEE Transactions on Signal Processing.

[15]  Robert W. Heath,et al.  Inverse Multipath Fingerprinting for Millimeter Wave V2I Beam Alignment , 2017, IEEE Transactions on Vehicular Technology.

[16]  Robert W. Heath,et al.  Online Learning for Position-Aided Millimeter Wave Beam Training , 2018, IEEE Access.

[17]  Rui Zhang,et al.  Wireless communications with unmanned aerial vehicles: opportunities and challenges , 2016, IEEE Communications Magazine.

[18]  Robert W. Heath,et al.  Millimeter-Wave Vehicular Communication to Support Massive Automotive Sensing , 2016, IEEE Communications Magazine.

[19]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.