Mobility and Blockage-Aware Communications in Millimeter-Wave Vehicular Networks

Mobility may degrade the performance of next-generation vehicular networks operating at the millimeter-wave spectrum: frequent mis-alignment and blockages require repeated beam-training and handover, with enormous overhead. Nevertheless, mobility induces temporal correlations in the communication beams and in blockage events. In this paper, an adaptive design is proposed, that learns and exploits these temporal correlations to reduce the beam-training overhead and make handover decisions. At each time-slot, the serving base station (BS) decides to perform either beam-training, data communication, or handover, under uncertainty in the system state. The decision problem is cast as a partially observable Markov decision process, with the goal to maximize the throughput delivered to the user, under an average power constraint. To address the high-dimensional optimization, an approximate constrained point-based value iteration (C-PBVI) method is developed, which simultaneously optimizes the primal and dual functions to meet the power constraint. Numerical results demonstrate a good match between the analysis and a simulation based on 2D mobility and 3D analog beamforming via uniform planar arrays at both BSs and UE, and reveal that C-PBVI performs near-optimally, and outperforms a baseline scheme with periodic beam-training by 38% in spectral efficiency. Motivated by the structure of C-PBVI, two heuristics are proposed, that trade complexity with sub-optimality, and achieve only 4% and 15% loss in spectral efficiency. Finally, the effect of mobility and multiple users on blockage dynamics is evaluated numerically, demonstrating superior performance over the baseline scheme.

[1]  Robert W. Heath,et al.  Beam design for beam switching based millimeter wave vehicle-to-infrastructure communications , 2016, 2016 IEEE International Conference on Communications (ICC).

[2]  Upamanyu Madhow,et al.  Compressive Channel Estimation and Tracking for Large Arrays in mm-Wave Picocells , 2015, IEEE Journal of Selected Topics in Signal Processing.

[3]  Robert W. Heath,et al.  Inverse Multipath Fingerprinting for Millimeter Wave V2I Beam Alignment , 2017, IEEE Transactions on Vehicular Technology.

[4]  Nicolo Michelusi,et al.  Energy-Efficient Interactive Beam Alignment for Millimeter-Wave Networks , 2018, IEEE Transactions on Wireless Communications.

[5]  Ying Li,et al.  Deep Learning Coordinated Beamforming for Highly-Mobile Millimeter Wave Systems , 2018, IEEE Access.

[6]  Joelle Pineau,et al.  Anytime Point-Based Approximations for Large POMDPs , 2006, J. Artif. Intell. Res..

[7]  Tracy Camp,et al.  A survey of mobility models for ad hoc network research , 2002, Wirel. Commun. Mob. Comput..

[8]  Robert W. Heath,et al.  Online Learning for Position-Aided Millimeter Wave Beam Training , 2018, IEEE Access.

[9]  John L. Gustafson,et al.  Little's Law , 2011, Encyclopedia of Parallel Computing.

[10]  Robert W. Heath,et al.  Millimeter-Wave Vehicular Communication to Support Massive Automotive Sensing , 2016, IEEE Communications Magazine.

[11]  R. Bansal,et al.  Antenna theory; analysis and design , 1984, Proceedings of the IEEE.

[12]  Robert W. Heath,et al.  Coverage analysis for millimeter wave cellular networks with blockage effects , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[13]  Maria Scalabrin,et al.  Adaptive Millimeter-Wave Communications Exploiting Mobility and Blockage Dynamics , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[14]  Vincent W. S. Wong,et al.  An MDP-Based Vertical Handoff Decision Algorithm for Heterogeneous Wireless Networks , 2008, IEEE Transactions on Vehicular Technology.

[15]  Sundeep Rangan,et al.  An MDP model for optimal handover decisions in mmWave cellular networks , 2015, 2016 European Conference on Networks and Communications (EuCNC).

[16]  Sung-En Chiu,et al.  Active Learning and CSI Acquisition for mmWave Initial Alignment , 2018, IEEE Journal on Selected Areas in Communications.

[17]  Nicolò Michelusi,et al.  Optimal Beam-Sweeping and Communication in Mobile Millimeter-Wave Networks , 2018, 2018 IEEE International Conference on Communications (ICC).

[18]  Building on intuition , 1994 .

[19]  Nikos A. Vlassis,et al.  Perseus: Randomized Point-based Value Iteration for POMDPs , 2005, J. Artif. Intell. Res..

[20]  Michele Zorzi,et al.  Initial Access in 5G mmWave Cellular Networks , 2016, IEEE Communications Magazine.

[21]  Wenyi Zhang,et al.  An MDP-Based Handover Decision Algorithm in Hierarchical LTE Networks , 2012, 2012 IEEE Vehicular Technology Conference (VTC Fall).

[22]  Saeedeh Parsaeefard,et al.  Dynamic Non-Orthogonal Multiple Access and Orthogonal Multiple Access in 5G Wireless Networks , 2018, IEEE Transactions on Communications.

[23]  Radhika Ranjan Roy,et al.  Random Gauss–Markov Mobility , 2011 .

[24]  Sergey Andreev,et al.  On the Temporal Effects of Mobile Blockers in Urban Millimeter-Wave Cellular Scenarios , 2017, IEEE Transactions on Vehicular Technology.

[25]  Urbashi Mitra,et al.  UWB Sparse/Diffuse Channels, Part I: Channel Models and Bayesian Estimators , 2012, IEEE Transactions on Signal Processing.

[26]  Yong Soo Cho,et al.  Application of Motion Sensors for Beam-Tracking of Mobile Stations in mmWave Communication Systems , 2014, Sensors.

[27]  Nicolo Michelusi,et al.  Second-Best Beam-Alignment via Bayesian Multi-Armed Bandits , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[28]  Michele Rossi,et al.  Beam Training and Data Transmission Optimization in Millimeter-Wave Vehicular Networks , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[29]  Michael D. Zoltowski,et al.  Multi-Resolution Codebook and Adaptive Beamforming Sequence Design for Millimeter Wave Beam Alignment , 2017, IEEE Transactions on Wireless Communications.