Learning-Based mmWave V2I Environment Augmentation through Tunable Reflectors

To support the demand of multi-Gbps sensory data exchanges for enhancing (semi)-autonomous driving, millimeter-wave bands (mmWave) vehicular-to- infrastructure (V2I) communications have attracted intensive attention. Unfortunately, the vulnerability to blockages over mmWave bands poses significant design challenges, which can be hardly addressed by manipulating end transceivers, such as beamforming techniques. In this paper, we propose to enhance mmWave V2I communications by augmenting the transmission environments through reflection, where highly-reflective cheap metallic plates are deployed as tunable reflectors without damaging the aesthetic nature of the environments. In this way, alternative indirect line-of-sight (LOS) links are established by adjusting the angle of reflectors. Our fundamental challenge is to adapt the time-consuming reflector angle tuning to the highly dynamic vehicular environment. By using deep reinforcement learning, we propose the learning-based Fast Reflection (LFR) algorithm, which autonomously learns from the observable traffic pattern to select desirable reflector angles in advance for probably blocked vehicles in near future. Simulation results demonstrate our proposal could effectively augment mmWave V2I transmission environments with significant performance gain.

[1]  Cheng-Xiang Wang,et al.  Beamspace SU-MIMO for Future Millimeter Wave Wireless Communications , 2017, IEEE Journal on Selected Areas in Communications.

[2]  Ignas Niemegeers,et al.  Robust 60 GHz Indoor Connectivity: Is It Possible with Reflections? , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[3]  Theodore S. Rappaport,et al.  Millimeter Wave Channel Modeling and Cellular Capacity Evaluation , 2013, IEEE Journal on Selected Areas in Communications.

[4]  Ben Y. Zhao,et al.  Mirror mirror on the ceiling: flexible wireless links for data centers , 2012, CCRV.

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  Ying-Chang Liang,et al.  Applications of Deep Reinforcement Learning in Communications and Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[7]  Robert W. Heath,et al.  MmWave Vehicle-to-Infrastructure Communication: Analysis of Urban Microcellular Networks , 2017, IEEE Transactions on Vehicular Technology.

[8]  Geoffrey Ye Li,et al.  Deep Reinforcement Learning for Resource Allocation in V2V Communications , 2017, 2018 IEEE International Conference on Communications (ICC).

[9]  Athanasios V. Vasilakos,et al.  A survey of millimeter wave communications (mmWave) for 5G: opportunities and challenges , 2015, Wireless Networks.

[10]  Robert W. Heath,et al.  Millimeter-Wave Vehicular Communication to Support Massive Automotive Sensing , 2016, IEEE Communications Magazine.

[11]  Kyung-Seok Kim,et al.  Characteristics Analysis of Reflection and Transmission According to Building Materials in the Millimeter Wave Band , 2015 .

[12]  Theodore S. Rappaport,et al.  Millimeter Wave Mobile Communications for 5G Cellular: It Will Work! , 2013, IEEE Access.

[13]  Yun-Pang Flötteröd,et al.  Microscopic Traffic Simulation using SUMO , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[14]  Yuguang Fang,et al.  Augmenting Transmission Environments for Better Communications: Tunable Reflector Assisted MmWave WLANs , 2020, IEEE Transactions on Vehicular Technology.