Vision-Aided Radio: User Identity Match in Radio and Video Domains Using Machine Learning

5G is designed to be an essential enabler and a leading infrastructure provider in the communication technology industry by supporting the demand for the growing data traffic and a variety of services with distinct requirements. The use of deep learning and computer vision tools has the means to increase the environmental awareness of the network with information from visual data. Information extracted via computer vision tools such as user position, movement direction, and speed can be promptly available for the network. However, the network must have a mechanism to match the identity of a user in both visual and radio systems. This mechanism is absent in the present literature. Therefore, we propose a framework to match the information from both visual and radio domains. This is an essential step to practical applications of computer vision tools in communications. We detail the proposed framework training and deployment phases for a presented setup. We carried out practical experiments using data collected in different types of environments. The work compares the use of Deep Neural Network and Random Forest classifiers and shows that the former performed better across all experiments, achieving classification accuracy greater than 99%.

[1]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[2]  Muhammad Alrabeiah,et al.  ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communications , 2020, 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring).

[3]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[4]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[5]  Rui Li,et al.  Land Cover Classification from Remote Sensing Images Based on Multi-Scale Fully Convolutional Network , 2020, ArXiv.

[6]  Alaa Tharwat,et al.  Classification assessment methods , 2020, Applied Computing and Informatics.

[7]  M. M. Hoffman,et al.  Classification and interaction in random forests , 2018, Proceedings of the National Academy of Sciences.

[8]  Jakob Hoydis,et al.  Deep HyperNetwork-Based MIMO Detection , 2020, 2020 IEEE 21st International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Muhammad Alrabeiah,et al.  Millimeter Wave Base Stations with Cameras: Vision-Aided Beam and Blockage Prediction , 2019, 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring).

[11]  Nicolas Gonthier,et al.  Multiple instance learning on deep features for weakly supervised object detection with extreme domain shifts , 2020, ArXiv.

[12]  Osvaldo Simeone,et al.  A Very Brief Introduction to Machine Learning With Applications to Communication Systems , 2018, IEEE Transactions on Cognitive Communications and Networking.

[13]  Muhammad Alrabeiah,et al.  Vision-Aided Dynamic Blockage Prediction for 6G Wireless Communication Networks , 2020, 2021 IEEE International Conference on Communications Workshops (ICC Workshops).

[14]  Jakob Hoydis,et al.  Toward Joint Learning of Optimal MAC Signaling and Wireless Channel Access , 2020, IEEE Transactions on Cognitive Communications and Networking.

[15]  Abien Fred Agarap.  Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[16]  Chuan Zhang,et al.  Artificial Intelligence for 5G and Beyond 5G: Implementations, Algorithms, and Optimizations , 2020, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[17]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[18]  Lisandro Lovisolo,et al.  Wi-Fi multi-floor indoor positioning considering architectural aspects and controlled computational complexity , 2014, Expert Syst. Appl..

[19]  Estefania Talavera,et al.  Deep learning for scene recognition from visual data: a survey , 2020, HAIS.

[20]  Yinhai Wang,et al.  Deep Learning Based Brain Tumor Segmentation: A Survey , 2020, ArXiv.

[21]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[22]  John Terry,et al.  OFDM Wireless LANs: A Theoretical and Practical Guide , 2001 .

[23]  A. Rao,et al.  RF Fingerprinting and Deep Learning Assisted UE Positioning in 5G , 2020, 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring).

[24]  Mohamed-Slim Alouini,et al.  Applying Deep-Learning-Based Computer Vision to Wireless Communications: Methodologies, Opportunities, and Challenges , 2020, IEEE Open Journal of the Communications Society.

[25]  Jakob Hoydis,et al.  Adaptive Neural Signal Detection for Massive MIMO , 2019, IEEE Transactions on Wireless Communications.