Feature-Based Deep Neural Networks for Short-Term Prediction of WiFi Channel Occupancy Rate

Spectrum occupancy prediction is a key enabling technology to facilitate a proactive resource allocation for dynamic spectrum management systems. This work focuses on the prediction of duty cycle (DC) metric that reflects spectrum usage (in the time domain). The spectrum usage is typically measured on a shorter time scale than needed for prediction. Hence, data thinning is required and we apply block averaging. However, averaging operation results in flattening the DC data and losing essential features to assist deep neural network (DNN) to predict the spectrum usage. To improve DC prediction after block averaging, a feature-based deep learning framework is proposed. Namely, long short-term memory (LSTM) and gated recurrent unit (GRU) are selected and enhanced by using features of the data, such as the variance of DC data in addition to DC data themself. The proposed model is capable of proactively predicting the spectrum usage by capturing complex relationships among various input features for the measured spectrum, thus providing higher prediction accuracy with an average improvement of 5% in RMSE compared with traditional models. Moreover, to have a better understanding of the proposed model, we quantify the effect of input features on the predicted spectrum usage values. Based on the most significant input features, a simpler and more efficient model is proposed to estimate DC with similar accuracy to when using all features.

[1]  Fabrice Rossi,et al.  Mean Absolute Percentage Error for regression models , 2016, Neurocomputing.

[2]  Yifan Guo,et al.  Spectrum availability prediction in cognitive aerospace communications: A deep learning perspective , 2017, 2017 Cognitive Communications for Aerospace Applications Workshop (CCAA).

[3]  Jian Yang,et al.  Spectrum Prediction Based on Taguchi Method in Deep Learning With Long Short-Term Memory , 2018, IEEE Access.

[4]  Ignacio J. Turias,et al.  Hybrid approaches based on SARIMA and artificial neural networks for inspection time series forecasting , 2014 .

[5]  Qi Hao,et al.  Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey , 2018, IEEE Communications Surveys & Tutorials.

[6]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[7]  Kareem E. Baddour,et al.  Spectrum Occupancy Prediction for Land Mobile Radio Bands Using a Recommender System , 2018, 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).

[8]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[9]  Janne J. Lehtomäki,et al.  Wireless Traffic Usage Forecasting Using Real Enterprise Network Data: Analysis and Methods , 2020, IEEE Open Journal of the Communications Society.

[10]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[11]  Gui-Bin Bian,et al.  Performance Analysis of Google Colaboratory as a Tool for Accelerating Deep Learning Applications , 2018, IEEE Access.

[12]  Dereje Hailemariam,et al.  Mobile data traffic forecasting in UMTS networks based on SARIMA model: The case of Addis Ababa, Ethiopia , 2017, 2017 IEEE AFRICON.

[13]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[14]  Amir Ghasemi Predictive Modeling of LTE User Throughput Via Crowd-Sourced Mobile Spectrum Data , 2018, 2018 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[15]  Asaf Shabtai,et al.  When Explainability Meets Adversarial Learning: Detecting Adversarial Examples using SHAP Signatures , 2019, 2020 International Joint Conference on Neural Networks (IJCNN).

[16]  Timo Teräsvirta,et al.  POWER OF THE NEURAL NETWORK LINEARITY TEST , 1993 .

[17]  Paul Patras,et al.  Long-Term Mobile Traffic Forecasting Using Deep Spatio-Temporal Neural Networks , 2017, MobiHoc.

[18]  Sana Salous,et al.  Spectrum Occupancy Statistics and Time Series Models for Cognitive Radio , 2011, J. Signal Process. Syst..

[19]  Quanshi Zhang,et al.  Visual interpretability for deep learning: a survey , 2018, Frontiers of Information Technology & Electronic Engineering.

[20]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[21]  Lajos Hanzo,et al.  Spectrum Inference in Cognitive Radio Networks: Algorithms and Applications , 2018, IEEE Communications Surveys & Tutorials.

[22]  Timothy Dozat,et al.  Incorporating Nesterov Momentum into Adam , 2016 .

[23]  Lee Lacy,et al.  Defense Advanced Research Projects Agency (DARPA) Agent Markup Language Computer Aided Knowledge Acquisition , 2005 .

[24]  Ronald Y. Chang,et al.  Analysis and Visualization of Deep Neural Networks in Device-Free Wi-Fi Indoor Localization , 2019, IEEE Access.

[25]  H. Birkan Yilmaz,et al.  Intelligent network data analytics function in 5G cellular networks using machine learning , 2020, Journal of Communications and Networks.

[26]  Christoph Hardegen,et al.  A Study of Deep Learning for Network Traffic Data Forecasting , 2019, ICANN.

[27]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Dongfeng Yuan,et al.  Deep Transfer Learning for Intelligent Cellular Traffic Prediction Based on Cross-Domain Big Data , 2019, IEEE Journal on Selected Areas in Communications.

[30]  Oliver W. W. Yang,et al.  Traffic prediction using FARIMA models , 1999, 1999 IEEE International Conference on Communications (Cat. No. 99CH36311).

[31]  Tuncer Baykas,et al.  Path Loss Exponent and Shadowing Factor Prediction From Satellite Images Using Deep Learning , 2019, IEEE Access.

[32]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[33]  N. Ahlgren,et al.  Combined Lagrange multiplier test for ARCH in vector autoregressive models , 2017 .

[34]  Takeo Fujii,et al.  Smart Spectrum for Future Wireless World , 2017, IEICE Trans. Commun..

[35]  Jie Yang,et al.  Data-Driven Deep Learning for Automatic Modulation Recognition in Cognitive Radios , 2019, IEEE Transactions on Vehicular Technology.

[36]  Nei Kato,et al.  A Deep-Learning-Based Radio Resource Assignment Technique for 5G Ultra Dense Networks , 2018, IEEE Network.

[37]  Melfi Alrasheedi,et al.  Intelligent Hybrid Model to Enhance Time Series Models for Predicting Network Traffic , 2020, IEEE Access.

[38]  Viktor K. Prasanna,et al.  Deep Learning Models For Aggregated Network Traffic Prediction , 2019, 2019 15th International Conference on Network and Service Management (CNSM).

[39]  L. Longo,et al.  Explainable Artificial Intelligence: a Systematic Review , 2020, ArXiv.

[40]  Scott M. Lundberg,et al.  Explainable machine-learning predictions for the prevention of hypoxaemia during surgery , 2018, Nature Biomedical Engineering.

[41]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[42]  Lutz Prechelt,et al.  Early Stopping - But When? , 2012, Neural Networks: Tricks of the Trade.

[43]  Jian-Xun Mi,et al.  Review Study of Interpretation Methods for Future Interpretable Machine Learning , 2020, IEEE Access.

[44]  Janne J. Lehtomäki,et al.  Applying Deep Neural Networks for Duty Cycle Estimation , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[45]  Rob J. Hyndman,et al.  Large-Scale Unusual Time Series Detection , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[46]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[47]  F. Windmeijer,et al.  An R-squared measure of goodness of fit for some common nonlinear regression models , 1997 .

[48]  R. Wilcox Applying Contemporary Statistical Techniques , 2003 .

[49]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[50]  Chin-Feng Lai,et al.  Gated Recurrent Unit Network-based Cellular Trafile Prediction , 2020, 2020 International Conference on Information Networking (ICOIN).

[51]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[52]  Skipper Seabold,et al.  Statsmodels: Econometric and Statistical Modeling with Python , 2010, SciPy.

[53]  Fang Zhou,et al.  Base Station Traffic Prediction based on STL-LSTM Networks , 2018, 2018 24th Asia-Pacific Conference on Communications (APCC).