KQIs-Driven QoE Anomaly Detection and Root Cause Analysis in Cellular Networks

With the dense deployment of cellular networks, the enrichment of service types and the explosive growth of data volume, there is an increasing need of automatically detecting and diagnosing degraded performance cells for operators. Previous studies mainly focus on QoS (Quality of Service) based anomaly detection and root cause analysis, but the cellular network operators pay more attention to the user’s QoE (Quality of Experience) degradation since QoE can better represent the user’s actual service experience. To achieve online QoE anomaly detection and root cause analysis, in this paper, we present a new integrated anomaly detection and diagnosis framework. Firstly, QoE is expressed by the KQIs (Key Quality Indicators) vector of the user’s three most common services with largest traffic. And then, QoE anomaly detection is processed by using two-step clustering method (SOM+K-mediods) to obtain QoE Anomaly Codebooks. Diagnosis is achieved by selecting KPIs (Key Performance Indicators) and learning their characteristic impact on KQIs to obtain Fault Cause Codebooks. The QoE Anomaly Codebooks are used to detect anomaly samples, and the Fault Cause Codebooks are applied to find the fault cause types. The designed framework has been evaluated with real 4G data. For comparison, three other two- step clustering algorithms are introduced, and results show that our framework can achieve the highest detection accuracy rate. Therefore, it can be directly used in real-world cellular networks for online fault detection and diagnosis.

[1]  Jun Wu,et al.  CellPAD: Detecting Performance Anomalies in Cellular Networks via Regression Analysis , 2018, 2018 IFIP Networking Conference (IFIP Networking) and Workshops.

[2]  SON conflict diagnosis in heterogeneous networks , 2015, 2015 IEEE 26th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[3]  Guo Wei,et al.  A QoE anomaly detection and diagnosis framework for cellular network operators , 2015, 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[4]  Troels E. Kolding,et al.  Advancements of QoE assessment and optimization in mobile networks in the machine era , 2018, 2018 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[5]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[6]  Lorenza Giupponi,et al.  From 4G to 5G: Self-organized Network Management meets Machine Learning , 2017, Comput. Commun..

[7]  Xiaohui Chen,et al.  SQoE KQIs anomaly detection in cellular networks: Fast online detection framework with Hourglass clustering , 2018, China Communications.

[8]  Christian Callegari,et al.  Detecting and diagnosing anomalies in cellular networks using Random Neural Networks , 2016, 2016 International Wireless Communications and Mobile Computing Conference (IWCMC).

[9]  Raquel Barco,et al.  Automatic Root Cause Analysis for LTE Networks Based on Unsupervised Techniques , 2016, IEEE Transactions on Vehicular Technology.

[10]  Zhongshan Zhang,et al.  Call Detail Records Driven Anomaly Detection and Traffic Prediction in Mobile Cellular Networks , 2018, IEEE Access.

[11]  Arsalan Darbandi,et al.  Enabling proactive self-healing by data mining network failure logs , 2017, 2017 International Conference on Computing, Networking and Communications (ICNC).

[12]  Ying Wang,et al.  A Data-Driven Architecture for Personalized QoE Management in 5G Wireless Networks , 2017, IEEE Wireless Communications.

[13]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[14]  Pinyi Ren,et al.  Deep Learning-Based Big Data-Assisted Anomaly Detection in Cellular Networks , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[15]  Raquel Barco,et al.  Methodology for the Design and Evaluation of Self-Healing LTE Networks , 2016, IEEE Transactions on Vehicular Technology.

[16]  Pedro Casas,et al.  Super learning for anomaly detection in cellular networks , 2017, 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[17]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .