Deep Network Analyzer (DNA): A Big Data Analytics Platform for Cellular Networks

In this paper, we present deep network analyzer (DNA), a big data analytics platform for anomaly detection (AD) and root cause analysis (RCA) in mobile wireless networks. DNA is motivated by the growing scale and complexity of cellular networks along with the lack of advanced big data analytics tools for effective network management. It abstracts the RCA process into two modules, namely rule (fingerprint) learning and the module of AD and fingerprint matching. We first develop a rare association rule mining method to learn the symptoms of network anomalies and to build a fingerprint knowledge database from the historic data. Then a statistical machine learning approach is employed to identify the anomalies within the incoming dataset collected via various probes in the network and map the fingerprints of the detected anomalies to the rules in the knowledge database. The DNA platform has been tested using the real production data from the field and has been shown to be a highly effective platform for AD and RCA for large-scale cellular systems serving tens of millions of mobile users.

[1]  Xiaodong Wang,et al.  An Auction Approach to Resource Allocation in Uplink OFDMA Systems , 2009, IEEE Transactions on Signal Processing.

[2]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[3]  Arian Bär,et al.  When YouTube Does not Work—Analysis of QoE-Relevant Degradation in Google CDN Traffic , 2014, IEEE Transactions on Network and Service Management.

[4]  Romano Fantacci,et al.  An optimized neural network for monitoring Key Performance Indicators in HSDPA , 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[5]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[6]  Amit Mukhopadhyay,et al.  Delivering quality of experience in multimedia networks , 2010 .

[7]  João Cesar M. Mota,et al.  Condition monitoring of 3G cellular networks through competitive neural models , 2005, IEEE Transactions on Neural Networks.

[8]  Engin Zeydan,et al.  Anomaly Detection In Cellular Network Data Using Big Data Analytics , 2014 .

[9]  Jeffrey G. Andrews,et al.  Modeling and Analysis of K-Tier Downlink Heterogeneous Cellular Networks , 2011, IEEE Journal on Selected Areas in Communications.

[10]  Ramakrishnan Srikant,et al.  Mining quantitative association rules in large relational tables , 1996, SIGMOD '96.

[11]  Charu C. Aggarwal,et al.  Outlier Detection for Temporal Data , 2014, Outlier Detection for Temporal Data.

[12]  Yongbin Wei,et al.  A survey on 3GPP heterogeneous networks , 2011, IEEE Wireless Communications.

[13]  Das Amrita,et al.  Mining Association Rules between Sets of Items in Large Databases , 2013 .

[14]  Jian Pei,et al.  Mining frequent patterns without candidate generation , 2000, SIGMOD 2000.

[15]  Lei Wu,et al.  Rare Itemset Mining , 2007, Sixth International Conference on Machine Learning and Applications (ICMLA 2007).

[16]  Ian F. Akyildiz,et al.  A survey of mobility management in next-generation all-IP-based wireless systems , 2004, IEEE Wirel. Commun..

[17]  Ashwin Sampath,et al.  Cell Association and Interference Coordination in Heterogeneous LTE-A Cellular Networks , 2010, IEEE Journal on Selected Areas in Communications.

[18]  Mudhakar Srivatsa,et al.  A Framework for Distributed Monitoring and Root Cause Analysis for Large IP Networks , 2009, 2009 28th IEEE International Symposium on Reliable Distributed Systems.

[19]  Raquel Barco,et al.  Automatic Root Cause Analysis for LTE Networks Based on Unsupervised Techniques , 2016, IEEE Transactions on Vehicular Technology.

[20]  Daniel Massey,et al.  G-RCA: a generic root cause analysis platform for service quality management in large IP networks , 2012, TNET.

[21]  Shamkant B. Navathe,et al.  Text Mining and Ontology Applications in Bioinformatics and GIS , 2007, International Conference on Machine Learning and Applications.

[22]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[23]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.