A CNN-based network failure prediction method with logs

Nowadays people are becoming increasingly dependent on networks. Taking precautions before failure of networks is becoming more and more important. Compared with detection of faults, prediction of faults is more critical as it can efficiently avoid the damage made by network faults based on the fault prediction. So this paper focuses on network failure prediction. When predicting network faults, current methods mainly rely on structured data, like alarm data. Compared with structured data, log data are more abundant and recently implemented to solve failure prediction problems of network systems. In order to predict failure in the networks, it becomes essential to take advantage of log data. In this paper, we propose a novel method to predict failure in the network system. We build a CNN model to accomplish our work. Experimental results confirm the effectiveness of our method.

[1]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[2]  András A. Benczúr,et al.  Machine Learning Based Session Drop Prediction in LTE Networks and Its SON Aspects , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[3]  Volker Wille,et al.  System for automated diagnosis in cellular networks based on performance indicators , 2005, Eur. Trans. Telecommun..

[4]  Navjot Singh,et al.  Log Analytics for Dependable Enterprise Telephony , 2012, 2012 Ninth European Dependable Computing Conference.

[5]  Felix Salfner,et al.  Error Log Processing for Accurate Failure Prediction , 2008, WASL.

[6]  Zhiling Lan,et al.  System log pre-processing to improve failure prediction , 2009, 2009 IEEE/IFIP International Conference on Dependable Systems & Networks.

[7]  Binh Nguyen,et al.  ABSENCE: Usage-based Failure Detection in Mobile Networks , 2015, MobiCom.

[8]  Mohammad Zulkernine,et al.  Runtime Prediction of Failure Modes from System Error Logs , 2013, 2013 18th International Conference on Engineering of Complex Computer Systems.

[9]  Sally A. McKee,et al.  Digging deeper into cluster system logs for failure prediction and root cause diagnosis , 2014, 2014 IEEE International Conference on Cluster Computing (CLUSTER).

[10]  Engin Zeydan,et al.  Anomaly Detection In Cellular Network Data Using Big Data Analytics , 2014 .

[11]  Joao Bota,et al.  Big Data Analytics for Detecting Host Misbehavior in Large Logs , 2015, 2015 IEEE Trustcom/BigDataSE/ISPA.

[12]  Wei Xu,et al.  System Problem Detection by Mining Console Logs , 2010 .

[13]  Jian Cao,et al.  Behavioral anomaly detection approach based on log monitoring , 2015, 2015 International Conference on Behavioral, Economic and Socio-cultural Computing (BESC).

[14]  Gary M. Weiss Predicting Telecommunication Equipment Failures from Sequences of Network Alarms , 2001, KDD 2001.

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.