A deep learning approach for predicting critical events using event logs

Event logs, comprising data on the occurrence of different types of events and associated times, are commonly collected during the operation of modern industrial machines and systems. It is widely believed that the rich information embedded in event logs can be used to predict the occurrence of critical events. In this paper, we propose a recurrent neural network model using time‐to‐event data from event logs not only to predict the time of the occurrence of a target event of interest, but also to interpret, from the trained model, significant events leading to the target event. To improve the performance of our model, sampling techniques and methods dealing with the censored data are utilized. The proposed model is tested on both simulated data and real‐world datasets. Through these comparison studies, we show that the deep learning approach can often achieve better prediction performance than the traditional statistical model, such as, the Cox proportional hazard model. The real‐world case study also shows that the model interpretation algorithm proposed in this work can reveal the underlying physical relationship among events.

[1]  Fausto Pedro García Márquez,et al.  Reliability analysis of detecting false alarms that employ neural networks: A real case study on wind turbines , 2019, Reliab. Eng. Syst. Saf..

[2]  Denis Larocque,et al.  Survival forests for data with dependent censoring , 2019, Statistical methods in medical research.

[3]  T. Emura,et al.  Analysis of Survival Data with Dependent Censoring: Copula-Based Approaches , 2018 .

[4]  Qiang Zhou,et al.  Remaining useful life prediction for hard failures using joint model with extended hazard , 2018, Qual. Reliab. Eng. Int..

[5]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[6]  Jimeng Sun,et al.  Using recurrent neural network models for early detection of heart failure onset , 2016, J. Am. Medical Informatics Assoc..

[7]  Y. Kluger,et al.  DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network , 2018, BMC Medical Research Methodology.

[8]  Gediminas Adomavicius,et al.  Adapting machine learning techniques to censored time-to-event health record data: A general-purpose approach using inverse probability of censoring weighting , 2016, J. Biomed. Informatics.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[11]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[12]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Kamal Mannar,et al.  Event log modeling and analysis for system failure prediction , 2011 .

[14]  Ahmed Z. Al-Garni,et al.  Artificial neural network application of modeling failure rate for Boeing 737 tires , 2011, Qual. Reliab. Eng. Int..

[15]  Yong Sun,et al.  A REVIEW ON RELIABILITY MODELS WITH COVARIATES , 2009, WCE 2010.

[16]  Tshilidzi Marwala,et al.  Machine and component residual life estimation through the application of neural networks , 2007, Reliab. Eng. Syst. Saf..

[17]  Suresh K. Choubey,et al.  Failure event prediction using the Cox proportional hazard model driven by frequent failure signatures , 2007 .

[18]  A. Tsiatis Semiparametric Theory and Missing Data , 2006 .

[19]  Mikhail J. Atallah,et al.  Reliable detection of episodes in event sequences , 2004, Knowledge and Information Systems.

[20]  Zhigang Li,et al.  Improving the Web Site's Effectiveness by Considering Each Page's Temporal Information , 2003, WAIM.

[21]  Margaret H. Dunham,et al.  Efficient mining of traversal patterns , 2001, Data Knowl. Eng..

[22]  Heikki Mannila,et al.  Association Rule Selection in a Data Mining Environment , 1999, PKDD.

[23]  Ian W. McKeague,et al.  Efficient Estimation from Right-Censored Data When Failure Indicators are Missing at Random , 1998 .

[24]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[25]  Heikki Mannila,et al.  TASA: Telecommunication Alarm Sequence Analyzer or how to enjoy faults in your network , 1996, Proceedings of NOMS '96 - IEEE Network Operations and Management Symposium.

[26]  Heikki Mannila,et al.  Knowledge discovery from telecommunication network alarm databases , 1996, Proceedings of the Twelfth International Conference on Data Engineering.

[27]  D.,et al.  Regression Models and Life-Tables , 2022 .