Failure Prediction using the Cox Proportional Hazard Model

Crashes of software systems may have disruptive, and sometimes tragic effects on users. Being able to forecast such failures is extremely important, even when the failures are inevitable – at least recovery or rescue actions can be taken. In this paper we present a technique to predict the failure of running software systems. We propose to use log messages to predict failures running devices that read log files of running application and warns about the likely failure of the system; the prediction is based on the Cox Proportional Hazards (PH) model that has been applied successfully in various fields of research. We perform an initial validation of the proposed approach on real-world data.

[1]  P. Schmidt,et al.  Predicting Criminal Recidivism Using "Split Population" Survival Time Models , 1987 .

[2]  D. Kleinbaum,et al.  Survival Analysis: A Self-Learning Text. , 1996 .

[3]  Alberto Sillitti,et al.  Measures for mobile users: an architecture , 2004, J. Syst. Archit..

[4]  Suresh K. Choubey,et al.  Failure event prediction using the Cox proportional hazard model driven by frequent failure signatures , 2007 .

[5]  A. Akhmetova Discovery of Frequent Episodes in Event Sequences , 2006 .

[6]  Alberto Sillitti,et al.  A case-study on using an Automated In-process Software Engineering Measurement and Analysis system in an industrial environment , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[7]  E. Agerbo High income, employment, postgraduate education, and marriage: a suicidal cocktail among psychiatric patients. , 2007, Archives of general psychiatry.

[8]  Hausi A. Müller,et al.  Autonomic Computing Now You See It, Now You Don't , 2008, ISSSE.

[9]  Alberto Sillitti,et al.  Collecting, integrating and analyzing software metrics and personal software process data , 2003, 2003 Proceedings 29th Euromicro Conference.

[10]  Marco Scotto,et al.  A relational approach to software metrics , 2004, SAC '04.

[11]  Marco Scotto,et al.  A non-invasive approach to product metrics collection , 2006, J. Syst. Archit..

[12]  V. S. Srinivasan,et al.  Fault detection/monitoring using time Petri nets , 1993, IEEE Trans. Syst. Man Cybern..

[13]  Laurence L. George,et al.  The Statistical Analysis of Failure Time Data , 2003, Technometrics.

[14]  Alberto Sillitti,et al.  Does Refactoring Improve Reusability? , 2006, ICSR.

[15]  P. Sham,et al.  Predicting prognosis in hepatocellular carcinoma after curative surgery with common clinicopathologic parameters , 2009, BMC Cancer.

[16]  Ping Zhu,et al.  Study of Customer Lifetime Value Model Based on Survival-Analysis Methods , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[17]  P. V. Rao,et al.  Applied Survival Analysis: Regression Modeling of Time to Event Data , 2000 .

[18]  D.,et al.  Regression Models and Life-Tables , 2022 .

[19]  C. Barros,et al.  The length of stay in tourism , 2010 .

[20]  Lawrence E. Holloway,et al.  Template languages for fault monitoring of timed discrete event processes , 2000, IEEE Trans. Autom. Control..

[21]  Chen Chao,et al.  Diagnosability of Discrete-event Systems Based on Temporal , 2012 .

[22]  Alberto Sillitti,et al.  14 Requirements Engineering for Agile Methods , 2004 .

[23]  Alberto Sillitti,et al.  An Empirical Exporatory Study on Inferring Developpers' Activities from Low-Level Data , 2007, SEKE.

[24]  C. Ellison,et al.  Structuring the Religion-Environment Connection: Identifying Religious Influences on Environmental Concern and Activism , 2007 .

[25]  B. Benda Gender Differences in Life-Course Theory of Recidivism: A Survival Analysis , 2005, International journal of offender therapy and comparative criminology.

[26]  Zhiling Lan,et al.  System log pre-processing to improve failure prediction , 2009, 2009 IEEE/IFIP International Conference on Dependable Systems & Networks.

[27]  Elisa T. Lee,et al.  Statistical Methods for Survival Data Analysis , 1994, IEEE Transactions on Reliability.

[28]  Arnoldo Frigessi,et al.  BIOINFORMATICS ORIGINAL PAPER doi:10.1093/bioinformatics/btm305 Gene expression Predicting survival from microarray data—a comparative study , 2022 .

[29]  Sung-Liang Yu,et al.  MicroRNA signature predicts survival and relapse in lung cancer. , 2008, Cancer cell.