Integration of Hidden Markov Modelling and Bayesian Network for fault detection and prediction of complex engineered systems

Abstract This paper presents a methodology for fault detection, fault prediction and fault isolation based on the integration of hidden Markov modelling (HMM) and Bayesian networks (BN). This addresses the nonlinear and non-Gaussian data characteristics to support fault detection and prediction, within an explainable hybrid framework that captures causality in the complex engineered system. The proposed methodology is based on the analysis of the pattern of similarity in the log-likelihood (LL) sequences against the training data for the mixture of Gaussians HMM (MoG-HMM). The BN model identifies the root cause of detected/predicted faults, using the information propagated from the HMM model as empirical evidence. The feasibility and effectiveness of the presented approach are discussed in conjunction with the application to a real-world case study of an automotive exhaust gas Aftertreatment system. The paper details the implementation of the methodology to this case study, with data available from real-world usage of the system. The results show that the proposed methodology identifies the fault faster and attributes the fault to the correct root cause. While the proposed methodology is illustrated with an automotive case study, its applicability is much wider to the fault detection and prediction problem of any similar complex engineered system.

[1]  Jie Ma,et al.  Fault Prediction Algorithm for Multiple Mode Process Based on Reconstruction Technique , 2015 .

[2]  Benoît Iung,et al.  Overview on Bayesian networks applications for dependability, risk analysis and maintenance areas , 2012, Eng. Appl. Artif. Intell..

[3]  Bing Han,et al.  Data-driven based fault prognosis for industrial systems: a concise overview , 2020, IEEE/CAA Journal of Automatica Sinica.

[4]  Seref Sagiroglu,et al.  Big data: A review , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[5]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[6]  Faisal Khan,et al.  Process Fault Prognosis Using Hidden Markov Model–Bayesian Networks Hybrid Model , 2019, Industrial & Engineering Chemistry Research.

[7]  Noureddine Zerhouni,et al.  A Data-Driven Failure Prognostics Method Based on Mixture of Gaussians Hidden Markov Models , 2012, IEEE Transactions on Reliability.

[8]  Faisal Khan,et al.  Process system fault detection and diagnosis using a hybrid technique , 2018, Chemical Engineering Science.

[9]  Yaneer Bar-Yam,et al.  Dynamics Of Complex Systems , 2019 .

[10]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[11]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[12]  Aitor Arnaiz,et al.  Application of Bayesian networks in prognostics for a new Integrated Vehicle Health Management concept , 2012, Expert Syst. Appl..

[13]  Wei Liang,et al.  An integrated method for safety pre-warning of complex system , 2010 .

[14]  Hedi Dhouibi,et al.  Diagnostic and prognostic of hybrid dynamic systems: Modeling and RUL evaluation for two maintenance policies , 2017, Reliab. Eng. Syst. Saf..

[15]  Lin Ma,et al.  Prognostic modelling options for remaining useful life estimation by industry , 2011 .

[16]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[17]  Tim Baines,et al.  State-of-the-art in integrated vehicle health management , 2009 .

[18]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[19]  Rui Kang,et al.  Benefits and Challenges of System Prognostics , 2012, IEEE Transactions on Reliability.

[20]  Yoshua Bengio,et al.  Towards Causal Representation Learning , 2021, ArXiv.

[21]  Jeremy Rohmer,et al.  Uncertainties in conditional probability tables of discrete Bayesian Belief Networks: A comprehensive review , 2020, Eng. Appl. Artif. Intell..

[22]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[23]  Lin Ma,et al.  An integrated approach for system functional reliability assessment using Dynamic Bayesian Network and Hidden Markov Model , 2018, Reliab. Eng. Syst. Saf..

[24]  Joseph Mathew,et al.  A review on prognostic techniques for non-stationary and non-linear rotating systems , 2015 .

[25]  Noureddine Zerhouni,et al.  Remaining Useful Life Estimation of Critical Components With Application to Bearings , 2012, IEEE Transactions on Reliability.

[26]  Felician Campean,et al.  Reliability Challenges for Automotive Aftertreatment Systems: a State-of-the-art Perspective , 2018 .

[27]  Shen Yin,et al.  Recursive Total Principle Component Regression Based Fault Detection and Its Application to Vehicular Cyber-Physical Systems , 2018, IEEE Transactions on Industrial Informatics.

[28]  Milton Borsato,et al.  An ontology-based model for prognostics and health management of machines , 2017, J. Ind. Inf. Integr..

[29]  Yisha Xiang,et al.  A review on condition-based maintenance optimization models for stochastically deteriorating system , 2017, Reliab. Eng. Syst. Saf..

[30]  Luigi Portinale,et al.  Bayesian networks in reliability , 2007, Reliab. Eng. Syst. Saf..

[31]  David Kim,et al.  A Bayesian network-based approach for fault analysis , 2017, Expert Syst. Appl..

[32]  T. Coosemans,et al.  A review of the European passenger car regulations – Real driving emissions vs local air quality , 2018 .

[33]  Felician Campean,et al.  Automotive IVHM: Towards Intelligent Personalised Systems Healthcare , 2019, Proceedings of the Design Society: International Conference on Engineering Design.

[34]  Faisal Khan,et al.  Dynamic process fault detection and diagnosis based on a combined approach of hidden Markov and Bayesian network model , 2019, Chemical Engineering Science.

[35]  Viliam Makis,et al.  Condition monitoring and state classification of gearboxes using stochastic resonance and hidden Markov models , 2018, Measurement.