A novel approach to process operating mode diagnosis using conditional random fields in the presence of missing data

Abstract Diagnosis of process operating modes is an important aspect of process monitoring. Due to its ability to model process transitions, the Hidden Markov Model (HMM) is widely used as a tool for operating mode diagnosis. However, it suffers from certain drawbacks due to its inherent assumptions. Hence, to address these issues and improve the operating mode diagnosis performance, we introduce the Conditional Random Field (CRF), which is a discriminiative probabilistic model based approach. Further, to deal with the missing measurement problem that commonly occurs in industrial datasets, a marginalized CRF framework is proposed in this paper and the related inference algorithms are developed under this newly designed framework. Validation studies performed on a simulated continuous stirred tank reactor (CSTR) system and an experimental hybrid tank system demonstrate that the proposed CRF based algorithms have superior performances compared to the existing approaches.

[1]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[2]  Biao Huang,et al.  Expectation–Maximization Approach to Fault Diagnosis With Missing Data , 2015, IEEE Transactions on Industrial Electronics.

[3]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields , 2010, Found. Trends Mach. Learn..

[4]  C. Torrence,et al.  A Practical Guide to Wavelet Analysis. , 1998 .

[5]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[6]  Donghua Zhou,et al.  Hidden Markov Model-Based Statistics Pattern Analysis for Multimode Process Monitoring: An Index-Switching Scheme , 2014 .

[7]  M. A. Henson,et al.  Input‐output linearization of general nonlinear processes , 1990 .

[8]  Dongping Zhang,et al.  Abnormal Crowd Motion Detection with Hidden Conditional Random Fields Model , 2015, MUE 2015.

[9]  Biao Huang,et al.  Bayesian methods for control loop diagnosis in the presence of temporal dependent evidences , 2011, Autom..

[10]  Xunyuan Yin,et al.  Distributed State Estimation of Sensor-Network Systems Subject to Markovian Channel Switching With Application to a Chemical Process , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[12]  S. Zhao,et al.  Monitoring of Processes with Multiple Operating Modes through Multiple Principle Component Analysis Models , 2004 .

[13]  Mudassir M. Rashid,et al.  Hidden Markov Model Based Adaptive Independent Component Analysis Approach for Complex Chemical Process Monitoring and Fault Detection , 2012 .

[14]  M. Potkonjak,et al.  Markov chain-based models for missing and faulty data in MICA2 sensor motes , 2005, IEEE Sensors, 2005..

[15]  Alireza Fatehi,et al.  Adaptive monitoring of the process operation based on symbolic episode representation and hidden Markov models with application toward an oil sand primary separation , 2014, Comput. Chem. Eng..

[16]  Biao Huang,et al.  Real-Time Assessment and Diagnosis of Process Operating Performance , 2017 .

[17]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[18]  G. Stephanopoulos,et al.  Representation of process trends—Part I. A formal representation framework , 1990 .

[19]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields for Relational Learning , 2007 .

[20]  Hanna M. Wallach,et al.  Conditional Random Fields: An Introduction , 2004 .

[21]  Vadim E. Uvarov,et al.  Training hidden Markov models on incomplete sequences , 2016, 2016 13th International Scientific-Technical Conference on Actual Problems of Electronics Instrument Engineering (APEIE).

[22]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[23]  Ahmet Palazoglu,et al.  Classification of process trends based on fuzzified symbolic representation and hidden Markov models , 1998 .

[24]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[25]  Georg Heigold,et al.  Equivalence of Generative and Log-Linear Models , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[26]  Dong Shen,et al.  Fault diagnosis and compensation for two‐dimensional discrete time systems with sensor faults and time‐varying delays , 2017 .

[27]  Geoffrey Zweig,et al.  A segmental CRF approach to large vocabulary continuous speech recognition , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[28]  Furong Gao,et al.  Review of Recent Research on Data-Based Process Monitoring , 2013 .

[29]  Xunyuan Yin,et al.  Distributed moving horizon state estimation of two-time-scale nonlinear systems , 2017, Autom..

[30]  Thomas G. Dietterich,et al.  Gradient Tree Boosting for Training Conditional Random Fields , 2008 .

[31]  Xunyuan Yin,et al.  Distributed output‐feedback fault detection and isolation of cascade process networks , 2017 .

[32]  Fei Liu,et al.  Fault Detection and Diagnosis of Multiple-Model Systems With Mismodeled Transition Probabilities , 2015, IEEE Transactions on Industrial Electronics.

[33]  Alireza Fatehi,et al.  Operating condition diagnosis based on HMM with adaptive transition probabilities in presence of missing observations , 2015 .

[34]  Weihua Li,et al.  Recursive PCA for adaptive process monitoring , 1999 .

[35]  Henry A. Kautz,et al.  Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields , 2007, Int. J. Robotics Res..

[36]  Steven X. Ding,et al.  A Review on Basic Data-Driven Approaches for Industrial Process Monitoring , 2014, IEEE Transactions on Industrial Electronics.

[37]  Dong Shen,et al.  Reliable H∞ control of discrete-time systems against random intermittent faults , 2016, Int. J. Syst. Sci..

[38]  Shaogang Gong,et al.  Action categorization with modified hidden conditional random field , 2010, Pattern Recognit..

[39]  Guofeng Wang,et al.  Bearing fault classification based on conditional random field , 2013 .