Data-Driven Design of Fault Diagnosis Systems

Due to the increasing demands on system performance, production quality as well as economic operation, modern technical systems become more complicated and the automation degrees are significantly growing. To ensure the safety and reliability of such complicated processes, an effective fault diagnosis system is of prime importance in process industry nowadays. Although the model-based fault diagnosis theory has been well established, it is still difficult to establish mathematical model by means of the first principles for large-scale process. On the other hand, a large amount of historical data from regular sensor measurements, event-logs and records are often available in such industrial processes. Motivated by this observation, it is of great interest to design fault diagnosis schemes only based on the available process data. Hence, development of efficient data-driven fault diagnosis schemes for different operating conditions is the primary objective of this thesis. This thesis is firstly dedicated to the modifications on the standard multivariate statistical process monitoring approaches. The modified approaches are considerably simple, and most importantly, avoid the drawbacks of the standard techniques. As a result, the proposed approaches are able to provide enhanced fault diagnosis performance on the applications under stationary operating conditions. The further study of this thesis focuses on developing reliable fault diagnosis schemes for dynamic processes under industrial operating conditions. Instead of identifying the entire process model, primary fault diagnosis can be efficiently realized by the identification of key components. Advanced design schemes like multiple residuals generator and state observer are also investigated to ensure high fault sensitivity performance. For the large-scale processes involving changes, e.g. in operating regimes or in the manipulated variables, the recursive and adaptive techniques are studied to cope with such uncertainty issues. A novel data-driven adaptive scheme is proposed, whose stability and convergence rate are analytically proven. Compared to the standard techniques, this approach does not involve complicated on-line computation and produces consistent estimate of the unknown parameters. To illustrate the effectiveness of the derived data-driven approaches, three industrial benchmark processes, i.e. the Tennessee Eastman chemical plant, the fed-batch fermen-

[1]  Barry M. Wise,et al.  The process chemometrics approach to process monitoring and fault detection , 1995 .

[2]  Ping Zhang,et al.  On the application of PCA technique to fault diagnosis , 2010 .

[3]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies , 2003, Comput. Chem. Eng..

[4]  Tony Gustafsson,et al.  A class of subspace tracking algorithms based on approximation of the noise-subspace , 2000, IEEE Trans. Signal Process..

[5]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[6]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems using analytical and knowledge-based redundancy: A survey and some new results , 1990, Autom..

[7]  S. Joe Qin,et al.  Statistical process monitoring: basics and beyond , 2003 .

[8]  Tao Chen,et al.  Multivariate statistical monitoring of two-dimensional dynamic batch processes utilizing non-Gaussian information , 2010 .

[9]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[10]  Paul M. Frank,et al.  Issues of Fault Diagnosis for Dynamic Systems , 2010, Springer London.

[11]  Lamiaa M. Elshenawy,et al.  Efficient Recursive Principal Component Analysis Algorithms for Process Monitoring , 2010 .

[12]  Michèle Basseville,et al.  Detecting changes in signals and systems - A survey , 1988, Autom..

[13]  James Moyne,et al.  Virtual metrology and feedback control for semiconductor manufacturing processes using recursive partial least squares , 2008 .

[14]  Janos Gertler,et al.  Generating directional residuals with dynamic parity relations , 1995, Autom..

[15]  Janos Gertler,et al.  Fault detection and diagnosis in engineering systems , 1998 .

[16]  Weihua Li,et al.  Recursive PCA for Adaptive Process Monitoring , 1999 .

[17]  Paul G. Plöger,et al.  Model-Based Fault Diagnosis Techniques for Mobile Robots , 2016 .

[18]  Grigorios Dimitriadis,et al.  Diagnosis of Process Faults in Chemical Systems Using a Local Partial Least Squares Approach , 2008 .

[19]  A. Höskuldsson PLS regression methods , 1988 .

[20]  S. Wold,et al.  PLS-regression: a basic tool of chemometrics , 2001 .

[21]  Shen Yin,et al.  On PCA-based fault diagnosis techniques , 2010, 2010 Conference on Control and Fault-Tolerant Systems (SysTol).

[22]  J R P Clarke Process Analysis , 1985 .

[23]  Birgit Köppen-Seliger Fehlerdiagnose mit künstlichen neuronalen Netzen , 1997 .

[24]  A. Willsky,et al.  Analytical redundancy and the design of robust failure detection systems , 1984 .

[25]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[26]  Sirkka-Liisa Jämsä-Jounela,et al.  A process monitoring system based on the Kohonen self-organizing maps , 2003 .

[27]  Steven X. Ding,et al.  Data-driven monitoring for stochastic systems and its application on batch process , 2013, Int. J. Syst. Sci..

[28]  Steven X. Ding,et al.  Data-Driven Design of Observers and Its Applications , 2011 .

[29]  S. Qin Recursive PLS algorithms for adaptive data modeling , 1998 .

[30]  Te-Won Lee,et al.  Independent Component Analysis , 1998, Springer US.

[31]  K. Helland,et al.  Recursive algorithm for partial least squares regression , 1992 .

[32]  M. Laser Recent Safety and Environmental Legislation , 2007 .

[33]  Leo H. Chiang,et al.  Fault diagnosis in chemical processes using Fisher discriminant analysis, discriminant partial least squares, and principal component analysis , 2000 .

[34]  Michèle Basseville,et al.  On-board Component Fault Detection and Isolation Using the Statistical Local Approach , 1998, Autom..

[35]  Donghua Zhou,et al.  Geometric properties of partial least squares for process monitoring , 2010, Autom..

[36]  S. Joe Qin,et al.  Joint diagnosis of process and sensor faults using principal component analysis , 1998 .

[37]  Harold Lee Jones,et al.  Failure detection in linear systems , 1973 .

[38]  Inseok Hwang,et al.  A Survey of Fault Detection, Isolation, and Reconfiguration Methods , 2010, IEEE Transactions on Control Systems Technology.

[39]  S. Ding,et al.  Recursive Identification Algorithm for Parity Space Based Fault Detection Systems , 2009 .

[40]  Steven X. Ding,et al.  Recursive identification algorithms to design fault detection systems , 2010 .

[41]  Torsten Jeinsch,et al.  An Approach to Analysis and Design of Observer and Parity Relation Based FDI Systems , 1999 .

[42]  Mark A. Girolami,et al.  Self-Organising Neural Networks: Independent Component Analysis and Blind Source Separation , 1999 .

[43]  Jin Wang,et al.  Closed-loop subspace identification using the parity space , 2006, Autom..

[44]  Zidong Wang,et al.  Stochastic reliable control of a class of uncertain time-delay systems with unknown nonlinearities , 2001 .

[45]  Manabu Kano,et al.  Monitoring independent components for fault detection , 2003 .

[46]  Ronald D. DeGroat,et al.  Noniterative subspace tracking , 1992, IEEE Trans. Signal Process..

[47]  Gang Feng,et al.  Reliable H∞ control for discrete-time piecewise linear systems with infinite distributed delays , 2009, at - Automatisierungstechnik.

[48]  Benoît Champagne,et al.  Adaptive eigendecomposition of data covariance matrices based on first-order perturbations , 1994, IEEE Trans. Signal Process..

[49]  Tricia J. Willink Efficient Adaptive SVD Algorithm for MIMO Applications , 2008, IEEE Transactions on Signal Processing.

[50]  U. Kruger,et al.  Dynamic Principal Component Analysis Using Subspace Model Identification , 2005, ICIC.

[51]  S. Joe Qin,et al.  Consistent dynamic PCA based on errors-in-variables subspace identification , 2001 .

[52]  Junghui Chen,et al.  On-line batch process monitoring using dynamic PCA and dynamic PLS models , 2002 .

[53]  M. Gevers,et al.  Stable adaptive observers for nonlinear time-varying systems , 1987 .

[54]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[55]  Nola D. Tracy,et al.  Multivariate Control Charts for Individual Observations , 1992 .

[56]  John F. MacGregor,et al.  Multivariate SPC charts for monitoring batch processes , 1995 .

[57]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[58]  Steven X. Ding,et al.  Adaptive Process Monitoring Based on Parity Space Methods , 2009 .

[59]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[60]  Shen Yin Data driven design of fault diagnosis systems , 2012 .

[61]  Bart De Moor,et al.  A unifying theorem for three subspace system identification algorithms , 1995, Autom..

[62]  Torsten Jeinsch,et al.  A characterization of parity space and its application to robust fault detection , 1999, IEEE Trans. Autom. Control..

[63]  John F. MacGregor STATISTICAL PROCESS CONTROL OF MULTIVARIATE PROCESSES , 1994 .

[64]  ChangKyoo Yoo,et al.  Statistical process monitoring with independent component analysis , 2004 .

[65]  Christos Georgakis,et al.  Disturbance detection and isolation by dynamic principal component analysis , 1995 .

[66]  Silvio Simani,et al.  Model-based fault diagnosis in dynamic systems using identification techniques , 2003 .

[67]  Gang Tao,et al.  Adaptive Control Design and Analysis , 2003 .

[68]  Daniel W. C. Ho,et al.  State estimation for delayed neural networks , 2005, IEEE Transactions on Neural Networks.

[69]  Fuli Wang,et al.  On-line batch process monitoring using batch dynamic kernel principal component analysis , 2010 .

[70]  Ping Zhang,et al.  On fault detection in linear discrete-time, periodic, and sampled-data systems , 2008 .

[71]  In-Beum Lee,et al.  Fault detection and diagnosis based on modified independent component analysis , 2006 .

[72]  Ping Zhang,et al.  Subspace method aided data-driven design of fault detection and isolation systems , 2009 .

[73]  Seongkyu Yoon,et al.  Statistical and causal model‐based approaches to fault detection and isolation , 2000 .

[74]  ChangKyoo Yoo,et al.  Fault detection of batch processes using multiway kernel principal component analysis , 2004, Comput. Chem. Eng..

[75]  Rolf Isermann,et al.  Fault diagnosis of machines via parameter estimation and knowledge processing - Tutorial paper , 1991, Autom..

[76]  Richard Vernon Beard,et al.  Failure accomodation in linear systems through self-reorganization. , 1971 .

[77]  George V. Moustakides,et al.  Fast and Stable Subspace Tracking , 2008, IEEE Transactions on Signal Processing.

[78]  Wolfgang Marquardt,et al.  Detection of multivariable trends in measured process quantities , 2006 .

[79]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[80]  T. McAvoy,et al.  Batch tracking via nonlinear principal component analysis , 1996 .

[81]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[82]  Steven X. Ding,et al.  Study on modifications of PLS approach for process monitoring , 2011 .

[83]  Steven X. Ding,et al.  Model-based fault diagnosis in technical processes , 2000 .

[84]  Qinghua Zhang,et al.  Adaptive observer for multiple-input-multiple-output (MIMO) linear time-varying systems , 2002, IEEE Trans. Autom. Control..

[85]  Gibaek Lee,et al.  Multiple-Fault Diagnosis of the Tennessee Eastman Process Based on System Decomposition and Dynamic PLS , 2004 .

[86]  I. Nimmo,et al.  Adequately address abnormal operations , 1995 .

[87]  Nina F. Thornhill,et al.  A continuous stirred tank heater simulation model with applications , 2008 .

[88]  S. Qin,et al.  Selection of the Number of Principal Components: The Variance of the Reconstruction Error Criterion with a Comparison to Other Methods† , 1999 .

[89]  Alan S. Willsky,et al.  A survey of design methods for failure detection in dynamic systems , 1976, Autom..

[90]  Richard D. Braatz,et al.  Data-driven Methods for Fault Detection and Diagnosis in Chemical Processes , 2000 .

[91]  Michel Verhaegen,et al.  Recursive subspace identification of linear and non-linear Wiener state-space models , 2000, Autom..

[92]  Janos Gertler,et al.  A new structural framework for parity equation-based failure detection and isolation , 1990, Autom..

[93]  Bin Yang,et al.  Projection approximation subspace tracking , 1995, IEEE Trans. Signal Process..

[94]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[95]  Q. Peter He,et al.  A New Fault Diagnosis Method Using Fault Directions in Fisher Discriminant Analysis , 2005 .

[96]  Bhupinder S. Dayal,et al.  Improved PLS algorithms , 1997 .

[97]  B. Moor,et al.  Subspace state space system identification for industrial processes , 1998 .

[98]  Stéphane Lecoeuche,et al.  Propagator-based methods for recursive subspace model identification , 2008, Signal Process..

[99]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[100]  S. Joe Qin,et al.  Data-driven Fault Detection and Diagnosis for Complex Industrial Processes , 2009 .

[101]  Donghua Zhou,et al.  Total projection to latent structures for process monitoring , 2009 .

[102]  Ping Zhang,et al.  An approach to data-driven adaptive residual generator design and implementation , 2009 .

[103]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[104]  B. Moor,et al.  Subspace identification for linear systems , 1996 .

[105]  Thomas E. Marlin,et al.  Multivariate statistical monitoring of process operating performance , 1991 .

[106]  Michel Kinnaert,et al.  Diagnosis and Fault-Tolerant Control , 2004, IEEE Transactions on Automatic Control.

[107]  In-Beum Lee,et al.  Nonlinear dynamic process monitoring based on dynamic kernel PCA , 2004 .

[108]  Bart De Moor,et al.  N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems , 1994, Autom..

[109]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[110]  John F. MacGregor,et al.  Adaptive batch monitoring using hierarchical PCA , 1998 .

[111]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[112]  J. E. Jackson,et al.  Control Procedures for Residuals Associated With Principal Component Analysis , 1979 .

[113]  A. Willsky,et al.  A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems , 1976 .

[114]  Maozhen Li,et al.  Stability analysis for stochastic Cohen-Grossberg neural networks with mixed time delays , 2006, IEEE Transactions on Neural Networks.

[115]  Arthur K. Kordon,et al.  Fault diagnosis based on Fisher discriminant analysis and support vector machines , 2004, Comput. Chem. Eng..

[116]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[117]  Jin Cao,et al.  PCA-based fault diagnosis in the presence of control and dynamics , 2004 .

[118]  I. Helland ON THE STRUCTURE OF PARTIAL LEAST SQUARES REGRESSION , 1988 .

[119]  Yingwei Zhang,et al.  Fault detection of non-Gaussian processes based on modified independent component analysis , 2010 .

[120]  Steven X. Ding,et al.  An Integrated Design Framework of Fault-Tolerant Wireless Networked Control Systems for Industrial Automatic Control Applications , 2013, IEEE Transactions on Industrial Informatics.

[121]  Gülnur Birol,et al.  A modular simulation package for fed-batch fermentation: penicillin production , 2002 .

[122]  W. A. Shewhart,et al.  Statistical method from the viewpoint of quality control , 1939 .

[123]  Si-Zhao Joe Qin,et al.  An overview of subspace identification , 2006, Comput. Chem. Eng..

[124]  N. Lawrence Ricker,et al.  Decentralized control of the Tennessee Eastman Challenge Process , 1996 .

[125]  S. Qin,et al.  Detection and identification of faulty sensors in dynamic processes , 2001 .

[126]  In-Beum Lee,et al.  Multiblock PLS-based localized process diagnosis , 2005 .

[127]  Jar-Ferr Yang,et al.  Adaptive eigensubspace algorithms for direction or frequency estimation and tracking , 1988, IEEE Trans. Acoust. Speech Signal Process..

[128]  George V. Moustakides,et al.  Blind adaptive channel estimation in ofdm systems , 2006, IEEE Transactions on Wireless Communications.