Online reduced gaussian process regression based generalized likelihood ratio test for fault detection

Abstract In this paper we consider a new fault detection approach that merges the benefits of Gaussian process regression (GPR) with a generalized likelihood ratio test (GLRT). The GPR is one of the most well-known machine learning techniques. It is simpler and generally more robust than other methods. To deal with both high computational costs for large data sets and time-varying dynamics of industrial processes, we consider a reduced and online version of the GPR method. The online reduced GPR (ORGPR) aims to select a reduced set of kernel functions to build the GPR model and apply it for online fault detection based on GLRT chart. Compared with the conventional GPR technique, the proposed ORGPR method has the advantages of improving the computational efficiency by decreasing the dimension of the kernel matrix. The developed ORGPR-based GLRT (ORGPR-based GLRT) could improve the fault detection efficiency since it is able to track the time-varying characteristics of the processes. The fault detection performance of the developed ORGPR-based GLRT method is evaluated using a Tennessee Eastman process. The simulation results show that the proposed method outperforms the conventional GPR-based GLRT technique.

[1]  Lyudmila Mihaylova,et al.  Online Sparse Multi-Output Gaussian Process Regression and Learning , 2019, IEEE Transactions on Signal and Information Processing over Networks.

[2]  Hazem Nounou,et al.  Kernel PCA-based GLRT for nonlinear fault detection of chemical processes , 2016 .

[3]  Jian Xiao,et al.  Short-Term Solar Power Forecasting Based on Weighted Gaussian Process Regression , 2018, IEEE Transactions on Industrial Electronics.

[4]  Maged M. Hamed,et al.  Prediction of wastewater treatment plant performance using artificial neural networks , 2004, Environ. Model. Softw..

[5]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[6]  Hazem N. Nounou,et al.  Improved Statistical Fault Detection Technique and Application to Biological Phenomena Modeled by S-Systems , 2017, IEEE Transactions on NanoBioscience.

[7]  Trevor Darrell,et al.  Gaussian Processes for Object Categorization , 2010, International Journal of Computer Vision.

[8]  Alexander J. Smola,et al.  Sparse Greedy Gaussian Process Regression , 2000, NIPS.

[9]  Hazem Nounou,et al.  Wavelet optimized EWMA for fault detection and application to photovoltaic systems , 2018, Solar Energy.

[10]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[11]  Aman Ullah,et al.  On the Robustness of LM, LR, and W Tests in Regression Models , 1984 .

[12]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems using analytical and knowledge-based redundancy: A survey and some new results , 1990, Autom..

[13]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[14]  Hazem Nounou,et al.  Kernel PLS-based GLRT method for fault detection of chemical processes , 2016 .

[15]  D. Steinberg.  CART: Classification and Regression Trees , 2009 .

[16]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Gustavo Camps-Valls,et al.  Retrieval of Biophysical Parameters With Heteroscedastic Gaussian Processes , 2014, IEEE Geoscience and Remote Sensing Letters.

[18]  Hazem Nounou,et al.  Fault detection using multiscale PCA-based moving window GLRT , 2017 .

[19]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[20]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[21]  Mahmoud Nasr,et al.  Application of Artificial Neural Network (ANN) for the prediction of EL-AGAMY wastewater treatment plant performance-EGYPT , 2012 .

[22]  Hazem Nounou,et al.  Enhanced data validation strategy of air quality monitoring network , 2018, Environmental research.

[23]  Kurt S. Riedel,et al.  A Sherman-Morrison-Woodbury Identity for Rank Augmenting Matrices with Application to Centering , 1992, SIAM J. Matrix Anal. Appl..

[24]  Majdi Mansouri,et al.  Multiscale Kernel PLS-Based Exponentially Weighted-GLRT and Its Application to Fault Detection , 2019, IEEE Transactions on Emerging Topics in Computational Intelligence.

[25]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[26]  Yassine Djebbar,et al.  Neural Network Prediction of Air Stripping KLa , 2002 .

[27]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[28]  Hazem Nounou,et al.  Statistical Fault Detection of Chemical Process - Comparative Studies , 2015 .

[29]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[30]  Hazem Nounou,et al.  Multiscale PLS-based GLRT for fault detection of chemical processes , 2017 .

[31]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[32]  Hazem Nounou,et al.  Monitoring of wastewater treatment plants using improved univariate statistical technique , 2018 .

[33]  Christopher M. Bishop,et al.  Variational Relevance Vector Machines , 2000, UAI.

[34]  Rolf Isermann.  Model-based fault-detection and diagnosis - status and applications § , 2004 .

[35]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..

[36]  Luis Alonso,et al.  Retrieval of Vegetation Biophysical Parameters Using Gaussian Process Techniques , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Narciso Moreno-Alfonso,et al.  Intelligent waste-water treatment with neural-networks , 2001 .

[38]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[39]  Jan Peters,et al.  Model Learning with Local Gaussian Process Regression , 2009, Adv. Robotics.

[40]  J. Ogutu,et al.  Genomic selection using regularized linear regression models: ridge regression, lasso, elastic net and their extensions , 2012, BMC Proceedings.

[41]  Okba Taouali,et al.  A new fault detection method for nonlinear process monitoring , 2016, The International Journal of Advanced Manufacturing Technology.

[42]  Michel Verhaegen,et al.  Online Sparse Gaussian Process Training with Input Noise , 2016, ArXiv.

[43]  Alexander Y. Sun,et al.  Monthly streamflow forecasting using Gaussian Process Regression , 2014 .

[44]  Abbas Rohani,et al.  A novel soft computing model (Gaussian process regression with K-fold cross validation) for daily and monthly solar radiation forecasting (Part: I) , 2018 .

[45]  Majdi Mansouri,et al.  Online reduced kernel principal component analysis for process monitoring , 2018 .

[46]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .