Monitoring nonstationary processes based on recursive cointegration analysis and elastic weight consolidation

This paper considers the problem of nonstationary process monitoring under frequently varying operating conditions. Traditional approaches generally misidentify the normal dynamic deviations as faults and thus lead to high false alarms. Besides, they generally consider single relatively steady operating condition and suffer from the catastrophic forgetting issue when learning successive operating conditions. In this paper, recursive cointegration analysis (RCA) is first proposed to distinguish the real faults from normal systems changes, where the model is updated once a new normal sample arrives and can adapt to slow change of cointegration relationship. Based on the long-term equilibrium information extracted by RCA, the remaining shortterm dynamic information is monitored by recursive principal component analysis (RPCA). Thus a comprehensive monitoring framework is built. When the system enters a new operating condition, the RCA-RPCA model is rebuilt to deal with the new condition. Meanwhile, elastic weight consolidation (EWC) is employed to settle the ‘catastrophic forgetting’ issue inherent in RPCA, where significant information of influential parameters is enhanced to avoid the abrupt performance degradation for similar modes. The effectiveness of the proposed method is illustrated by a practical industrial system.

[1]  Shan Yu,et al.  Continual learning of context-dependent processing in neural networks , 2018, Nature Machine Intelligence.

[2]  Songhang Chen,et al.  An Improved Mixture of Probabilistic PCA for Nonlinear Data-Driven Process Monitoring , 2019, IEEE Transactions on Cybernetics.

[3]  Chunhui Zhao,et al.  A full‐condition monitoring method for nonstationary dynamic chemical processes with cointegration and slow feature analysis , 2018 .

[4]  Xiang Yin,et al.  Decentralized Fault Prognosis of Discrete-Event Systems Using State-Estimate-Based Protocols , 2019, IEEE Transactions on Cybernetics.

[5]  Xuefeng Yan,et al.  Whole Process Monitoring Based on Unstable Neuron Output Information in Hidden Layers of Deep Belief Network , 2019, IEEE Transactions on Cybernetics.

[6]  Maoyin Chen,et al.  Monitoring multimode processes: a modified PCA algorithm with continual learning ability , 2020, Journal of Process Control.

[7]  S. Johansen STATISTICAL ANALYSIS OF COINTEGRATION VECTORS , 1988 .

[8]  Chunhui Zhao,et al.  Slow-Feature-Analysis-Based Batch Process Monitoring With Comprehensive Interpretation of Operation Condition Deviation and Dynamic Anomaly , 2019, IEEE Transactions on Industrial Electronics.

[9]  Chunhui Zhao,et al.  Dynamic Distributed Monitoring Strategy for Large-Scale Nonstationary Processes Subject to Frequently Varying Conditions Under Closed-Loop Control , 2019, IEEE Transactions on Industrial Electronics.

[10]  Claus Weihs,et al.  Variable window adaptive Kernel Principal Component Analysis for nonlinear nonstationary process monitoring , 2011, Comput. Ind. Eng..

[11]  Yining Dong,et al.  Efficient Dynamic Latent Variable Analysis for High-Dimensional Time Series Data , 2020, IEEE Transactions on Industrial Informatics.

[12]  Nicolas Y. Masse,et al.  Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization , 2018, Proceedings of the National Academy of Sciences.

[13]  Jianbin Qiu,et al.  Fault Detection for Nonlinear Process With Deterministic Disturbances: A Just-In-Time Learning Based Data Driven Method , 2017, IEEE Transactions on Cybernetics.

[14]  Johan A. K. Suykens,et al.  Concurrent monitoring of operating condition deviations and process dynamics anomalies with slow feature analysis , 2015 .

[15]  Razvan Pascanu,et al.  Overcoming catastrophic forgetting in neural networks , 2016, Proceedings of the National Academy of Sciences.

[16]  Bart De Ketelaere,et al.  A systematic comparison of PCA-based statistical process monitoring methods for high-dimensional, time-dependent processes , 2016 .

[17]  Søren Johansen,et al.  Recursive Estimation in Cointegrated VAR-Models , 1992 .

[18]  Søren Johansen,et al.  Some tests for parameter constancy in cointegrated VAR-models , 1999 .

[19]  Donghua Zhou,et al.  Anomaly detection in the fan system of a thermal power plant monitored by continuous and two-valued variables , 2020 .

[20]  Henrik Sandberg,et al.  Distributed Fault Detection and Isolation Resilient to Network Model Uncertainties , 2014, IEEE Transactions on Cybernetics.

[21]  Faiz A. Al-Khayyal,et al.  Difference of convex solution of quadratically constrained optimization problems , 2003, Eur. J. Oper. Res..

[22]  Ruomu Tan,et al.  Nonstationary Discrete Convolution Kernel for Multimodal Process Monitoring , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Chunhui Zhao,et al.  Recursive cointegration analytics for adaptive monitoring of nonstationary industrial processes with both static and dynamic variations , 2020 .

[24]  Feiping Nie,et al.  Robust Manifold Nonnegative Matrix Factorization , 2014, ACM Trans. Knowl. Discov. Data.

[25]  Andrew Y. T. Leung,et al.  Cointegration Testing Method for Monitoring Nonstationary Processes , 2009 .

[26]  Lamiaa M. Elshenawy,et al.  Efficient Recursive Principal Component Analysis Algorithms for Process Monitoring , 2010 .

[27]  Zhiqiang Ge,et al.  Multimode Process Monitoring Based on Switching Autoregressive Dynamic Latent Variable Model , 2018, IEEE Transactions on Industrial Electronics.

[28]  Ferenc Huszár,et al.  Note on the quadratic penalties in elastic weight consolidation , 2017, Proceedings of the National Academy of Sciences.

[29]  Andrew Ball,et al.  Monitoring Nonstationary Processes Using Stationary Subspace Analysis and Fractional Integration Order Estimation , 2019, Industrial & Engineering Chemistry Research.

[30]  C. Granger,et al.  Co-integration and error correction: representation, estimation and testing , 1987 .

[31]  Hava T. Siegelmann,et al.  Brain-inspired replay for continual learning with artificial neural networks , 2020, Nature Communications.

[32]  Yi Cao,et al.  Canonical Variate Dissimilarity Analysis for Process Incipient Fault Detection , 2018, IEEE Transactions on Industrial Informatics.

[33]  James Lam,et al.  An Improved Incremental Learning Approach for KPI Prognosis of Dynamic Fuel Cell System , 2016, IEEE Transactions on Cybernetics.

[34]  Donghua Zhou,et al.  Process monitoring based on orthogonal locality preserving projection with maximum likelihood estimation , 2019, Industrial & Engineering Chemistry Research.

[35]  Fan Yang,et al.  Recursive Slow Feature Analysis for Adaptive Monitoring of Industrial Processes , 2018, IEEE Transactions on Industrial Electronics.

[36]  Antoine Soubeyran,et al.  Global convergence of a proximal linearized algorithm for difference of convex functions , 2015, Optimization Letters.

[37]  Duck Young Kim,et al.  Empirical Sensitivity Analysis of Discretization Parameters for Fault Pattern Extraction From Multivariate Time Series Data , 2017, IEEE Transactions on Cybernetics.

[38]  Yee Whye Teh,et al.  Progress & Compress: A scalable framework for continual learning , 2018, ICML.