Multimode Process Monitoring Using Variational Bayesian Inference and Canonical Correlation Analysis

Industrial processes generally have various operation modes, and fault detection for such processes is important. This paper proposes a method that integrates a variational Bayesian Gaussian mixture model with canonical correlation analysis (VBGMM-CCA) for efficient multimode process monitoring. The proposed VBGMM-CCA method maximizes the advantage of VBGMM in automatic mode identification and the superiority of CCA in local fault detection. First, VBGMM is applied to unlabeled historical process data to determine the number of operation modes and cluster the data in each mode. Second, local CCA models that explore input and output relationships are established. Fault detection residuals are generated in each local CCA model, and monitoring statistics are derived. Finally, a Bayesian inference probability index that integrates monitoring results from all local models is developed to increase the monitoring robustness. The effectiveness of the proposed monitoring scheme is verified through experimental studies on a numerical example and the multiphase batch-fed penicillin fermentation process. Note to Practitioners—Process monitoring is important in guaranteeing process safety and improving product quality. Large amounts of unlabeled process data with multiple operation modes generally exist in industrial processes. Labeling these data is difficult or costly. Hence, this paper presents a VBGMM-CCA method for monitoring multimode processes. The key advantage of the proposed method is that it automatically identifies the number of operation modes in historical data and clusters the data. Then, local CCA monitors are established to model the process input and output relationships. During online monitoring, the running-on operation mode is identified through a density function, and the process status is evaluated by the corresponding CCA monitor. A probabilistic monitoring index is also developed to increase the robustness of the monitoring. In comparison with the results of conventional methods, the monitoring results of the proposed approach are more reliable and informative because the process status and the type of the detected fault are presented.

[1]  John F. MacGregor,et al.  Multivariate SPC charts for monitoring batch processes , 1995 .

[2]  Shen Yin,et al.  Recent results on key performance indicator oriented fault detection using the DB-KIT toolbox , 2017, IECON 2017 - 43rd Annual Conference of the IEEE Industrial Electronics Society.

[3]  Dexian Huang,et al.  Canonical variate analysis-based contributions for fault identification , 2015 .

[4]  Biao Huang,et al.  Neighborhood Variational Bayesian Multivariate Analysis for Distributed Process Monitoring With Missing Data , 2019, IEEE Transactions on Control Systems Technology.

[5]  Jian Wang,et al.  Fault Diagnosis Method of Joint Fisher Discriminant Analysis Based on the Local and Global Manifold Learning and Its Kernel Version , 2016, IEEE Transactions on Automation Science and Engineering.

[6]  Steven X. Ding,et al.  Improved canonical correlation analysis-based fault detection methods for industrial processes , 2016 .

[7]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Gülnur Birol,et al.  A modular simulation package for fed-batch fermentation: penicillin production , 2002 .

[9]  N. Nasios,et al.  Variational learning for Gaussian mixture models , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  S. Joe Qin,et al.  Statistical process monitoring: basics and beyond , 2003 .

[11]  Yingwei Zhang,et al.  Multimode process monitoring based on data-driven method , 2017, J. Frankl. Inst..

[12]  Chunhui Zhao,et al.  A Quality-Relevant Sequential Phase Partition Approach for Regression Modeling and Quality Prediction Analysis in Manufacturing Processes , 2014, IEEE Transactions on Automation Science and Engineering.

[13]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[14]  Zhiqiang Ge,et al.  Non-Gaussian Industrial Process Monitoring With Probabilistic Independent Component Analysis , 2017, IEEE Transactions on Automation Science and Engineering.

[15]  S. Qin,et al.  Multimode process monitoring with Bayesian inference‐based finite Gaussian mixture models , 2008 .

[16]  Manabu Kano,et al.  Locally weighted kernel partial least squares regression based on sparse nonlinear features for virtual sensing of nonlinear time-varying processes , 2017, Comput. Chem. Eng..

[17]  Bin Liu,et al.  A Mixture of Variational Canonical Correlation Analysis for Nonlinear and Quality-Relevant Process Monitoring , 2018, IEEE Transactions on Industrial Electronics.

[18]  Steven X. Ding,et al.  Real-time fault diagnosis and fault-tolerant control , 2015, IEEE Transactions on Industrial Electronics.

[19]  Yang Tang,et al.  Multimode Process Monitoring and Fault Detection: A Sparse Modeling and Dictionary Learning Method , 2017, IEEE Transactions on Industrial Electronics.

[20]  Biao Huang,et al.  Distributed monitoring for large-scale processes based on multivariate statistical analysis and Bayesian method , 2016 .

[21]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[22]  Xuefeng Yan,et al.  Parallel PCA–KPCA for nonlinear process monitoring , 2018, Control Engineering Practice.

[23]  Yuan Yao,et al.  Statistical analysis and online monitoring for multimode processes with between-mode transitions , 2010 .

[24]  Steven X. Ding,et al.  Canonical correlation analysis-based fault detection methods with application to alumina evaporation process , 2016 .

[25]  Biao Huang,et al.  Performance-Driven Distributed PCA Process Monitoring Based on Fault-Relevant Variable Selection and Bayesian Inference , 2016, IEEE Transactions on Industrial Electronics.

[26]  Zhiqiang Ge,et al.  Multimode Process Monitoring Based on Switching Autoregressive Dynamic Latent Variable Model , 2018, IEEE Transactions on Industrial Electronics.

[27]  Steven X. Ding,et al.  Fault Detection for Non-Gaussian Processes Using Generalized Canonical Correlation Analysis and Randomized Algorithms , 2018, IEEE Transactions on Industrial Electronics.

[28]  Kaixiang Peng,et al.  A Quality-Based Nonlinear Fault Diagnosis Framework Focusing on Industrial Multimode Batch Processes , 2016, IEEE Transactions on Industrial Electronics.

[29]  Yang Wang,et al.  Joint-Individual Monitoring of Parallel-Running Batch Processes Based on MCCA , 2018, IEEE Access.

[30]  Shen Yin,et al.  Recursive Total Principle Component Regression Based Fault Detection and Its Application to Vehicular Cyber-Physical Systems , 2018, IEEE Transactions on Industrial Informatics.

[31]  Shen Yin,et al.  Recent Advances in Key-Performance-Indicator Oriented Prognosis and Diagnosis With a MATLAB Toolbox: DB-KIT , 2019, IEEE Transactions on Industrial Informatics.

[32]  Chunhui Zhao,et al.  A full‐condition monitoring method for nonstationary dynamic chemical processes with cointegration and slow feature analysis , 2018 .

[33]  Chunhui Zhao,et al.  Comprehensive Subspace Decomposition with Analysis of Between-Mode Relative Changes for Multimode Process Monitoring , 2015 .

[34]  Steven X. Ding,et al.  Data-driven Design of Fault Diagnosis and Fault-tolerant Control Systems , 2014 .

[35]  Yang Wang,et al.  Data-Driven Distributed Local Fault Detection for Large-Scale Processes Based on the GA-Regularized Canonical Correlation Analysis , 2017, IEEE Transactions on Industrial Electronics.

[36]  Rhoda Min Ting. Tong Multivariate statistical monitoring of batch processes. , 2009 .

[37]  Xuefeng Yan,et al.  Learning Deep Correlated Representations for Nonlinear Process Monitoring , 2019, IEEE Transactions on Industrial Informatics.

[38]  Qiang Liu,et al.  Dynamic concurrent kernel CCA for strip-thickness relevant fault diagnosis of continuous annealing processes , 2017, Journal of Process Control.

[39]  Donghua Zhou,et al.  Geometric properties of partial least squares for process monitoring , 2010, Autom..

[40]  Mu-Song Chen,et al.  A Variational Bayesian Approach for Unsupervised Clustering , 2016 .

[41]  Zhiqiang Ge,et al.  Review on data-driven modeling and monitoring for plant-wide industrial processes , 2017 .

[42]  Jin Hyun Park,et al.  Process monitoring using a Gaussian mixture model via principal component analysis and discriminant analysis , 2004, Comput. Chem. Eng..

[43]  Qiang Liu,et al.  Concurrent quality and process monitoring with canonical correlation analysis , 2017 .

[44]  S. Joe Qin,et al.  Process data analytics in the era of big data , 2014 .