Maximized Mutual Information Analysis Based on Stochastic Representation for Process Monitoring

This paper proposes a stochastic representation of maximized mutual information analysis (MIA) method for quality monitoring in which a manner of imposing prior probability distributions over projection parameters is employed and subsequently, a Bayesian estimation algorithm is put forward for projection learning. The proposed stochastic MIA (SMIA) based approach allows the enhanced performance of fault detection due to the following advantages over classic monitoring methods. First, the SMIA approach utilizes the mechanism of hierarchical priors and an individual prior over each projection direction, as a key feature of the proposed method, which enables SMIA to build a sparse model that can discard irrelevant components in the process data with respect to the prediction of quality variables. Second, the proposed SMIA method incorporates the advantage of maximizing mutual information on the minimum achievable error of model prediction as well as the advantage of describing the serial dynamics. Additionally, the optimal dimensionality of the latent space in an SMIA can be automatically determined during the procedure of Bayesian estimation by the utilization of these adaptive priors over projections. The effectiveness of the proposed approach for quality monitoring is demonstrated on the benchmark of Tennessee Eastman process.

[1]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[2]  R. Braatz,et al.  Fault detection of process correlation structure using canonical variate analysis-based correlation features , 2017 .

[3]  J. Galdos,et al.  Information and distortion in reduced-order filter design , 1977, IEEE Trans. Inf. Theory.

[4]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[5]  Kari Torkkola,et al.  Feature Extraction by Non-Parametric Mutual Information Maximization , 2003, J. Mach. Learn. Res..

[6]  Dexian Huang,et al.  Canonical variate analysis-based monitoring of process correlation structure using causal feature representation , 2015 .

[7]  Donghua Zhou,et al.  Geometric properties of partial least squares for process monitoring , 2010, Autom..

[8]  Qiang Liu,et al.  Concurrent quality and process monitoring with canonical correlation analysis , 2017 .

[9]  Zhiqiang Ge,et al.  Semisupervised Kernel Learning for FDA Model and its Application for Fault Classification in Industrial Processes , 2016, IEEE Transactions on Industrial Informatics.

[10]  S. Joe Qin,et al.  Quality‐relevant and process‐relevant fault monitoring with concurrent projection to latent structures , 2013 .

[11]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[12]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[13]  Huijun Gao,et al.  Data-Based Techniques Focused on Modern Industry: An Overview , 2015, IEEE Transactions on Industrial Electronics.

[14]  Richard D. Braatz,et al.  Fault detection in industrial processes using canonical variate analysis and dynamic principal component analysis , 2000 .

[15]  Steven X. Ding,et al.  Canonical correlation analysis-based fault detection methods with application to alumina evaporation process , 2016 .

[16]  Dexian Huang,et al.  Canonical variate analysis-based contributions for fault identification , 2015 .

[17]  ChangKyoo Yoo,et al.  Statistical monitoring of dynamic processes based on dynamic independent component analysis , 2004 .

[18]  J. Macgregor,et al.  Monitoring batch processes using multiway principal component analysis , 1994 .

[19]  Richard D. Braatz,et al.  Principal Component Analysis of Process Datasets with Missing Values , 2017 .

[20]  Xu Yang,et al.  Robust PLS approach for KPI-related prediction and diagnosis against outliers and missing data , 2014, Int. J. Syst. Sci..

[21]  Richard D. Braatz,et al.  A combined canonical variate analysis and Fisher discriminant analysis (CVA-FDA) approach for fault diagnosis , 2015, Comput. Chem. Eng..

[22]  Richard D. Braatz,et al.  Perspectives on process monitoring of industrial systems , 2016, Annu. Rev. Control..

[23]  Richard D. Braatz,et al.  An Information-Theoretic Framework for Fault Detection Evaluation and Design of Optimal Dimensionality Reduction Methods , 2018 .

[24]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[25]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[26]  Steven X. Ding,et al.  A Review on Basic Data-Driven Approaches for Industrial Process Monitoring , 2014, IEEE Transactions on Industrial Electronics.

[27]  In-Beum Lee,et al.  Process monitoring based on probabilistic PCA , 2003 .

[28]  Tommy W. S. Chow,et al.  Effective feature selection scheme using mutual information , 2005, Neurocomputing.

[29]  Zhiqiang Ge,et al.  Review on data-driven modeling and monitoring for plant-wide industrial processes , 2017 .

[30]  Yi Cao,et al.  Nonlinear Dynamic Process Monitoring Using Canonical Variate Analysis and Kernel Density Estimations , 2009 .

[31]  Zhi-huan Song,et al.  Mixture Bayesian regularization method of PPCA for multimode process monitoring , 2010 .

[32]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[33]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[34]  Zhiqiang Ge,et al.  Distributed Parallel PCA for Modeling and Monitoring of Large-Scale Plant-Wide Processes With Big Data , 2017, IEEE Transactions on Industrial Informatics.