Joint monitoring of multiple quality-related indicators in nonlinear processes based on multi-task learning

Abstract Current strategies for quality-related process monitoring mainly focus on a single quality indicator. For multiple related indicators, traditional algorithms extract the same quality-related features from variable spaces while neglecting the specific features of each indicator. Considering the correlation among these quality indicators, essential information can be captured in common features without being affected by the noise pattern of each indicator. By contrast, specific features are also needed for accuracy prediction. In this work, an end-to-end multiple quality-related model is proposed to monitor indicators jointly on the basis of a multi-task learning framework. Apart from the predictive loss of these quality indicators, this model finds the correlation among the extracted features according to the soft parameter-sharing strategy. After that, quality-related and quality-unrelated statistics are calculated to detect faults. Finally, the proposed method is evaluated by different cases in the Tennessee–Eastman and wind turbine blade icing processes.

[1]  Tong Zhang,et al.  A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , 2005, J. Mach. Learn. Res..

[2]  Donghua Zhou,et al.  Total projection to latent structures for process monitoring , 2009 .

[3]  Kai-xiang Peng,et al.  Quality-Related Process Monitoring Based on Total Kernel PLS Model and Its Industrial Application , 2013 .

[4]  Xiaojun Chang,et al.  Semisupervised Feature Analysis by Mining Correlations Among Multiple Tasks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[6]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[7]  Guang Wang,et al.  A Kernel Least Squares Based Approach for Nonlinear Quality-Related Fault Detection , 2017, IEEE Transactions on Industrial Electronics.

[8]  Xiangyang Xue,et al.  Flexible multi-task learning with latent task grouping , 2016, Neurocomputing.

[9]  Rama Chellappa,et al.  HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shen Yin,et al.  Recent Advances in Key-Performance-Indicator Oriented Prognosis and Diagnosis With a MATLAB Toolbox: DB-KIT , 2019, IEEE Transactions on Industrial Informatics.

[11]  S. Joe Qin,et al.  Quality‐relevant and process‐relevant fault monitoring with concurrent projection to latent structures , 2013 .

[12]  Chi-Keong Goh,et al.  Co-evolutionary multi-task learning for dynamic time series prediction , 2017, Appl. Soft Comput..

[13]  Xuefeng Yan,et al.  Batch process monitoring based on self-adaptive subspace support vector data description , 2017 .

[14]  Biao Huang,et al.  Survey on the theoretical research and engineering applications of multivariate statistics process monitoring algorithms: 2008-2017 , 2018, The Canadian Journal of Chemical Engineering.

[15]  Kaixiang Peng,et al.  A comparison and evaluation of key performance indicator-based multivariate statistics process monitoring approaches ☆ , 2015 .

[16]  Okyay Kaynak,et al.  Data-Driven Monitoring and Safety Control of Industrial Cyber-Physical Systems: Basics and Beyond , 2018, IEEE Access.

[17]  Xin Yu,et al.  Multi-local-task learning with global regularization for object tracking , 2015, Pattern Recognit..

[18]  Yangkang Chen,et al.  Data-driven multitask sparse dictionary learning for noise attenuation of 3D seismic data , 2017 .

[19]  Martial Hebert,et al.  Cross-Stitch Networks for Multi-task Learning , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Xuefeng Yan,et al.  Whole Process Monitoring Based on Unstable Neuron Output Information in Hidden Layers of Deep Belief Network , 2019, IEEE Transactions on Cybernetics.

[21]  Tom Heskes,et al.  Task Clustering and Gating for Bayesian Multitask Learning , 2003, J. Mach. Learn. Res..

[22]  Hao Luo,et al.  Quality-related fault detection using linear and nonlinear principal component regression , 2016, J. Frankl. Inst..

[23]  Okyay Kaynak,et al.  Optimized Design of Parity Relation-Based Residual Generator for Fault Detection: Data-Driven Approaches , 2021, IEEE Transactions on Industrial Informatics.

[24]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[25]  Biao Huang,et al.  Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling With Variable-Wise Weighted SAE , 2018, IEEE Transactions on Industrial Informatics.

[26]  Yuting Su,et al.  HEp-2 cells Classification via clustered multi-task learning , 2016, Neurocomputing.

[27]  Huijun Gao,et al.  Data-Based Techniques Focused on Modern Industry: An Overview , 2015, IEEE Transactions on Industrial Electronics.

[28]  Dit-Yan Yeung,et al.  Transfer metric learning by learning task relationships , 2010, KDD.

[29]  Chi-Keong Goh,et al.  Co-evolutionary multi-task learning with predictive recurrence for multi-step chaotic time series prediction , 2017, Neurocomputing.

[30]  Shen Yin,et al.  Real-Time Monitoring and Control of Industrial Cyberphysical Systems: With Integrated Plant-Wide Monitoring and Control Framework , 2019, IEEE Industrial Electronics Magazine.

[31]  Xuefeng Yan,et al.  Monitoring of quality-relevant and quality-irrelevant blocks with characteristic-similar variables based on self-organizing map and kernel approaches , 2019, Journal of Process Control.

[32]  Rohitash Chandra,et al.  Coevolutionary multi-task learning for feature-based modular pattern classification , 2018, Neurocomputing.

[33]  Zhang Yi,et al.  A multitask multiview clustering algorithm in heterogeneous situations based on LLE and LE , 2019, Knowl. Based Syst..

[34]  Shen Yin,et al.  A nonlinear quality-related fault detection approach based on modified kernel partial least squares. , 2017, ISA transactions.

[35]  Steven X. Ding,et al.  Data-driven design of monitoring and diagnosis systems for dynamic processes: A review of subspace technique based schemes and some recent results , 2014 .

[36]  Changsheng Xu,et al.  Learning Multi-Task Correlation Particle Filters for Visual Tracking , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Junfei Qiao,et al.  A self-organizing deep belief network for nonlinear system modeling , 2018, Appl. Soft Comput..

[38]  Biao Huang,et al.  Review and Perspectives of Data-Driven Distributed Monitoring for Industrial Plant-Wide Processes , 2019, Industrial & Engineering Chemistry Research.

[39]  Jie Tang,et al.  Predicting individual retweet behavior by user similarity: A multi-task learning approach , 2015, Knowl. Based Syst..