Fault Diagnosis of Unseen Modes in Chemical Processes Based on Labeling and Class Progressive Adversarial Learning

While deep neural network (DNN)-based fault diagnosis methods can monitor the faults that occur on the operating modes, they cannot perform well on the modes that are never experienced before. This limitation makes it challenging to ensure the production safety of chemical processes. In this article, this issue is formulated as domain generalization (DG), which aims to learn a universal fault diagnosis model from historical operating modes that can generalize well to unseen modes. Many existing DG approaches focus on learning a domain-invariant representation by aligning marginal distributions between domains, which ignore the conditional relationships and label information. Recently, some researches start to reduce the discrepancy of the class conditional distributions across domains, while the theoretical justifications of that are still missing. To address this issue, the theoretical analysis of DG is developed to investigate how to minimize the unseen domains’ risk, which is a theoretical guarantee that the DG methods can generalize well over unseen domains. This theory reveals that the unseen domain error can be bounded by the shift of the label and class conditional distributions across source domains. Then, this result motivates a novel labeling and class progressive adversarial learning (LCPAL) algorithm for fault diagnosis, which simultaneously controls the errors weighted based on label information and aligns the class conditional distributions between different historical operating modes, as well as reducing the adverse effect of the domain-specific feature. Empirical results on both the numerical example and the Tennessee Eastman process (TEP) demonstrate the effectiveness of the LCPAL approach.

[1]  Nabil Magbool Jan,et al.  No-Delay Multimodal Process Monitoring Using Kullback-Leibler Divergence-Based Statistics in Probabilistic Mixture Models , 2023, IEEE Transactions on Automation Science and Engineering.

[2]  W. Gui,et al.  Layer‐wise contribution‐filtered propagation for deep learning‐based fault isolation , 2022, International Journal of Robust and Nonlinear Control.

[3]  W. Gui,et al.  Imputation of Missing Values in Time Series Using an Adaptive-Learned Median-Filled Deep Autoencoder , 2022, IEEE Transactions on Cybernetics.

[4]  Hongbo Shi,et al.  Hierarchical Latent Variable Extraction and Multisegment Probability Density Analysis Method for Incipient Fault Detection , 2022, IEEE Transactions on Industrial Informatics.

[5]  Sinno Jialin Pan,et al.  AdaRNN: Adaptive Learning and Forecasting of Time Series , 2021, CIKM.

[6]  Hongbo Shi,et al.  Adaptive Manifold Discriminative Distribution Alignment for Fault Diagnosis of Chemical Processes , 2021, Industrial & Engineering Chemistry Research.

[7]  Chunhui Zhao,et al.  Multisource-Refined Transfer Network for Industrial Fault Diagnosis Under Domain and Category Inconsistencies , 2021, IEEE Transactions on Cybernetics.

[8]  Cuiling Lan,et al.  Generalizing to Unseen Domains: A Survey on Domain Generalization , 2021, IEEE Transactions on Knowledge and Data Engineering.

[9]  Jipu Li,et al.  Deep Semisupervised Domain Generalization Network for Rotary Machinery Fault Diagnosis Under Variable Speed , 2020, IEEE Transactions on Instrumentation and Measurement.

[10]  B. Chaib-draa,et al.  Domain generalization via optimal transport with metric similarity learning , 2020, Neurocomputing.

[11]  Donghua Zhou,et al.  Multimode process monitoring based on fault dependent variable selection and moving window-negative log likelihood probability , 2020, Comput. Chem. Eng..

[12]  Jinsong Zhao,et al.  Fault detection and diagnosis based on transfer learning for multimode chemical processes , 2020, Comput. Chem. Eng..

[13]  Qingming Huang,et al.  Gradually Vanishing Bridge for Adversarial Domain Adaptation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Sivaraman Balakrishnan,et al.  A Unified View of Label Shift Estimation , 2020, NeurIPS.

[15]  Minqiang Xu,et al.  Intelligent Fault Identification Based on Multisource Domain Generalization Towards Actual Diagnosis Scenario , 2020, IEEE Transactions on Industrial Electronics.

[16]  Chunhui Zhao,et al.  A Fine-Grained Adversarial Network Method for Cross-Domain Industrial Fault Diagnosis , 2020, IEEE Transactions on Automation Science and Engineering.

[17]  Yang Tao,et al.  Performance-Indicator-Oriented Concurrent Subspace Process Monitoring Method , 2019, IEEE Transactions on Industrial Electronics.

[18]  Pong C. Yuen,et al.  Multi-Adversarial Discriminative Deep Domain Generalization for Face Presentation Attack Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Alex ChiChung Kot,et al.  Domain Generalization with Adversarial Feature Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Yongxin Yang,et al.  Learning to Generalize: Meta-Learning for Domain Generalization , 2017, AAAI.

[21]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[22]  Cristobal Ruiz-Carcel,et al.  Statistical process monitoring of a multiphase flow facility , 2015 .

[23]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[24]  Joelle Pineau,et al.  Online Bagging and Boosting for Imbalanced Data Streams , 2013, IEEE Transactions on Knowledge and Data Engineering.

[25]  Bernhard Schölkopf,et al.  Domain Generalization via Invariant Feature Representation , 2013, ICML.

[26]  In-Beum Lee,et al.  Nonlinear dynamic process monitoring based on dynamic kernel PCA , 2004 .

[27]  Rolf Isermann,et al.  Supervision, fault-detection and fault-diagnosis methods — An introduction , 1997 .

[28]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[29]  Min Xia,et al.  Intelligent Process Monitoring of Laser-Induced Graphene Production With Deep Transfer Learning , 2022, IEEE Transactions on Instrumentation and Measurement.

[30]  H. Shi,et al.  Consistency Regularization Auto-Encoder Network for Semi-Supervised Process Fault Diagnosis , 2022, IEEE Transactions on Instrumentation and Measurement.

[31]  Keke Huang,et al.  Multimode Process Monitoring and Mode Identification Based on Multiple Dictionary Learning , 2021, IEEE Transactions on Instrumentation and Measurement.

[32]  Jianbo Yu,et al.  Convolutional Long Short-Term Memory Autoencoder-Based Feature Learning for Fault Detection in Industrial Processes , 2021, IEEE Transactions on Instrumentation and Measurement.

[33]  Hongbo Shi,et al.  A Supervised Adaptive Resampling Monitoring Method for Quality Indicator in Time-Varying Process , 2021, IEEE Transactions on Instrumentation and Measurement.

[34]  Biao Huang,et al.  Data-Driven Fault Detection for Dynamic Systems With Performance Degradation: A Unified Transfer Learning Framework , 2021, IEEE Transactions on Instrumentation and Measurement.