A Zero-Shot Soft Sensor Modeling Approach Using Adversarial Learning for Robustness Against Sensor Fault

Soft sensors are widely used in many industrial systems to monitor key variables that are difficult to measure, using measurements from other available physical sensors. Because physical sensors are susceptible to faults, it is crucial for soft sensor models to be robust against them. Recently, deep learning has shown promising results in developing data-driven soft sensors for various applications. However, existing learning-based soft sensors are still vulnerable to sensor faults, which could deteriorate the performance of the models. In this article, we propose a deep learning-based modeling framework for developing soft sensor models that are robust to sensor faults. Due to the difficulty in obtaining datasets that cover all possible sensor fault characteristics, the proposed framework is developed to be zero-shot such that the model can be trained with only fault-free dataset without requiring any sensor fault patterns, thus greatly saving the time and resources needed to collect such data. Instead, adversarial examples are used as a proxy for faulty sensor inputs so that the model can learn to be adaptive through the proposed two-stage, uncertainty-aware recurrent neural network architecture. We demonstrate our approach to the TE benchmark process and a real industrial multiphase flow process and show that robustness is achieved as the accuracy does not degrade significantly when sensor faults are present during the model evaluation.

[1]  Zhiqiang Ge,et al.  Adversarial Attacks on Neural-Network-Based Soft Sensors: Directly Attack Output , 2022, IEEE Transactions on Industrial Informatics.

[2]  Chunhui Zhao,et al.  Adversarial smoothing tri-regression for robust semi-supervised industrial soft sensor , 2021, Journal of Process Control.

[3]  Han Liu,et al.  A Hybrid Mechanism- and Data-Driven Soft Sensor Based on the Generative Adversarial Network and Gated Recurrent Unit , 2021, IEEE Sensors Journal.

[4]  Alireza Fatehi,et al.  Domain Adversarial Neural Network Regression to design transferable soft sensor in a power plant , 2021, Comput. Ind..

[5]  Chunhui Zhao,et al.  A Deep Probabilistic Transfer Learning Framework for Soft Sensor Modeling With Missing Data , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Chunhui Zhao,et al.  Fault Description Based Attribute Transfer for Zero-Sample Industrial Fault Diagnosis , 2021, IEEE Transactions on Industrial Informatics.

[7]  Zhiqiang Ge,et al.  A Survey on Deep Learning for Data-Driven Soft Sensors , 2021, IEEE Transactions on Industrial Informatics.

[8]  Chao Yang,et al.  Development of Adversarial Transfer Learning Soft Sensor for Multigrade Processes , 2020 .

[9]  Ying Wang,et al.  Recent advances in sensor fault diagnosis: A review , 2020 .

[10]  Zhiqiang Ge,et al.  Automatic Deep Extraction of Robust Dynamic Features for Industrial Big Data Modeling and Soft Sensor Application , 2020, IEEE Transactions on Industrial Informatics.

[11]  Lin Li,et al.  Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network , 2020, IEEE Transactions on Industrial Informatics.

[12]  Lamyaa Sadouk,et al.  Robust Loss Function for Deep Learning Regression with Outliers , 2020 .

[13]  Xianqiang Yang,et al.  Mixture robust L1 probabilistic principal component regression and soft sensor application , 2020 .

[14]  Shuihua Zheng,et al.  Robust Soft Sensor with Deep Kernel Learning for Quality Prediction in Rubber Mixing Processes , 2020, Sensors.

[15]  Xiao Wang,et al.  Data Preprocessing for Soft Sensor Using Generative Adversarial Networks , 2018, 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[16]  Ting-Hua Yi,et al.  Development of sensor validation methodologies for structural health monitoring: A comprehensive review , 2017 .

[17]  Christoph H. Lampert,et al.  Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Aleksander Madry,et al.  Towards Deep Learning Models Resistant to Adversarial Attacks , 2017, ICLR.

[19]  Di Tang,et al.  A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application , 2017, IEEE Transactions on Industrial Electronics.

[20]  David A. Wagner,et al.  Towards Evaluating the Robustness of Neural Networks , 2016, 2017 IEEE Symposium on Security and Privacy (SP).

[21]  Yan-Lin He,et al.  Soft-sensing model development using PLSR-based dynamic extreme learning machine with an enhanced hidden layer , 2016 .

[22]  ChangKyoo Yoo,et al.  A robust localized soft sensor for particulate matter modeling in Seoul metro systems. , 2016, Journal of hazardous materials.

[23]  Rui Araújo,et al.  Review of soft sensor methods for regression applications , 2016 .

[24]  Cristobal Ruiz-Carcel,et al.  Statistical process monitoring of a multiphase flow facility , 2015 .

[25]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[26]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[27]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[28]  Ramesh Govindan,et al.  Sensor faults: Detection methods and prevalence in real-world datasets , 2010, TOSN.

[29]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[30]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[31]  Xiao Wang,et al.  Data supplement for a soft sensor using a new generative model based on a variational autoencoder and Wasserstein GAN , 2020 .

[32]  Maia B. Cook,et al.  Additional Tennessee Eastman Process Simulation Data for Anomaly Detection Evaluation , 2017 .

[33]  Hooshang Jazayeri-Rad,et al.  Robust data-driven soft sensor based on iteratively weighted least squares support vector regression optimized by the cuckoo optimization algorithm , 2015 .