Adaptive virtual sensors using SNPER for the localized construction and elastic net regularization in nonlinear processes

Abstract Traditional data-driven virtual sensors were constructed upon the macro-perspective of the manifold structure using generalized models. They did not focus on the local relationships among the data samples through micro-perspective of manifold proximity indicating the local relationships among the data samples. In the case with the quantity of data points fewer than the dimensions of the data variables, the virtual sensor model is likely to be unstable, ill-conditioned, and computationally expensive. And the real-world data often vary with time. It is difficult, in the long term, to sustain good performance by a single fixed model. This paper addresses the aforementioned issues by proposing three algorithms (NPER, SNPER, and LW-SNPER) to successively improve the virtual sensor modeling performance for nonlinear, high-dimensional and time-varying processes. It is shown through the numerical cases and a real semiconductor process that the proposed algorithms perform better than the other regular regression algorithms.

[1]  Manabu Kano,et al.  Soft‐sensor development using correlation‐based just‐in‐time modeling , 2009 .

[2]  Dexian Huang,et al.  Probabilistic slow feature analysis‐based representation learning from massive process data for soft sensor modeling , 2015 .

[3]  S.Joe Qin,et al.  Neural Networks for Intelligent Sensors and Control — Practical Issues and Some Solutions , 1997 .

[4]  Zhiqiang Ge,et al.  Dynamic Probabilistic Latent Variable Model for Process Data Modeling and Regression Application , 2019, IEEE Transactions on Control Systems Technology.

[5]  Yanjun Ma,et al.  Bayesian Learning for Dynamic Feature Extraction With Application in Soft Sensing , 2017, IEEE Transactions on Industrial Electronics.

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Zhiqiang Ge,et al.  Moving window adaptive soft sensor for state shifting process based on weighted supervised latent factor analysis , 2017 .

[8]  Hong Huang,et al.  Improved discriminant sparsity neighborhood preserving embedding for hyperspectral image classification , 2014, Neurocomputing.

[9]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[10]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[11]  Stefano Malan,et al.  Parameters Estimation of Hydraulic Circuit Head Losses for Virtual Sensor Design , 2017, IEEE Transactions on Control Systems Technology.

[12]  Xuefeng Yan,et al.  Just‐in‐time reorganized PCA integrated with SVDD for chemical process monitoring , 2014 .

[13]  Jianbin Qiu,et al.  Fault Detection for Nonlinear Process With Deterministic Disturbances: A Just-In-Time Learning Based Data Driven Method , 2017, IEEE Transactions on Cybernetics.

[14]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[15]  Marco Sorrentino,et al.  Neural network models for virtual sensing of NOx emissions in automotive diesel engines with least square-based adaptation , 2017 .

[16]  Zhiqiang Ge,et al.  Adaptive soft sensors for quality prediction under the framework of Bayesian network , 2018 .

[17]  Zhiqiang Ge,et al.  Supervised Latent Factor Analysis for Process Data Regression Modeling and Soft Sensor Application , 2016, IEEE Transactions on Control Systems Technology.

[18]  Zhiqiang Ge,et al.  Data Mining and Analytics in the Process Industry: The Role of Machine Learning , 2017, IEEE Access.

[19]  Hiromasa Kaneko,et al.  Development of a new soft sensor method using independent component analysis and partial least squares , 2009 .

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Zhiqiang Ge,et al.  Review on data-driven modeling and monitoring for plant-wide industrial processes , 2017 .

[23]  Koichi Fujiwara,et al.  Development of correlation-based pattern recognition algorithm and adaptive soft-sensor design , 2012 .

[24]  Biao Huang,et al.  Multiple model based soft sensor development with irregular/missing process output measurement , 2011, 2011 International Symposium on Advanced Control of Industrial Processes (ADCONIP).

[25]  Shuicheng Yan,et al.  Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[26]  Michel Benne,et al.  Soft-sensor for industrial sugar crystallization: On-line mass of crystals, concentration and purity measurement , 2010 .

[27]  Zhiqiang Ge,et al.  Mixture semisupervised principal component regression model and soft sensor application , 2014 .

[28]  K. Funatsu,et al.  Ensemble locally weighted partial least squares as a just‐in‐time modeling method , 2016 .

[29]  Di Tang,et al.  A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application , 2017, IEEE Transactions on Industrial Electronics.

[30]  Jin Wang,et al.  Comparison of the performance of a reduced-order dynamic PLS soft sensor with different updating schemes for digester control , 2012 .

[31]  Jialin Liu,et al.  On-line soft sensor for polyethylene process with multiple production grades , 2007 .

[32]  Zhiqiang Ge,et al.  Nonlocal structure constrained neighborhood preserving embedding model and its application for fault detection , 2015 .

[33]  Hiromasa Kaneko,et al.  Application of Online Support Vector Regression for Soft Sensors , 2014 .

[34]  Manabu Kano,et al.  Locally weighted kernel partial least squares regression based on sparse nonlinear features for virtual sensing of nonlinear time-varying processes , 2017, Comput. Chem. Eng..

[35]  Hongbo Shi,et al.  Multimode process monitoring using improved dynamic neighborhood preserving embedding , 2014 .

[36]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[37]  Junghui Chen,et al.  Active Selection of Informative Data for Sequential Quality Enhancement of Soft Sensor Models with Latent Variables , 2017 .

[38]  Luigi Fortuna,et al.  Soft sensors for product quality monitoring in debutanizer distillation columns , 2005 .

[39]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[40]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[41]  C. Yoo,et al.  Nonlinear process monitoring using kernel principal component analysis , 2004 .

[42]  Bogdan Gabrys,et al.  Local learning‐based adaptive soft sensor for catalyst activation prediction , 2011 .