Nonlinear soft sensor development for industrial thickeners using domain transfer functional-link neural network

Abstract The thickener is used to provide slurries with a stable and satisfactory concentration in the ore dressing plant. To efficiently control an industrial thickener, a soft sensor model should be built first to predict the underflow concentration. In industrial sites, it is usually expensive and time-consuming to collect sufficient high-quality data to develop a data-driven model. In this work, a nonlinear regression method for transfer learning is proposed to solve this problem, which is named domain transfer functional-link neural network (DT-FLNN). The framework of the proposed method includes two stages, and the issue of domain adaption is separately considered at each stage. In the first stage, the activation matrix of the source domain is reconstructed to narrow the distribution difference, and the augmented input matrices of the source and target domains are formulated. Then, the latent variable (LV) based linear regression method for transfer learning is performed at the second stage to train the FLNN of the target domain, and the task of domain adaption is realized by introducing a regularization term. Besides, a systematic method is also presented to determine the hyper-parameters in the proposed DT-FLNN method. The efficiency of the proposed method is evaluated by employing a numerical example and an industrial application. Compared with other nonlinear regression approaches for transfer learning, the proposed method can further increase the prediction accuracy and reduce the influence of noise.

[1]  C. L. Philip Chen,et al.  Robust Broad Learning System for Uncertain Data Modeling , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  S. L. Brooy,et al.  Review of gold extraction from ores , 1994 .

[3]  Clayton D. Scott,et al.  Robust kernel density estimation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[5]  Furong Gao,et al.  Model Migration with Inclusive Similarity for Development of a New Process Model , 2008 .

[6]  Frank-Michael Schleif,et al.  Transfer learning extensions for the probabilistic classification vector machine , 2020, Neurocomputing.

[7]  C. L. Philip Chen,et al.  Transductive Transfer Learning Based on Broad Learning System , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Yang Hu,et al.  Fault diagnostics between different type of components: A transfer learning approach , 2020, Appl. Soft Comput..

[9]  Chao Yang,et al.  Development of Adversarial Transfer Learning Soft Sensor for Multigrade Processes , 2020 .

[10]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[11]  Furong Gao,et al.  Similar Batch Process Monitoring With Orthogonal Subspace Alignment , 2018, IEEE Transactions on Industrial Electronics.

[12]  P. N. Suganthan,et al.  A comprehensive evaluation of random vector functional link networks , 2016, Inf. Sci..

[13]  Theodora Kourti,et al.  Product transfer between sites using Joint-Y PLS , 2005 .

[14]  Philip S. Yu,et al.  Domain Invariant Transfer Kernel Learning , 2015, IEEE Transactions on Knowledge and Data Engineering.

[15]  Furong Gao,et al.  Bayesian improved model migration methodology for fast process modeling by incorporating prior information , 2015 .

[16]  Yuan Yao,et al.  Transfer of Qualitative and Quantitative Knowledge for Similar Batch Process Monitoring , 2018, IEEE Access.

[17]  Ingmar Nopens,et al.  A consistent modelling methodology for secondary settling tanks in wastewater treatment. , 2011, Water research.

[18]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[19]  Qiang Yang,et al.  Cross-domain sentiment classification via spectral feature alignment , 2010, WWW '10.

[20]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.

[21]  Fengqi You,et al.  Transfer learning for end-product quality prediction of batch processes using domain-adaption joint-Y PLS , 2020, Comput. Chem. Eng..

[22]  Ivor W. Tsang,et al.  Domain Transfer Multiple Kernel Learning , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Kaixin Liu,et al.  Domain adaptation transfer learning soft sensor for product quality prediction , 2019, Chemometrics and Intelligent Laboratory Systems.

[24]  Xiaoping Ma,et al.  Weighted Broad Learning System and Its Application in Nonlinear Industrial Process Modeling , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Tao Chen,et al.  Transfer learning for efficient meta-modeling of process simulations , 2018 .

[26]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[27]  L. A. Houseman,et al.  PlantStar 2000: a plant-wide control platform for minerals processing , 2001 .

[28]  John Blitzer,et al.  Domain Adaptation with Structural Correspondence Learning , 2006, EMNLP.

[29]  Ingmar Nopens,et al.  On reliable and unreliable numerical methods for the simulation of secondary settling tanks in wastewater treatment , 2012, Comput. Chem. Eng..

[30]  Jingjing Guo,et al.  Adaptive Modeling of Fixed-Bed Reactors with Multicycle and Multimode Characteristics Based on Transfer Learning and Just-In-Time Learning , 2020 .

[31]  Danyu Xu,et al.  A method for characterizing the complete settling process of activated sludge. , 2006, Water research.

[32]  Furong Gao,et al.  Model Migration for Development of a New Process Model , 2009 .

[33]  Dakuo He,et al.  Data-driven-based self-healing control of abnormal feeding conditions in thickening–dewatering process , 2020 .

[34]  D. Massart,et al.  The Radial Basis Functions — Partial Least Squares approach as a flexible non-linear regression technique , 1996 .

[35]  Milan Papež,et al.  Robust Bayesian Transfer Learning Between Kalman Filters , 2019, 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP).

[36]  Ivor W. Tsang,et al.  Domain Transfer SVM for video concept detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[39]  Edwin Lughofer,et al.  Domain-Invariant Partial-Least-Squares Regression. , 2018, Analytical chemistry.

[40]  David Zhang,et al.  Domain Adaptation Extreme Learning Machines for Drift Compensation in E-Nose Systems , 2015, IEEE Transactions on Instrumentation and Measurement.

[41]  Jian Sun,et al.  A Practical Transfer Learning Algorithm for Face Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[42]  Lisha Guo,et al.  An experimental study of low concentration sludge settling velocity under turbulent condition. , 2009, Water research.

[43]  Najdan Vukovic,et al.  A comprehensive experimental evaluation of orthogonal polynomial expanded random vector functional link neural networks for regression , 2017, Appl. Soft Comput..

[44]  Fuli Wang,et al.  Assessment of operating performance using cross-domain feature transfer learning , 2019, Control Engineering Practice.

[45]  Shunming Li,et al.  A novel transfer learning method for robust fault diagnosis of rotating machines under variable working conditions , 2019, Measurement.

[46]  Fuli Wang,et al.  Final quality prediction method for new batch processes based on improved JYKPLS process transfer model , 2018, Chemometrics and Intelligent Laboratory Systems.

[47]  Zhizhong Mao,et al.  Kernel partial robust M-regression as a flexible robust nonlinear modeling technique , 2010 .

[48]  S. Wold,et al.  PLS-regression: a basic tool of chemometrics , 2001 .

[49]  Fuli Wang,et al.  Safety control modeling method based on Bayesian network transfer learning for the thickening process of gold hydrometallurgy , 2020, Knowl. Based Syst..

[50]  Dacheng Tao,et al.  Bregman Divergence-Based Regularization for Transfer Subspace Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[51]  Chao Chen,et al.  Parameter Transfer Extreme Learning Machine based on Projective Model , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).