Recursive weighted kernel regression for semi-supervised soft-sensing modeling of fed-batch processes

Abstract Soft-sensor techniques have been increasingly applied in chemical industry to establish an online monitor of unmeasured product indices. However, one intrinsic obstacle of soft-sensing modeling is insufficiency of labeled data while unlabeled data is abundant. In this work, a semi-supervised recursive weighted kernel regression (RWKR) method is proposed to model the soft-sensor by leveraging both labeled and unlabeled data. A novel weight strategy is presented to improve the prediction and its recursive algorithm is formulated, which adopts the incremental and decremental learning mechanism to update the soft-sensor model online and control the model complexity. Simulative soft-sensor for penicillin production process indicates that RWKR is superior to both relevance vector machine (RVM) and harmonic functions to model such fed-batch processes. Additionally, it sheds light on more competitive semi-supervised soft-sensing modeling approaches.

[1]  Meng Wang,et al.  Semi-Supervised Kernel Regression , 2006, Sixth International Conference on Data Mining (ICDM'06).

[2]  Zhi-Hua Zhou,et al.  Semi-Supervised Regression with Co-Training , 2005, IJCAI.

[3]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[4]  Gene H. Golub,et al.  Matrix computations , 1983 .

[5]  Ronald Rosenfeld,et al.  Semi-supervised learning with graphs , 2005 .

[6]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[7]  V. Vijayabaskar,et al.  Prediction of properties of rubber by using artificial neural networks , 2006 .

[8]  Kun Chen,et al.  kNN-RVM lazy learning approach for soft-sensing modeling of fed-batch processes , 2011, 2011 International Symposium on Advanced Control of Industrial Processes (ADCONIP).

[9]  Song Kai.  RPLS based adaptive statistical quality monitoring of rubber mixing process , 2007 .

[10]  Guanfeng Liu,et al.  A TSVM Based Semi-Supervised Approach to SAR Image Segmentation , 2008, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[11]  In-Beum Lee,et al.  A novel multivariate regression approach based on kernel partial least squares with orthogonal signal correction , 2005 .

[12]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[13]  Pierantonio Facco,et al.  Moving average PLS soft sensor for online product quality estimation in an industrial batch polymerization process , 2009 .

[14]  Luiz Augusto da Cruz Meleiro,et al.  ANN-based soft-sensor for real-time process monitoring and control of an industrial polymerization process , 2009, Comput. Chem. Eng..

[15]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[16]  Gülnur Birol,et al.  A modular simulation package for fed-batch fermentation: penicillin production , 2002 .

[17]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[19]  U. Kruger,et al.  Moving window kernel PCA for adaptive monitoring of nonlinear processes , 2009 .

[20]  Scott C. James,et al.  ON-LINE ESTIMATION IN BIOREACTORS: A REVIEW , 2000 .

[21]  Michael E. Tipping.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[22]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[23]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[24]  Jason Weston,et al.  Semi-supervised Protein Classification Using Cluster Kernels , 2003, NIPS.

[25]  Ping Li,et al.  Selective recursive kernel learning for online identification of nonlinear systems with NARX form , 2010 .

[26]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[27]  İlker Bekir Topçu,et al.  Prediction of rubberized mortar properties using artificial neural network and fuzzy logic , 2008 .

[28]  S. J. Parulekar,et al.  A morphologically structured model for penicillin production , 2002, Biotechnology and bioengineering.

[29]  Haiqing Wang,et al.  Soft Chemical Analyzer Development Using Adaptive Least-Squares Support Vector Regression with Selective Pruning and Variable Moving Window Size , 2009 .

[30]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.