kNN-RVM lazy learning approach for soft-sensing modeling of fed-batch processes

Fed-batch processes are inherently difficult to model owing to non-steady-state operation, small-sample condition, instinct time-variation and batch-to-batch variation caused by drifting. Furthermore, when the process switches to different operation phrases, global learning modeling methods would suffer poor performance due to the negative impact of overdue training samples. In this paper, a k nearest neighbor relevance vector machine (kNN-RVM) based lazy learning method is proposed to model the fed-batch processes to soft-sense the corresponding production indices. A recursive algorithm is developed to effectively obtain the kernel matrices used by previous kNN step and following modeling process. Simulative soft-sensors of penicillin production process and rubber mixing process are implemented to valid the proposed method. Comparative results indict that proposed method has better precision and much lower computational complexity than relevance vector machine (RVM) on soft-sensing modeling of fed-batch processes.

[1]  David J. C. MacKay,et al.  The Evidence Framework Applied to Classification Networks , 1992, Neural Computation.

[2]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[3]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[4]  Ping Li,et al.  Selective recursive kernel learning for online identification of nonlinear systems with NARX form , 2010 .

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  An adaptive neuro-fuzzy inference system as a soft sensor for viscosity in rubber mixing process , 2000 .

[7]  Haiqing Wang,et al.  Soft Chemical Analyzer Development Using Adaptive Least-Squares Support Vector Regression with Selective Pruning and Variable Moving Window Size , 2009 .

[8]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[9]  Gülnur Birol,et al.  A modular simulation package for fed-batch fermentation: penicillin production , 2002 .

[10]  Ana González-Marcos,et al.  A neural network-based approach for optimising rubber extrusion lines , 2007, Int. J. Comput. Integr. Manuf..

[11]  Geoffrey I. Webb,et al.  Lazy Learning of Bayesian Rules , 2000, Machine Learning.

[12]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[13]  Youxian Sun,et al.  Soft Sensor Based on Relevance Vector Machines for Microbiological Fermentation , 2008 .

[14]  Michael E. Tipping,et al.  Fast Marginal Likelihood Maximisation for Sparse Bayesian Models , 2003 .

[15]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[16]  Haiqing Wang,et al.  Study of discharge modeling method using support vector machine for rubber mixing process , 2003, Proceedings of the 2003 American Control Conference, 2003..

[17]  Song Kai RPLS based adaptive statistical quality monitoring of rubber mixing process , 2007 .

[18]  Scott C. James,et al.  ON-LINE ESTIMATION IN BIOREACTORS: A REVIEW , 2000 .

[19]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[20]  Ping Li,et al.  Kernel classifier with adaptive structure and fixed memory for process diagnosis , 2006 .

[21]  Ping Li,et al.  Kernel learning adaptive one‐step‐ahead predictive control for nonlinear processes , 2008 .

[22]  Yi Liu,et al.  Online prediction of Mooney viscosity in industrial rubber mixing process via adaptive kernel learning method , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[23]  V. Vijayabaskar,et al.  Prediction of properties of rubber by using artificial neural networks , 2006 .