Online local learning based adaptive soft sensor and its application to an industrial fed-batch chlortetracycline fermentation process

Abstract This work presents a new method for adaptive soft sensor development by further exploiting just-in-time modeling framework. In the presented method, referred to as online local learning based adaptive soft sensor (OLLASS), the samples used for local modeling are selected based on the mutual information (MI) weighted or neighbor sample based similarity measure. Then, two adaptive methods, namely self-validation and neighbor-validation, are developed to adaptively select the optimal local modeling size for scenarios without and with the neighbor output information, respectively. Further, a real-time performance improvement strategy is used to enhance the online modeling efficiency. Moreover, an online dual updating strategy is proposed to activate infrequent local model updating and model output offset updating in turn, which allows significantly reducing the online computational load by avoiding unnecessary local model reconstruction while at the same time maintaining high estimation accuracy by performing offset compensation. A maximal similarity replacement rule using MI weighted similarity measure is used for database updating. The superiority of the proposed OLLASS method over traditional soft sensors in terms of the estimation accuracy, adaptive capability and real-time performance is demonstrated through an industrial fed-batch chlortetracycline fermentation process.

[1]  Sirish L. Shah,et al.  Inferential sensors for estimation of polymer quality parameters: Industrial application of a PLS-based soft sensor for a LDPE plant , 2006 .

[2]  Jie Yu.  Multiway Gaussian Mixture Model Based Adaptive Kernel Partial Least Squares Regression Method for Soft Sensor Estimation and Reliable Quality Prediction of Nonlinear Multiphase Batch Processes , 2012 .

[3]  Tao Chen,et al.  Bagging for Gaussian process regression , 2009, Neurocomputing.

[4]  Koichi Fujiwara,et al.  Development of correlation-based pattern recognition algorithm and adaptive soft-sensor design , 2012 .

[5]  Zhi-huan Song,et al.  Locally Weighted Kernel Principal Component Regression Model for Soft Sensing of Nonlinear Time-Variant Processes , 2014 .

[6]  Zhiqiang Ge,et al.  A comparative study of just-in-time-learning based methods for online soft sensor modeling , 2010 .

[7]  Lian Zhao,et al.  Adaptive neuro-fuzzy based inferential sensor model for estimating the average air temperature in space heating systems , 2009 .

[8]  Sten Bay Jørgensen,et al.  A systematic approach for soft sensor development , 2007, Comput. Chem. Eng..

[9]  Hiromasa Kaneko,et al.  Adaptive soft sensor based on online support vector regression and Bayesian ensemble learning for various states in chemical plants , 2014 .

[10]  Hiromasa Kaneko,et al.  Maintenance-free soft sensor models with time difference of process variables , 2011 .

[11]  Zhiqiang Ge,et al.  Soft sensor model development in multiphase/multimode processes based on Gaussian mixture regression , 2014 .

[12]  Hiromasa Kaneko,et al.  Application of Online Support Vector Regression for Soft Sensors , 2014 .

[13]  Lei Wu,et al.  Hybrid intelligent control of substrate feeding for industrial fed-batch chlortetracycline fermentation process. , 2014, ISA transactions.

[14]  Dong-Sheng Cao,et al.  The boosting: A new idea of building models , 2010 .

[15]  B. Kowalski,et al.  Partial least-squares regression: a tutorial , 1986 .

[16]  Manabu Kano,et al.  Long-Term Industrial Applications of Inferential Control Based on Just-In-Time Soft-Sensors: Economical Impact and Challenges , 2013 .

[17]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[18]  Andrew W. Moore,et al.  Locally Weighted Learning for Control , 1997, Artificial Intelligence Review.

[19]  Koichi Fujiwara,et al.  Virtual sensing technology in process industries: Trends and challenges revealed by recent industria , 2013 .

[20]  Bogdan Gabrys,et al.  Review of adaptation mechanisms for data-driven soft sensors , 2011, Comput. Chem. Eng..

[21]  Fuli Wang,et al.  Neural network ensemble modeling for nosiheptide fermentation process based on partial least squares regression , 2011 .

[22]  Chi Ma,et al.  Fault diagnosis of nonlinear processes using multiscale KPCA and multiscale KPLS , 2011 .

[23]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[24]  Furong Gao,et al.  Review of Recent Research on Data-Based Process Monitoring , 2013 .

[25]  Jie Yu,et al.  Online quality prediction of nonlinear and non-Gaussian chemical processes with shifting dynamics using finite mixture model based Gaussian process regression approach , 2012 .

[26]  Biao Huang,et al.  Design of inferential sensors in the process industry: A review of Bayesian methods , 2013 .

[27]  Mudassir M. Rashid,et al.  A new dissimilarity method integrating multidimensional mutual information and independent component analysis for non-Gaussian dynamic process monitoring , 2012 .

[28]  Zhiqiang Ge,et al.  Ensemble independent component regression models and soft sensing application , 2014 .

[29]  Xuefeng Yan,et al.  Batch process monitoring based on just-in-time learning and multiple-subspace principal component analysis , 2014 .

[30]  Jingqi Yuan,et al.  Data-driven prediction of the product formation in industrial 2-keto-l-gulonic acid fermentation , 2012, Comput. Chem. Eng..

[31]  Zhi-huan Song,et al.  Adaptive local kernel-based learning for soft sensor modeling of nonlinear processes , 2011 .

[32]  Stefan Schaal,et al.  Scalable Techniques from Nonparametric Statistics for Real Time Robot Learning , 2002, Applied Intelligence.

[33]  Jie Yu,et al.  A Bayesian inference based two-stage support vector regression framework for soft sensor development in batch bioprocesses , 2012, Comput. Chem. Eng..

[34]  Soon Keat Tan,et al.  Moving-Window GPR for Nonlinear Dynamic System Modeling with Dual Updating and Dual Preprocessing , 2012 .

[35]  T. Isaksson,et al.  New approach for distance measurement in locally weighted regression , 1994 .

[36]  Michel Verleysen,et al.  Resampling methods for parameter-free and robust feature selection with mutual information , 2007, Neurocomputing.

[37]  Biao Huang,et al.  Development and industrial application of soft sensors with on-line Bayesian model updating strategy , 2013 .

[38]  Hiromasa Kaneko,et al.  Database monitoring index for adaptive soft sensors and the application to industrial process , 2014 .

[39]  Jie Yu,et al.  A non-Gaussian pattern matching based dynamic process monitoring approach and its application to cryogenic air separation process , 2013, Comput. Chem. Eng..

[40]  Jialin Liu,et al.  On-line soft sensor for polyethylene process with multiple production grades , 2007 .

[41]  Lei Xie,et al.  Novel Just-In-Time Learning-Based Soft Sensor Utilizing Non-Gaussian Information , 2014, IEEE Transactions on Control Systems Technology.

[42]  Luiz Augusto da Cruz Meleiro,et al.  ANN-based soft-sensor for real-time process monitoring and control of an industrial polymerization process , 2009, Comput. Chem. Eng..

[43]  S. Wold,et al.  PLS-regression: a basic tool of chemometrics , 2001 .

[44]  Manabu Kano,et al.  Data-based process monitoring, process control, and quality improvement: Recent developments and applications in steel industry , 2008, Comput. Chem. Eng..

[45]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Daniel E. Rivera,et al.  A 'Model-on-Demand' identification methodology for non-linear process systems , 2001 .

[47]  George Cybenko,et al.  Just-in-Time Learning and Estimation , 1996 .

[48]  Bogdan Gabrys,et al.  Local learning‐based adaptive soft sensor for catalyst activation prediction , 2011 .

[49]  Bernhard Schölkopf,et al.  Kernel Principal Component Analysis , 1997, ICANN.

[50]  Morimasa Ogawa,et al.  The state of the art in chemical process control in Japan: Good practice and questionnaire survey , 2010 .

[51]  Biao Huang,et al.  A unified recursive just-in-time approach with industrial near infrared spectroscopy application , 2014 .

[52]  Xi Zhang,et al.  Nonlinear Multivariate Quality Estimation and Prediction Based on Kernel Partial Least Squares , 2008 .

[53]  Mudassir Rashid,et al.  Nonlinear and Non-Gaussian Dynamic Batch Process Monitoring Using a New Multiway Kernel Independent Component Analysis and Multidimensional Mutual Information Based Dissimilarity Approach , 2012 .

[54]  Hiromasa Kaneko,et al.  Classification of the Degradation of Soft Sensor Models and Discussion on Adaptive Models , 2013 .

[55]  Manabu Kano,et al.  Optimum quality design system for steel products through locally weighted regression model , 2011 .

[56]  Hiromasa Kaneko,et al.  A soft sensor method based on values predicted from multiple intervals of time difference for improvement and estimation of prediction accuracy , 2011 .

[57]  Hiromasa Kaneko,et al.  Adaptive soft sensor model using online support vector regression with time variable and discussion of appropriate hyperparameter settings and window size , 2013, Comput. Chem. Eng..

[58]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  Zhiqiang Ge,et al.  Mixture semisupervised principal component regression model and soft sensor application , 2014 .

[60]  Zhiqiang Ge,et al.  External analysis‐based regression model for robust soft sensing of multimode chemical processes , 2014 .

[61]  Dražen Slišković,et al.  Adaptive soft sensor for online prediction and process monitoring based on a mixture of Gaussian process models , 2013, Comput. Chem. Eng..

[62]  Yeong-Koo Yeo,et al.  A recursive PLS-based soft sensor for prediction of the melt index during grade change operations in HDPE plant , 2009 .

[63]  Manabu Kano,et al.  Soft‐sensor development using correlation‐based just‐in‐time modeling , 2009 .

[64]  M. Chiu,et al.  A new data-based methodology for nonlinear process modeling , 2004 .

[65]  Ping Wu,et al.  Online dual updating with recursive PLS model and its application in predicting crystal size of purified terephthalic acid (PTA) process , 2006 .

[66]  Manabu Kano,et al.  Development of soft-sensor using locally weighted PLS with adaptive similarity measure , 2013 .

[67]  Mauro Birattari,et al.  Lazy Learning Meets the Recursive Least Squares Algorithm , 1998, NIPS.

[68]  G. Irwin,et al.  Process monitoring approach using fast moving window PCA , 2005 .

[69]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[70]  S. Qin.  Recursive PLS algorithms for adaptive data modeling , 1998 .

[71]  Jian Chu,et al.  Multiple Model Soft Sensor Based on Affinity Propagation, Gaussian Process and Bayesian Committee Machine , 2009 .

[72]  Manabu Kano,et al.  Estimation of active pharmaceutical ingredients content using locally weighted partial least squares and statistical wavelength selection. , 2011, International journal of pharmaceutics.

[73]  Jie Yu,et al.  A Bayesian model averaging based multi-kernel Gaussian process regression framework for nonlinear state estimation and quality prediction of multiphase batch processes with transient dynamics and uncertainty , 2013 .

[74]  Min-Sen Chiu,et al.  Nonlinear process monitoring using JITL-PCA , 2005 .

[75]  M. Birattari,et al.  Lazy learning for local modelling and control design , 1999 .

[76]  Željko Hocenski,et al.  Methods for Plant Data-Based Process Modeling in Soft-Sensor Development , 2011 .

[77]  Hiromasa Kaneko,et al.  Development of a new soft sensor method using independent component analysis and partial least squares , 2009 .

[78]  K. Fujiwara,et al.  Development of correlation-based clustering method and its application to software sensing , 2010 .

[79]  En Sup Yoon,et al.  Weighted support vector machine for quality estimation in the polymerization process , 2005 .

[80]  Furong Gao,et al.  Stage-based process analysis and quality prediction for batch processes , 2005 .

[81]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[82]  Lei Wu,et al.  Adaptive soft sensor modeling framework based on just-in-time learning and kernel partial least squares regression for nonlinear multiphase batch processes , 2014, Comput. Chem. Eng..

[83]  Soon Keat Tan,et al.  Localized, Adaptive Recursive Partial Least Squares Regression for Dynamic System Modeling , 2012 .

[84]  Stefan Schaal,et al.  Incremental Online Learning in High Dimensions , 2005, Neural Computation.

[85]  I. Jolliffe.  Principal Component Analysis , 2002 .

[86]  S. Wold.  Nonlinear partial least squares modelling II. Spline inner relation , 1992 .

[87]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[88]  A. Saptoro.  State of the Art in the Development of Adaptive Soft Sensors based on Just-in-Time Models , 2014 .

[89]  Bhaskar D. Kulkarni,et al.  Development of a soft sensor for a batch distillation column using support vector regression techniques , 2007 .

[90]  Steven D. Brown,et al.  A localized adaptive soft sensor for dynamic system modeling , 2014 .