Nonlinear PLS Integrated with Error-Based LSSVM and Its Application to NOX Modeling

This article presents a novel nonlinear partial least-squares (PLS) method to address a nonlinear problem with input collinearity in an industrial process. The proposed method integrates an inner least-squares support vector machine (LSSVM) function with an outer linear PLS framework. First, the input and output latent variables are extracted to eliminate the collinearity through PLS projection, and then LSSVM is used to construct nonlinear relation between each pair of latent variables. Moreover, a weight-updating procedure is incorporated to enhance the accuracy of prediction. Then, training and predicting algorithms based on modified nonlinear iterative partial least-squares (NIPALS) steps are also described in detail. The performance of the new method is also investigated with a benchmark data set. Finally, this approach is applied to a real industrial process to predict the NO x emissions of a coal-fired boiler. The root-mean-square errors (RMSEs) on the training and testing data decreased to only 12.6632 and 37.6609, respectively. Compared with the original linear PLS and other kinds of nonlinear PLS methods, a reduction of approximately 40.8―47.4% in the prediction errors is attained. The results reveal that the new approach is capable of modeling the nonlinear relation of NO x emissions with other process parameters and improving the prediction performance.

[1]  Hao Zhou,et al.  A comparative study of optimization algorithms for low NOx combustion modification at a coal-fired utility boiler , 2009, Expert Syst. Appl..

[2]  S. Wold,et al.  Some recent developments in PLS modeling , 2001 .

[3]  Priyanka Ojha,et al.  Partial least squares and artificial neural networks modeling for predicting chlorophenol removal from aqueous solution , 2009 .

[4]  Gabriele Pannocchia,et al.  Prediction of coal ash thermal properties using Partial Least Squares Regression , 2003 .

[5]  G. Lim,et al.  A nonlinear partial least squares algorithm using quadratic fuzzy inference system , 2009 .

[6]  Zhiqiang Ge,et al.  Nonlinear Soft Sensor Development Based on Relevance Vector Machine , 2010 .

[7]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[8]  F. Doyle,et al.  Predictive Dynamic Modeling of Key Process Variables in Granulation Processes Using Partial Least Squares Approach , 2011 .

[9]  Thomas J. McAvoy,et al.  Nonlinear PLS Modeling Using Neural Networks , 1992 .

[10]  Hao Zhou,et al.  Computational intelligence approach for NOx emissions minimization in a coal-fired utility boiler , 2010 .

[11]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[12]  Biao Huang,et al.  Dealing with Irregular Data in Soft Sensors: Bayesian Method and Comparative Study , 2008 .

[13]  In-Beum Lee,et al.  A novel multivariate regression approach based on kernel partial least squares with orthogonal signal correction , 2005 .

[14]  Hao Zhou,et al.  Modeling NOx emissions from coal-fired utility boilers using support vector regression with ant colony optimization , 2012, Eng. Appl. Artif. Intell..

[15]  Michael J. Pazzani,et al.  A Principal Components Approach to Combining Regression Estimates , 1999, Machine Learning.

[16]  Jialin Liu,et al.  Development of Self-Validating Soft Sensors Using Fast Moving Window Partial Least Squares , 2010 .

[17]  Julian Morris,et al.  A non-linear nested partial least-squares algorithm , 2005, Comput. Stat. Data Anal..

[18]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[19]  E. Martin,et al.  Non-linear projection to latent structures revisited: the quadratic PLS algorithm , 1999 .

[20]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[21]  Dae Sung Lee,et al.  On-line estimation of key process variables based on kernel partial least squares in an industrial cokes wastewater treatment plant. , 2009, Journal of hazardous materials.

[22]  Jialin Liu,et al.  On-line soft sensor for polyethylene process with multiple production grades , 2007 .

[23]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[24]  Ahmet Palazoglu,et al.  Orthogonal nonlinear partial least-squares regression , 2003 .

[25]  Johan A. K. Suykens,et al.  Benchmarking Least Squares Support Vector Machine Classifiers , 2004, Machine Learning.

[26]  Ying-wei Zhang,et al.  Complex process monitoring using modified partial least squares method of independent component regression , 2009 .

[27]  A. J. Morris,et al.  Non-linear projection to latent structures revisited (the neural network PLS algorithm) , 1999 .

[28]  Xi Zhang,et al.  Nonlinear Multivariate Quality Estimation and Prediction Based on Kernel Partial Least Squares , 2008 .

[29]  B. Kowalski,et al.  Partial least-squares regression: a tutorial , 1986 .

[30]  Zhi-Hua Zhou,et al.  Ensemble of GA based Selective Neural Network Ensembles , 2002 .

[31]  J. Ross Quinlan,et al.  Combining Instance-Based and Model-Based Learning , 1993, ICML.

[32]  George W. Irwin,et al.  Nonlinear PLS modelling using radial basis functions , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[33]  Wu Zhan-song.  Combustion Optimization for Utility Boiler Based on Least Square-support Vector Machine , 2010 .

[34]  S. Wold,et al.  Nonlinear PLS modeling , 1989 .

[35]  Yan Zhou,et al.  Robust partial least squares regression: Part I, algorithmic developments , 2008 .

[36]  C. Yoo,et al.  Nonlinear PLS modeling with fuzzy inference system , 2002 .