Regularized least squares support vector regression for the simultaneous learning of a function and its derivatives

In this paper, we propose a regularized least squares approach based support vector machine for simultaneously approximating a function and its derivatives. The proposed algorithm is simple and fast as no quadratic programming solver needs to be employed. Effectively, only the solution of a structured system of linear equations is needed.

[1]  Fernando Pérez-Cruz,et al.  Convergence of the IRWLS Procedure to the Support Vector Machine Solution , 2005, Neural Computation.

[2]  Reshma Khemchandani,et al.  Regularized least squares fuzzy support vector regression for financial time series forecasting , 2009, Expert Syst. Appl..

[3]  Lucie P. Aarts,et al.  Neural Network Method for Solving Partial Differential Equations , 2001, Neural Processing Letters.

[4]  Jiménez,et al.  Neural network differential equation and plasma equilibrium solver. , 1995, Physical review letters.

[5]  Gene H. Golub,et al.  Matrix computations , 1983 .

[6]  Jung Liu,et al.  Shape-based image retrieval using support vector machines, Fourier descriptors and self-organizing maps , 2007, Inf. Sci..

[7]  Alexander Gammerman,et al.  Ridge Regression Learning Algorithm in Dual Variables , 1998, ICML.

[8]  Leon O. Chua,et al.  Device modeling by radial basis functions , 1992 .

[9]  Leszek Rutkowski,et al.  A general approach for nonparametric fitting of functions and their derivatives with applications to linear circuits identification , 1986 .

[10]  Piet M. T. Broersen.  How to select polynomial models with an accurate derivative , 2000, IEEE Trans. Instrum. Meas..

[11]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  M. Omair Ahmad,et al.  Optimizing the kernel in the empirical feature space , 2005, IEEE Transactions on Neural Networks.

[14]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[15]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[16]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[17]  Thorsten Joachims,et al.  A Statistical Learning Model of Text Classification for Support Vector Machines. , 2001, SIGIR 2002.

[18]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[19]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[20]  Fernando Pérez-Cruz,et al.  Support Vector Regression for the simultaneous learning of a multivariate function and its derivatives , 2005, Neurocomputing.

[21]  J. N. Kok,et al.  A multilevel nonlinearity study design , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[22]  Ulrich Stadtmüller,et al.  Bandwidth choice and confidence intervals for derivatives of noisy data , 1987 .

[23]  Glenn Fung,et al.  Proximal support vector machine classifiers , 2001, KDD '01.

[24]  Thorsten Joachims,et al.  A statistical learning learning model of text classification for support vector machines , 2001, SIGIR '01.

[25]  Matthias W. Seeger,et al.  Using the Nyström Method to Speed Up Kernel Machines , 2000, NIPS.

[26]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.