Twin support vector regression for the simultaneous learning of a function and its derivatives

Twin support vector regression (TSVR) determines a pair of $$\epsilon$$-insensitive up- and down-bound functions by solving two related support vector machine-type problems, each of which is smaller than that in a classical SVR. On the lines of TSVR, we have proposed a novel regressor for the simultaneous learning of a function and its derivatives, termed as TSVR of a Function and its Derivatives. Results over several functions of more than one variable demonstrate its effectiveness over other existing approaches in terms of improving the estimation accuracy and reducing run time complexity.

[1]  Glenn Fung,et al.  Proximal support vector machine classifiers , 2001, KDD '01.

[2]  Xizhao Wang,et al.  Fast Fuzzy Multicategory SVM Based on Support Vector Domain Description , 2008, Int. J. Pattern Recognit. Artif. Intell..

[3]  Ira Kemelmacher-Shlizerman,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 3d Face Reconstruction from a Single Image Using a Single Reference Face Shape , 2022 .

[4]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Pascal Fua,et al.  3D stereo reconstruction of human faces driven by differential constraints , 2000, Image Vis. Comput..

[6]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[7]  Leon O. Chua,et al.  Device modeling by radial basis functions , 1992 .

[8]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[9]  Theodore B. Trafalis,et al.  Support vector machine for regression and applications to financial forecasting , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[10]  H. Martín,et al.  Orthogonal variant moments features in image analysis , 2010 .

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[13]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[14]  Glenn Fung,et al.  Incremental Support Vector Machine Classification , 2002, SDM.

[15]  C. L. Philip Chen,et al.  Adaptive least squares support vector machines filter for hand tremor canceling in microsurgery , 2011, Int. J. Mach. Learn. Cybern..

[16]  Fei He,et al.  Discrete-Time Model Representation for Biochemical Pathway Systems , 2007 .

[17]  Zheng Gao,et al.  Multiple faults diagnosis in motion system based on SVM , 2012, Int. J. Mach. Learn. Cybern..

[18]  Fernando Pérez-Cruz,et al.  Convergence of the IRWLS Procedure to the Support Vector Machine Solution , 2005, Neural Computation.

[19]  Reshma Khemchandani,et al.  Regularized least squares fuzzy support vector regression for financial time series forecasting , 2009, Expert Syst. Appl..

[20]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[22]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[23]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[24]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[25]  Xinjun Peng,et al.  TSVR: An efficient Twin Support Vector Machine for regression , 2010, Neural Networks.

[26]  Reshma Khemchandani,et al.  Regularized Least Squares Twin SVR for the Simultaneous Learning of a Function and its Derivative , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[27]  Songfeng Zheng,et al.  Gradient descent algorithms for quantile regression with smooth approximation , 2011, Int. J. Mach. Learn. Cybern..

[28]  Zhi-Hua Zhou,et al.  Non-Parametric Kernel Learning with robust pairwise constraints , 2012, Int. J. Mach. Learn. Cybern..

[29]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[30]  Reshma Khemchandani,et al.  Regularized least squares support vector regression for the simultaneous learning of a function and its derivatives , 2008, Inf. Sci..

[32]  Fernando Pérez-Cruz,et al.  Support Vector Regression for the simultaneous learning of a multivariate function and its derivatives , 2005, Neurocomputing.

[33]  Touradj Ebrahimi,et al.  Joint Time-Frequency-Space Classification of EEG in a Brain-Computer Interface Application , 2003, EURASIP J. Adv. Signal Process..