Knowledge Based ε-Support Vector Regression Method

The classical regression systems modeling methods only consider the single scene, which has the weakness: partial information missing may weaken the generalization abilities of the regression systems constructed based on this dataset. A regression system with the Knowledge transfer learning abilities, i.e. Knowledge Based ε-Support Vector Regression (KB-ε-SVR for brevity) is proposed based on ε-support vector regression. KB-ε-SVR can use the current data information sufficiently, and learn from the existing useful historical knowledge effectively, so that remedy the information lack in the current scene. Reinforced current model is obtained through control the similarity between current model and history model in the object function and current model can benefit from history scene when information is missing or insufficient. Experiments show that KB-ε-SVR has the better performance and adaptability than the traditional ε-support vector regression methods in scenarios with insufficient data.

[1]  Tom Heskes,et al.  Task Clustering and Gating for Bayesian Multitask Learning , 2003, J. Mach. Learn. Res..

[2]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[3]  Anton Schwaighofer,et al.  Learning Gaussian processes from multiple tasks , 2005, ICML.

[4]  Pei Yang,et al.  Bayesian Task-Level Transfer Learning for Non-linear Regression , 2008, 2008 International Conference on Computer Science and Software Engineering.

[5]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[6]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[7]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[8]  Zhaohong Deng,et al.  Knowledge-Leverage-Based TSK Fuzzy System Modeling , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.