Smooth support vector machine based on piecewise function

Abstract Support vector machines (SVMs) have shown remarkable success in many applications. However, the non-smooth feature of objective function is a limitation in practical application of SVMs. To overcome this disadvantage, a twice continuously differentiable piecewise-smooth function is constructed to smooth the objective function of unconstrained support vector machine (SVM), and it issues a piecewise-smooth support vector machine (PWESSVM). Comparing to the other smooth approximation functions, the smooth precision has an obvious improvement. The theoretical analysis shows PWESSVM is globally convergent. Numerical results and comparisons demonstrate the classification performance of our algorithm is better than other competitive baselines.

[1]  Eduardo J Spinosa,et al.  Support vector machines for novel class detection in Bioinformatics. , 2005, Genetics and molecular research : GMR.

[2]  LI Guang-ming,et al.  Research on a New Class of Functions for Smoothing Support Vector Machines , 2007 .

[3]  Yuan-Hai Shao,et al.  A coordinate descent margin based-twin support vector machine for classification , 2012, Neural Networks.

[4]  Jorge Nocedal,et al.  On the Behavior of the Gradient Norm in the Steepest Descent Method , 2002, Comput. Optim. Appl..

[5]  YuBo Yuan,et al.  A Polynomial Smooth Support Vector Machine for Classification , 2005, ADMA.

[6]  Santi Wulan Purnami,et al.  ! ! 1 ! , 1995 .

[7]  Ji Zheng,et al.  A support vector machine classifier with automatic confidence and its application to gender classification , 2011, Neurocomputing.

[8]  Xue Sun,et al.  Multi-class text categorization based on LDA and SVM , 2011 .

[9]  Walmir M. Caminhas,et al.  SVM practical industrial application for mechanical faults diagnostic , 2011, Expert Syst. Appl..

[10]  Xin Zhou,et al.  Application of kernel methods in signals modulation classification , 2011 .

[11]  Zhi-cheng Zhao.  Combining SVM and CHMM classifiers for porno video recognition , 2012 .

[12]  Michael C. Ferris,et al.  Semismooth support vector machines , 2004, Math. Program..

[13]  Yubo Yuan,et al.  SPLINE FUNCTION SMOOTH SUPPORT VECTOR MACHINE FOR CLASSIFICATION , 2007 .

[14]  Yuh-Jye Lee,et al.  SSVM: A Smooth Support Vector Machine for Classification , 2001, Comput. Optim. Appl..

[15]  Jing Cai,et al.  A Support Vector Classifier Based on Vague Similarity Measure , 2013 .

[16]  Chengxian Xu,et al.  A Survey of Quasi-Newton Equations and Quasi-Newton Methods for Optimization , 2001, Ann. Oper. Res..

[17]  Robert Hable,et al.  Consistency of support vector machines using additive kernels for additive models , 2012, Comput. Stat. Data Anal..

[18]  B. Yuan,et al.  New Solution Method to Smoothing Support Vector Machine with One Control Parameter Smoothing Function , 2010, 2010 Second WRI Global Congress on Intelligent Systems.

[19]  Jih Pin Yeh,et al.  Optimal reduction of solutions for support vector machines , 2009, Appl. Math. Comput..

[20]  Yubo Yuan,et al.  Forecasting the movement direction of exchange rate with polynomial smooth support vector machine , 2013, Math. Comput. Model..