Improved 2-norm Based Fuzzy Least Squares Twin Support Vector Machine

In order to reduce the higher training cost of support vector machine (SVM) and its sensitivity towards noise and outliers, two fuzzy based approaches are proposed in this paper. The proposed approaches are based on least squares twin support vector machine (LSTWSVM) and fuzzy support vector machine (FSVM). The effects of noise and outliers are reduced by assigning lower membership values to the data points which are away from the class centers. Further, 2-norm of the slack vectors of the LSTWSVM formulation is taken after multiplying to their respective diagonal matrices of the membership values to effectively utilize the fuzzy membership principle and to make the optimization problem strongly convex. Moreover, the proposed approaches solve linear equations instead of quadratic programming problems which help in training faster. The effectiveness of the proposed approaches are established by comparing the classification accuracies and training time with support vector machine, fuzzy support vector machine, twin support vector machine and least squares twin support vector machine.

[1]  C. M. Bishop,et al.  Improvements on Twin Support Vector Machines , 2011 .

[2]  Kannan Balakrishnan,et al.  Unconstrained Handwritten Malayalam Character Recognition using Wavelet Transform and Support vector Machine Classifier , 2012 .

[3]  Kourosh Mozafari,et al.  Hepatitis disease diagnosis using a novel hybrid method based on support vector machine and simulated annealing (SVM-SA) , 2012, Comput. Methods Programs Biomed..

[4]  Somula Ramasubbareddy,et al.  Classification of Heart Disease Using Support Vector Machine , 2019, Journal of Computational and Theoretical Nanoscience.

[5]  Dayou Liu,et al.  A support vector machine classifier with rough set-based feature selection for breast cancer diagnosis , 2011, Expert Syst. Appl..

[6]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Juan Manuel Górriz,et al.  Computer-aided diagnosis of Alzheimer's type dementia combining support vector machines and discriminant set of features , 2013, Inf. Sci..

[8]  William M. Campbell,et al.  Support vector machines for speaker and language recognition , 2006, Comput. Speech Lang..

[9]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[10]  Yong Shi,et al.  Laplacian twin support vector machine for semi-supervised classification , 2012, Neural Networks.

[11]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[12]  M. L. Dewal,et al.  Epileptic seizure detection using DWT based fuzzy approximate entropy and support vector machine , 2014, Neurocomputing.

[13]  David R. Musicant,et al.  Lagrangian Support Vector Machines , 2001, J. Mach. Learn. Res..

[14]  Deepak Gupta,et al.  Entropy based fuzzy least squares twin support vector machine for class imbalance learning , 2018, Applied Intelligence.

[15]  Huimin Lu,et al.  Facial Emotion Recognition Based on Biorthogonal Wavelet Entropy, Fuzzy Support Vector Machine, and Stratified Cross Validation , 2016, IEEE Access.

[16]  Xinjun Peng,et al.  TSVR: An efficient Twin Support Vector Machine for regression , 2010, Neural Networks.

[17]  Preetha Phillips,et al.  Pathological brain detection in MRI scanning by wavelet packet Tsallis entropy and fuzzy support vector machine , 2015, SpringerPlus.

[18]  Deepak Gupta,et al.  A fuzzy twin support vector machine based on information entropy for class imbalance learning , 2019, Neural Computing and Applications.

[19]  M. N. Ayyaz,et al.  Handwritten Character Recognition Using Multiclass SVM Classification with Hybrid Feature Extraction , 2016 .

[20]  Nasser Ghadiri,et al.  Fuzzy Least Squares Twin Support Vector Machines , 2015, Eng. Appl. Artif. Intell..

[21]  Madan Gopal,et al.  Least squares twin support vector machines for pattern classification , 2009, Expert Syst. Appl..

[22]  SartakhtiJavad Salimi,et al.  Hepatitis disease diagnosis using a novel hybrid method based on support vector machine and simulated annealing (SVM-SA) , 2012 .

[23]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[24]  S. Balasundaram,et al.  Training Lagrangian twin support vector regression via unconstrained convex minimization , 2014, Knowl. Based Syst..

[25]  Yong Shi,et al.  Robust twin support vector machine for pattern classification , 2013, Pattern Recognit..

[26]  M. K. Soni,et al.  Speaker Recognition using Support Vector Machine , 2014 .

[27]  Yuwei Zhang,et al.  Face Recognition Based on Principle Component Analysis and Support Vector Machine , 2011, 2011 3rd International Workshop on Intelligent Systems and Applications.

[28]  Suresh Chandra,et al.  Robust Parametric Twin Support Vector Machine for Pattern Classification , 2018, Neural Processing Letters.

[29]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  William M. Campbell,et al.  Phonetic Speaker Recognition with Support Vector Machines , 2003, NIPS.

[31]  Jian Xiao,et al.  Electric vehicle state of charge estimation: Nonlinear correlation and fuzzy support vector machine , 2015 .