Smooth augmented lagrangian method for twin bounded support vector machine

In this paper, we propose a method for solving the twin bounded support vector machine (TBSVM) for the binary classification. To do so, we use the augmented Lagrangian (AL) optimization method and smoothing technique, to obtain new unconstrained smooth minimization problems for TBSVM classifiers. At first, the augmented Lagrangian method is recruited to convert TBSVM into unconstrained minimization programming problems called as AL-TBSVM. We attempt to solve the primal programming problems of AL-TBSVM by converting them into smooth unconstrained minimization problems. Then, the smooth reformulations of AL-TBSVM, which we called AL-STBSVM, are solved by the well-known Newton's algorithm. Finally, experimental results on artificial and several University of California Irvine (UCI) benchmark data sets are provided along with the statistical analysis to show the superior performance of our method in terms of classification accuracy and learning speed.

[1]  Ting Wang,et al.  Color image segmentation using pixel wise support vector machine classification , 2011, Pattern Recognit..

[2]  Qingna Li,et al.  An efficient augmented Lagrangian method for support vector machine , 2020, Optim. Methods Softw..

[3]  Fatemeh Bazikar,et al.  DC programming and DCA for parametric-margin ν-support vector machine , 2020, Applied Intelligence.

[4]  Saeed Ketabchi,et al.  Minimum Norm Solution to the Absolute Value Equation in the Convex Case , 2012, J. Optim. Theory Appl..

[5]  Panos M. Pardalos,et al.  An improvement on parametric $$\nu $$ν-support vector algorithm for classification , 2019, Ann. Oper. Res..

[6]  Yuan-Hai Shao,et al.  Improvements on Twin Support Vector Machines , 2011, IEEE Transactions on Neural Networks.

[7]  Glenn Fung,et al.  Proximal support vector machine classifiers , 2001, KDD '01.

[8]  Saeed Ketabchi,et al.  Generalized Twin Support Vector Machines , 2021, Neural Processing Letters.

[9]  Ali Mostafaeipour,et al.  Forecasting the wind power generation using Box–Jenkins and hybrid artificial intelligence , 2019, International Journal of Energy Sector Management.

[10]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[12]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[13]  Madan Gopal,et al.  Application of smoothing technique on twin support vector machines , 2008, Pattern Recognit. Lett..

[14]  Yitian Xu,et al.  An improved ν-twin bounded support vector machine , 2018, Applied Intelligence.

[15]  R. Iman,et al.  Approximations of the critical region of the fbietkan statistic , 1980 .

[16]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[17]  Roohallah Alizadehsani,et al.  Computer aided decision making for heart disease detection using hybrid neural network-Genetic algorithm , 2017, Comput. Methods Programs Biomed..

[18]  Zhiquan Qi,et al.  Review on: Twin Support Vector Machines , 2014, Annals of Data Science.

[19]  Lan Bai,et al.  Twin Support Vector Machine for Clustering , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Saeed Ketabchi,et al.  Augmented Lagrangian method for recourse problem of two-stage stochastic linear programming , 2013, Kybernetika.

[21]  Olvi L. Mangasarian,et al.  Smoothing methods for convex inequalities and linear complementarity problems , 1995, Math. Program..

[22]  Ying-jie Tian,et al.  Improved twin support vector machine , 2013, Science China Mathematics.

[23]  Reza Tavakkoli-Moghaddam,et al.  An Improved Artificial Intelligence Based on Gray Wolf Optimization and Cultural Algorithm to Predict Demand for Dairy Products: A Case Study , 2019, Int. J. Interact. Multim. Artif. Intell..

[24]  Reza Tavakkoli-Moghaddam,et al.  Hybrid artificial intelligence and robust optimization for a multi-objective product portfolio problem Case study: The dairy products industry , 2019, Comput. Ind. Eng..

[25]  Yahia Zare Mehrjerdi,et al.  A robust optimization model for sustainable and resilient closed-loop supply chain network design considering conditional value at risk , 2021, Numerical Algebra, Control & Optimization.

[26]  José Mario Martínez,et al.  Practical augmented Lagrangian methods for constrained optimization , 2014, Fundamentals of algorithms.

[27]  G. Weber,et al.  A robust time-cost-quality-energy-environment trade-off with resource-constrained in project management: A case study for a bridge construction project , 2020, Journal of Industrial & Management Optimization.

[28]  Olvi L. Mangasarian,et al.  A class of smoothing functions for nonlinear and mixed complementarity problems , 1996, Comput. Optim. Appl..

[29]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[30]  Ling Jing,et al.  Fuzzy and interval-valued fuzzy nonparallel support vector machine , 2019, J. Intell. Fuzzy Syst..

[31]  A. Goli,et al.  Application of Improved Artificial Intelligence with Runner-Root Meta-Heuristic Algorithm for Dairy Products Industry: A Case Study , 2020, Int. J. Artif. Intell. Tools.

[32]  Domenico Ciuonzo,et al.  Learning Wireless Sensor Networks for Source Localization , 2019, Sensors.

[33]  Reshma Khemchandani,et al.  Improvements on ν-Twin Support Vector Machine , 2016, Neural Networks.

[34]  Yuh-Jye Lee,et al.  SSVM: A Smooth Support Vector Machine for Classification , 2001, Comput. Optim. Appl..

[35]  Reza Tavakkoli-Moghaddam,et al.  Application of robust optimization for a product portfolio problem using an invasive weed optimization algorithm , 2019, Numerical Algebra, Control & Optimization.

[36]  Xinjun Peng,et al.  A nu-twin support vector machine (nu-TSVM) classifier and its geometric algorithms , 2010, Inf. Sci..

[37]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.