Nonparallel Support Vector Machines for Multiple-Instance Learning

Abstract In this paper, we proposed a new multiple-instance learning (MIL) method based on nonparallel support vector machines (called MI-NPSVM). For the linear case, MI-NPSVM constructs two nonparallel hyperplanes by solving two SVM-type prob- lems, which is different from many other maximum margin SVM-based MIL methods. For the nonlinear case, kernel functions can be easily applied to extend the linear case, which is different from other nonparallel SVM-based MIL methods. Further- more, compared with the existing MIL method based on nonparallel SVM – MI-TSVM, MI-NPSVM has two main advantages. Firstly the method enforces the structural risk minimization; secondly it does not need to solve a bilevel programming prob- lem anymore, but to solve a series of standard Quadratic Programming Problems (QPPs). All experimental results on public datasets show that our method is superior to the traditional MIL methods like MI-SVM, MI-TSVM etc.

[1]  Yuan-Hai Shao,et al.  Improvements on Twin Support Vector Machines , 2011, IEEE Transactions on Neural Networks.

[2]  Nai-Yang Deng,et al.  Support Vector Machines: Optimization Based Theory, Algorithms, and Extensions , 2012 .

[3]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Yuan-Hai Shao,et al.  Multiple Instance Twin Support Vector Machines , 2010 .

[5]  Reshma Khemchandani,et al.  Optimal kernel selection in twin support vector machines , 2009, Optim. Lett..

[6]  Yong Shi,et al.  Twin support vector machine with Universum data , 2012, Neural Networks.

[7]  Jan Ramon,et al.  Multi instance neural networks , 2000, ICML 2000.

[8]  Oded Maron,et al.  Multiple-Instance Learning for Natural Scene Classification , 1998, ICML.

[9]  Nai-Yang Deng,et al.  Multi-instance Support Vector Machine Based on Convex Combination∗ , 2009 .

[10]  Qi Zhang,et al.  EM-DD: An Improved Multiple-Instance Learning Technique , 2001, NIPS.

[11]  Yong Shi,et al.  Robust twin support vector machine for pattern classification , 2013, Pattern Recognit..

[12]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[13]  Madan Gopal,et al.  Least squares twin support vector machines for pattern classification , 2009, Expert Syst. Appl..

[14]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[15]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.

[16]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[17]  Yong Shi,et al.  Laplacian twin support vector machine for semi-supervised classification , 2012, Neural Networks.

[18]  Edward W. Wild,et al.  Multiple Instance Classification via Successive Linear Programming , 2008 .

[19]  Yong Shi,et al.  Recent advances on support vector machines research , 2012 .

[20]  Zhi-Hua Zhou,et al.  Multi-Instance Learning Based Web Mining , 2005, Applied Intelligence.

[21]  Yuan-Hai Shao,et al.  Probabilistic outputs for twin support vector machines , 2012, Knowl. Based Syst..

[22]  Madan Gopal,et al.  Application of smoothing technique on twin support vector machines , 2008, Pattern Recognit. Lett..

[23]  Zhiquan Qi,et al.  Efficient sparse nonparallel support vector machines for classification , 2014, Neural Computing and Applications.