A Privacy-Preserving Twin Support Vector Machine Classifier for Vertical Partitioned Data

In this paper, a novel privacy-preserving binary classifier termed as Privacy Preservation Twin Support Vector Machine (PPTWSVM) has been proposed. The PPTWSVM formulation is motivated by the Privacy-Preserving Support Vector Machine (PPSVM) formulations of Mangasarian and Wild (Mangasarian et al. in ACM Trans Knowl Discov Data 2(3),12, 2008 [1]; Mangasarian and Edward in Privacy-preserving classification of horizontally partitioned data via random Kernels, 2008 [2]; Mangasarian and Edward in Privacy-preserving random Kernel classification of checkerboard partitioned data. Data mining. Springer, USA, 2010 [3]) and Twin Support Vector Machine (TWSVM) formulation of Jayadeva et al. (IEEE Trans Pattern Anal Mach Intell 29(5):905–910, 2007 [4]; Khemchandani and Chandra in Twin support vector machines: models, extensions and applications. Springer, 2016 [5]). Similar to PPSVM, PPTWSVM also employs the random kernel technique for preserving the privacy of participating entities which are holding the different feature columns of the representing data. An extensive numerical implementation on UCI benchmark datasets confirms that PPTWSVM is faster than PPSVM in the training phase and owns better generalization ability.

[1]  Jaideep Vaidya,et al.  Knowledge and Information Systems , 2007 .

[2]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[3]  O. Mangasarian,et al.  Massive data discrimination via linear support vector machines , 2000 .

[4]  Ming-Syan Chen,et al.  On the Design and Analysis of the Privacy-Preserving SVM Classifier , 2011, IEEE Transactions on Knowledge and Data Engineering.

[5]  Glenn Fung,et al.  Multicategory Proximal Support Vector Machine Classifiers , 2005, Machine Learning.

[6]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Federico Girosi,et al.  Support Vector Machines: Training and Applications , 1997 .

[9]  Glenn Fung,et al.  Privacy-preserving classification of vertically partitioned data via random kernels , 2008, TKDD.

[10]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[11]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[12]  Yuh-Jye Lee,et al.  RSVM: Reduced Support Vector Machines , 2001, SDM.

[13]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[15]  Vladimir Cherkassky,et al.  Learning from Data: Concepts, Theory, and Methods , 1998 .

[16]  Olvi L. Mangasarian,et al.  Privacy-Preserving Classification of Horizontally Partitioned Data via Random Kernels , 2008, DMIN.

[17]  Bernhard Schölkopf,et al.  Support vector channel selection in BCI , 2004, IEEE Transactions on Biomedical Engineering.

[18]  Olvi L. Mangasarian,et al.  Generalized Support Vector Machines , 1998 .

[19]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[20]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[21]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Olvi L. Mangasarian,et al.  Privacy-Preserving Random Kernel Classification of Checkerboard Partitioned Data , 2010, Data Mining.

[23]  Bernhard Schölkopf,et al.  Kernel Methods in Computational Biology , 2005 .

[24]  Reshma Khemchandani,et al.  Twin Support Vector Machines - Models, Extensions and Applications , 2016, Studies in Computational Intelligence.

[25]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.