Support vector machine based exploratory projection pursuit optimization for user face identification

For most real-world biometric identification applications, the training database size could be very large, i.e. in the range of several thousands. This yields to the curse of dimensionality problem. The downside of such a problem is that it could negatively affect both the identification performance and speed. In this paper we use Exploratory Projection Pursuit (EPP) methods to determine clusters of users having significant similarities and then apply Support Vector Machine (SVM) classifiers on each cluster of users independently. This allows reducing the dimensionality of the dataset for training SVMs and thus improving the performance of user identification.

[1]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[2]  Nathan Intrator,et al.  Combining Exploratory Projection Pursuit and Projection Pursuit Regression with Application to Neural Networks , 1993, Neural Computation.

[3]  T. Rohatsch,et al.  Projection pursuit for analyzing data from semiconductor environments , 2006, IEEE Transactions on Semiconductor Manufacturing.

[4]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[5]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[6]  Jiayang Sun.  Some Practical Aspects of Exploratory Projection Pursuit , 1993, SIAM J. Sci. Comput..

[7]  Alain Berro,et al.  An Efficient Optimization Method for Revealing Local Optima of Projection Pursuit Indices , 2010, ANTS Conference.

[8]  S. Klinke,et al.  Exploratory Projection Pursuit , 1995 .

[9]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[10]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[11]  Alain Berro,et al.  Genetic algorithms and particle swarm optimization for exploratory projection pursuit , 2010, Annals of Mathematics and Artificial Intelligence.

[12]  F. Prieto,et al.  Cluster Identification Using Projections , 2001 .

[13]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[14]  J. Platt.  Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[15]  Li Li,et al.  Support Vector Machines , 2015 .

[16]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[17]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[20]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[21]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[22]  Wen Yu,et al.  SVM Classification for Large Data Sets by Considering Models of Classes Distribution , 2007, 2007 Sixth Mexican International Conference on Artificial Intelligence, Special Session (MICAI).