Selection and Fusion of Similarity Measure Based Classifiers Using Support Vector Machines

In this paper, we address the problem of selecting and fusing similarity measures based classifiers in LDA face space. The performance of a face verification system in an LDA feature space using different similarity measure based classifiers is experimentally studied first. The study is performed for both manually and automatically registered face images. A sequential search approach which is in principle similar to the "plus L and take away R" algorithm is then applied in order to find an optimum subset of the adopted classifiers. The selected classifiers are combined using the SVM classifier. We show that although, individually, one of the adopted scoring functions, the Gradient Direction distance outperforms the other metrics, by fusing different similarity measures using the proposed method, the resulting decision making scheme improves the performance of the system in different conditions.

[1]  Antanas Verikas,et al.  Soft combination of neural classifiers: A comparative study , 1999, Pattern Recognit. Lett..

[2]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[3]  Fabio Roli,et al.  Analysis of Linear and Order Statistics Combiners for Fusion of Imbalanced Classifiers , 2002, Multiple Classifier Systems.

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Mohammad Shahram Moin,et al.  A New Approach on Multimodal Biometrics Based on Combining Neural Networks Using AdaBoost , 2004, ECCV Workshop BioAW.

[7]  Josef Kittler,et al.  Similarity Measures Fusion Using SVM Classifier for Face Authentication , 2008, VISAPP.

[8]  Robert P. W. Duin,et al.  The combining classifier: to train or not to train? , 2002, Object recognition supported by user interaction for service robots.

[9]  Josef Kittler,et al.  Confidence Based Gating of Multiple Face Authentication Experts , 2006, SSPR/SPR.

[10]  Jiri Matas,et al.  Feature-based affine-invariant localization of faces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Vytautas Perlibakas,et al.  Distance measures for PCA-based face recognition , 2004, Pattern Recognit. Lett..

[12]  Josef Kittler,et al.  Decision making in the LDA space: generalised gradient direction metric , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[13]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[14]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[15]  Josef Kittler,et al.  Multiple classifier systems : second International Workshop, MCS 2001, Cambridge, UK, July 2-4, 2001 : proceedings , 2001 .

[16]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[17]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .