Optimal fusion scheme selection framework based on genetic algorithms for multimodal face recognition

In this paper, we consider the problem of feature selection and classifier fusion and discuss how they should be reflected in the fusion system architecture. We employed the genetic algorithm with a novel coding to search the worst performing fusion strategy. The proposed algorithm tunes itself between feature and matching score levels, and improves the final performance over the original on two levels, and as a fusion method, it not only contains fusion strategy to combine the most relevant features so as to achieve adequate and optimized results, but also has the extensive ability to select the most discriminative features and their appropriate classifiers. Sparse Representation Classifier (SRC) and Nearest Neighbor classifier with euclidean distance, mahalanobis distance, cosine distance and correlation distance are exploited to calculate all the similarity measures. Experiments are provided on the FRGC database and show that the proposed method produces significantly better results than the baseline fusion methods

[1]  Chin-Seng Chua,et al.  Image Level Fusion Method for Multimodal 2D + 3D Face Recognition , 2008, ICIAR.

[2]  Daniel Rueckert,et al.  Evaluation of automatic 4D face recognition using surface and texture registration , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[3]  Bogdan Gabrys,et al.  Genetic algorithms in classifier fusion , 2006, Appl. Soft Comput..

[4]  Marina L. Gavrilova,et al.  FES: A System for Combining Face, Ear and Signature Biometrics Using Rank Level Fusion , 2008, Fifth International Conference on Information Technology: New Generations (itng 2008).

[5]  Mohammed Bennamoun,et al.  Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition , 2007, International Journal of Computer Vision.

[6]  Constantine Kotropoulos,et al.  Improving speech emotion recognition using adaptive genetic algorithms , 2007, 2007 15th European Signal Processing Conference.

[7]  Bülent Sankur,et al.  Representation Plurality and Fusion for 3-D Face Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation-principal directions for curved object recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[9]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[10]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[12]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation. Principal directions for curved object recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[14]  Jiuchao Feng,et al.  KFCE: A dictionary generation algorithm for sparse representation , 2009, Signal Process..

[15]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[16]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[17]  Liming Chen,et al.  New Experiments on ICP-Based 3D Face Recognition and Authentication , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Berk Gökberk,et al.  Comparative Analysis of Decision-level Fusion Algorithms for 3D Face Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  Congcong Li,et al.  Face Recognition Based on Pose-Variant Image Synthesis and Multi-level Multi-feature Fusion , 2007, AMFG.

[20]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Bogdan Gabrys,et al.  Classifier selection for majority voting , 2005, Inf. Fusion.

[22]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[23]  Afzal Godil,et al.  Face recognition using 3D facial shape and color map information: comparison and combination , 2004, SPIE Defense + Commercial Sensing.

[24]  Berk Gökberk,et al.  Rank-based decision fusion for 3D shape-based face recognition , 2005, Proceedings of the IEEE 13th Signal Processing and Communications Applications Conference, 2005..

[25]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  S. Zucker,et al.  Differential Geometry from the Frenet Point of View: Boundary Detection, Stereo, Texture and Color , 2006, Handbook of Mathematical Models in Computer Vision.

[27]  Sridha Sridharan,et al.  Robust 3D Face Recognition from Expression Categorisation , 2007, ICB.

[28]  Liming Chen,et al.  A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[29]  Constantine Kotropoulos,et al.  Fast and accurate sequential floating forward feature selection with the Bayes classifier applied to speech emotion recognition , 2008, Signal Process..

[30]  Berk Gökberk,et al.  Rank-based decision fusion for 3D shape-based face recognition , 2005, SIU 2005.

[31]  Patrick J. Flynn,et al.  3D Face Recognition with Region Committee Voting , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).