Bimodal biometric verification based on face and lips

In this paper, we present a novel approach to person verification by fusing face and lip features. Specifically, the face is modeled by the discriminative common vector and the discrete wavelet transform. Our lip features are simple geometric features based on a lip contour, which can be interpreted as multiple spatial widths and heights from a center of mass. In order to combine these features, we consider two simple fusion strategies: data fusion before training and score fusion after training, working with two different face databases. Fusing them together boosts the performance to achieve an equal error rate as low as 0.4% and 0.28%, respectively, confirming that our approach of fusing lips and face is effective and promising.

[1]  Tieniu Tan,et al.  Automatic 3D Face Recognition Using Discriminant Common Vectors , 2006, ICB.

[2]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[4]  Hakan Cevikalp,et al.  Discriminative common vectors for face recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  M.A. Ferrer,et al.  Arbitrary illumination conditions for facial identification , 2007, 2007 41st Annual IEEE International Carnahan Conference on Security Technology.

[6]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[7]  Jianguo Zhang,et al.  Biometric Identification Using Motion History Images of a Speaker's Lip Movements , 2008, 2008 International Machine Vision and Image Processing Conference.

[8]  Nobuyuki Otsu,et al.  ATlreshold Selection Method fromGray-Level Histograms , 1979 .

[9]  Yan Xiang,et al.  Multi-parts and multi-feature fusion in face verification , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[11]  Josef Bigün,et al.  Motion Features from Lip Movement for Person Authentication , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[12]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[13]  Anastasios Tefas,et al.  Class-Specific Kernel-Discriminant Analysis for Face Verification , 2007, IEEE Transactions on Information Forensics and Security.

[14]  Hakan Cevikalp,et al.  The Kernel Common Vector Method: A Novel Nonlinear Subspace Classifier for Pattern Recognition , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).