Lip-shape Dependent Face Verification

We present a multimodal approach to face verification which draws on two distinct knowledge sources of biometric information concerning the subject. A B-spline lip tracker provides the control information regarding the state of the lip shape which is used by a conventional eigenface based face verification system to confirm or reject a claimed personal identity. The performance of the system tested on the M2VTS database shows a promising improvement over the unimodal approach. This improvement derives from the achieved reduction in the population entropy of the models, thus minimising the probability of imposter acceptance.

[1]  Jiri Matas,et al.  Spatial and Feature Space Clustering: Applications in Image Analysis , 1995, CAIP.

[2]  D.,et al.  Multi-modal person veri cation tools using speech and images , 1996 .

[3]  Jiri Matas,et al.  Image interpretation: exploiting multiple cues , 1995 .

[4]  Alex Pentland,et al.  Face recognition using view-based and modular eigenspaces , 1994, Optics & Photonics.

[5]  Michael Isard,et al.  3D position, attitude and shape input using video tracking of hands and lips , 1994, SIGGRAPH.

[6]  Yochai Konig,et al.  "Eigenlips" for robust speech recognition , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  B. Barsky,et al.  An Introduction to Splines for Use in Computer Graphics and Geometric Modeling , 1987 .

[8]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[9]  Luc Vandendorpe,et al.  Multi-modal person verification tools using speech and images , 1996 .

[10]  Andrew Blake,et al.  Real-Time Lip Tracking for Audio-Visual Speech Recognition Applications , 1996, ECCV.

[11]  Gerald Farin,et al.  Curves and surfaces for computer aided geometric design , 1990 .

[12]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tomaso Poggio,et al.  Automatic person recognition by acoustic and geometric features , 1995 .

[14]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Juergen Luettin,et al.  Active Shape Models for Visual Speech Feature Extraction , 1996 .