Assessing the Uniqueness and Permanence of Facial Actions for Use in Biometric Applications

Although the human face is commonly used as a physiological biometric, very little work has been done to exploit the idiosyncrasies of facial motions for person identification. In this paper, we investigate the uniqueness and permanence of facial actions to determine whether these can be used as a behavioral biometric. Experiments are carried out using 3-D video data of participants performing a set of very short verbal and nonverbal facial actions. The data have been collected over long time intervals to assess the variability of the subjects' emotional and physical conditions. Quantitative evaluations are performed for both the identification and the verification problems; the results indicate that emotional expressions (e.g., smile and disgust) are not sufficiently reliable for identity recognition in real-life situations, whereas speech-related facial movements show promising potential.

[1]  Patrick Lucey,et al.  Confusability of Phonemes Grouped According to their Viseme Classes in Noisy Environments , 2004 .

[2]  Jason Brand,et al.  Acoustic and facial features for speaker recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Bayya Yegnanarayana,et al.  Correlation-Based Similarity Between Signals for Speaker Verification with Limited Amount of Speech Data , 2006, MRCS.

[4]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[5]  Peter Hammond,et al.  Dense surface point distribution models of the human face , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[6]  M. Trivedi,et al.  Manifold analysis of facial gestures for face recognition , 2003, WBMA '03.

[7]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[8]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[9]  Sharath Pankanti,et al.  Guide to Biometrics , 2003, Springer Professional Computing.

[10]  Josef Bigün,et al.  Audio-visual person authentication using lip-motion from orientation maps , 2007, Pattern Recognit. Lett..

[11]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[12]  Lijun Yin,et al.  A high-resolution 3D dynamic facial expression database , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[13]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[14]  M. Bock,et al.  Are Facial Expressions Reproducible? , 2003 .

[15]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[16]  Paul L. Rosin,et al.  Facial Dynamics in Biometric Identification , 2008, BMVC.

[17]  T. Hastie,et al.  Principal Curves , 2007 .

[18]  Pietro Perona,et al.  Continuous dynamic time warping for translation-invariant curve alignment with applications to signature verification , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Luc Vandendorpe,et al.  The M2VTS Multimodal Face Database (Release 1.00) , 1997, AVBPA.

[20]  John S. D. Mason,et al.  The role of dynamics in visual speech biometrics , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[21]  P. Jonathon Phillips,et al.  Support Vector Machines Applied to Face Recognition , 1998, NIPS.

[22]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Farzin Deravi,et al.  Design issues for a digital audio-visual integrated database , 1996 .

[24]  John Laver,et al.  Principles of Phonetics: Principles of transcription , 1994 .

[25]  Suresh Venkatasubramanian,et al.  Curve Matching, Time Warping, and Light Fields: New Algorithms for Computing Similarity between Curves , 2007, Journal of Mathematical Imaging and Vision.

[26]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  徐繼聖.  從Face Recognition Vendor Test (FRVT) 2006看臉部辨?科技近期的考驗 , 2006 .

[28]  Whitney M. Weikum,et al.  Visual language discrimination , 2008 .

[29]  Sharon Lesner,et al.  Visual vowel and diphthong perception across speakers , 1981 .

[30]  Juergen Luettin,et al.  Speaker identification by lipreading , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[31]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[32]  Sharath Pankanti,et al.  Biometrics: a tool for information security , 2006, IEEE Transactions on Information Forensics and Security.

[33]  Venu Govindaraju,et al.  Facial Expression Biometrics Using Tracker Displacement Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Ralph Gross,et al.  Individual differences in facial expression: stability over time, relation to self-reported emotion, and ability to inform person identification , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[35]  Anil K. Jain,et al.  Three-dimensional face recognition across pose and expression , 2006 .

[36]  Klaus Mueller,et al.  Dynamic Approach for Face Recognition Using Digital Image Skin Correlation , 2005, AVBPA.

[37]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.