Towards general motion-based face recognition

Motion-based face recognition is a young research topic, inspired mainly by psychological studies on motion-based perception of human faces. Unlike its close relative, appearance-based face recognition, motion-based face recognition extracts personal characteristics from facial motion (e.g. smile) and uses the information to recognize human identity. However, existing studies in this field are limited to fixed motion, that is - a subject must perform a specific type of facial motion in order to be correctly recognized. In this paper, we try to overcome this limitation by investigating the patterns of local skin deformation exhibited in facial motion. We are pushing the state-of-the-art towards general motion-based face recognition. Our approach is able to extract identity evidence from various types of facial motion, as long as those facial motions are at least, in some part of the face, locally similar to the facial motions used in training. We call our approach Local Deformation Profile (or LDP). This approach is tested through several experiments conducted over a video database of facial expression. The experiment results demonstrate the potential of LDP to be used for biometrics. We also evaluate LDP under extremely heavy face makeup, showing its usefulness to recognize faces even in disguise.

[1]  Hong-Yuan Mark Liao,et al.  Person identification using facial motion , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  A. O'Toole,et al.  Psychological and neural perspectives on the role of motion in face recognition. , 2003, Behavioral and cognitive neuroscience reviews.

[3]  V. Bruce,et al.  The role of movement in the recognition of famous faces , 1999, Memory & cognition.

[4]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[5]  Dmitry B. Goldgof,et al.  Elastic face - an anatomy-based biometrics beyond visible cue , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[6]  Martin A. Giese,et al.  Probing dynamic human facial action recognition from the other side of the mean , 2008, APGV '08.

[7]  H. Bülthoff,et al.  A search advantage for faces learned in motion , 2006, Experimental Brain Research.

[8]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[11]  K. Lander,et al.  Recognizing Face Identity from Natural and Morphed Smiles , 2006, Quarterly journal of experimental psychology.

[12]  Ye Ning,et al.  Smile, you’re on identity camera , 2008, 2008 19th International Conference on Pattern Recognition.

[13]  Anil K. Jain,et al.  Can soft biometric traits assist user recognition? , 2004, SPIE Defense + Commercial Sensing.

[14]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[15]  R. M. Bowen,et al.  Introduction to Continuum Mechanics for Engineers , 1989 .

[16]  W. Marsden.  I and J , 2012 .

[17]  Z. Kourtzi,et al.  A Matching Advantage for Dynamic Human Faces , 2002, Perception.

[18]  Klaus Mueller,et al.  Dynamic Approach for Face Recognition Using Digital Image Skin Correlation , 2005, AVBPA.

[19]  Venu Govindaraju,et al.  Facial Expression Biometrics Using Tracker Displacement Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.