Like Father, Like Son: Facial Expression Dynamics for Kinship Verification

Kinship verification from facial appearance is a difficult problem. This paper explores the possibility of employing facial expression dynamics in this problem. By using features that describe facial dynamics and spatio-temporal appearance over smile expressions, we show that it is possible to improve the state of the art in this problem, and verify that it is indeed possible to recognize kinship by resemblance of facial expressions. The proposed method is tested on different kin relationships. On the average, 72.89% verification accuracy is achieved on spontaneous smiles.

[1]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[2]  Albert Ali Salah,et al.  A Statistical Method for 2-D Facial Landmarking , 2012, IEEE Transactions on Image Processing.

[3]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  L. Brodsky,et al.  Hereditary family signature of facial expression , 2006, Proceedings of the National Academy of Sciences.

[5]  P. Ekman.  Telling lies: clues to deceit in the marketplace , 1985 .

[6]  Albert Ali Salah,et al.  Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles , 2012, ECCV.

[7]  Tsuhan Chen,et al.  Towards computational models of kinship verification , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Jiwen Lu,et al.  Neighborhood repulsed metric learning for kinship verification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[10]  L. Maloney,et al.  Where are kin recognition signals in the human face? , 2006, Journal of vision.

[11]  Paul F. Velleman,et al.  Definition and Comparison of Robust Nonlinear Data Smoothing Algorithms , 1980 .

[12]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[13]  Thomas S. Huang,et al.  Explanation-based facial motion tracking using a piecewise Bezier volume deformation model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Albert Ali Salah,et al.  A smile can reveal your age: enabling facial dynamics in age estimation , 2012, ACM Multimedia.

[15]  Xiaolong Wang,et al.  Kinship Measurement on Salient Facial Features , 2012, IEEE Transactions on Instrumentation and Measurement.

[16]  Jiwen Lu,et al.  Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments , 2012, ACM Multimedia.

[17]  George W. Quinn,et al.  Distinguishing identical twins by face recognition , 2011, Face and Gesture 2011.

[18]  Laurence T Maloney,et al.  Kin recognition and the perceived facial similarity of children. , 2006, Journal of vision.

[19]  Jiebo Luo,et al.  Understanding Kin Relationships in a Photo , 2012, IEEE Transactions on Multimedia.

[20]  Richa Singh,et al.  Self-similarity representation of Weber faces for kinship classification , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[21]  Matti Pietikäinen,et al.  Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).