Video-Based Facial Kinship Verification

In this chapter, we investigate the problem of video-based kinship verification via human face analysis. While several attempts have been made on facial kinship verification from still images, to our best knowledge, the problem of video-based kinship verification has not been formally addressed in the literature. In this chapter, we first present a new video face dataset called Kinship Face Videos in the Wild (KFVW) which were captured in wild conditions for the video-based kinship verification study, as well as the standard benchmark. Then, we employ our benchmark to evaluate and compare the performance of several state-of-the-art metric learning-based kinship verification methods. Finally, several observations are provided in evaluation part which may give some hints for the future direction for video-based kinship verification studies.

[1]  Tsuhan Chen,et al.  Kinship classification by modeling facial feature heredity , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Jiwen Lu,et al.  Prototype-Based Discriminative Feature Learning for Kinship Verification , 2015, IEEE Transactions on Cybernetics.

[3]  Richa Singh,et al.  Self-similarity representation of Weber faces for kinship classification , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[4]  Hamdi Dibeklioglu,et al.  Graph-Based Kinship Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[5]  Tsuhan Chen,et al.  Towards computational models of kinship verification , 2010, 2010 IEEE International Conference on Image Processing.

[6]  Rabab Kreidieh Ward,et al.  Improved Face Representation by Nonuniform Multilevel Selection of Gabor Convolution Features , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Xiaoyang Tan,et al.  Tri-subjects kinship verification: Understanding the core of a family , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[8]  Jiwen Lu,et al.  Kinship verification from facial images under uncontrolled conditions , 2011, ACM Multimedia.

[9]  Li Bai,et al.  Cosine Similarity Metric Learning for Face Verification , 2010, ACCV.

[10]  Haibin Yan,et al.  Video-based kinship verification using distance metric learning , 2018, Pattern Recognit..

[11]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Jiwen Lu,et al.  Neighborhood repulsed metric learning for kinship verification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Shiguang Shan,et al.  Side-Information based Linear Discriminant Analysis for Face Recognition , 2011, BMVC.

[16]  Chandra Kambhamettu,et al.  Can faces verify blood-relations? , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[17]  Ming Shao,et al.  Toward kinship verification using visual attributes , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[18]  Jiebo Luo,et al.  Understanding Kin Relationships in a Photo , 2012, IEEE Transactions on Multimedia.

[19]  Ming Shao,et al.  Kinship Verification through Transfer Learning , 2011, IJCAI.

[20]  Jiwen Lu,et al.  Discriminative Multimetric Learning for Kinship Verification , 2014, IEEE Transactions on Information Forensics and Security.

[21]  Albert Ali Salah,et al.  Like Father, Like Son: Facial Expression Dynamics for Kinship Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[22]  Ming Shao,et al.  Genealogical face recognition based on UB KinFace database , 2011, CVPR 2011 WORKSHOPS.

[23]  Xiaolong Wang,et al.  Kinship Measurement on Salient Facial Features , 2012, IEEE Transactions on Instrumentation and Measurement.

[24]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[25]  Jiwen Lu,et al.  Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments , 2012, ACM Multimedia.