Learning discriminative compact binary face descriptor for kinship verification

Abstract In this paper, we propose a weakly-supervised feature learning method called discriminative compact binary face descriptor (D-CBFD) for facial kinship verification. Unlike most existing kinship verification methods where hand-crafted features are used for face representation, our D-CBFD learns discriminative face representation from a set of weakly-labeled samples. Given a face image, we first compute pixel difference vectors (PDVs) at local patches. Then, we learn a discriminative projection to map each PDV into a low-dimensional binary feature space, where the energy information of the PDV can be well preserved and the distance between the positive pair is smaller and that between the negative pair is larger. Lastly, we pool these binary feature vectors within each face into a histogram feature as the final representation. Experimental results on three kinship datasets are presented to show the effectiveness of the proposed method.

[1]  Jiwen Lu,et al.  Neighborhood repulsed metric learning for kinship verification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Krystian Mikolajczyk,et al.  Binary Online Learned Descriptors , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jiwen Lu,et al.  Kinship verification from facial images under uncontrolled conditions , 2011, ACM Multimedia.

[4]  A. Alvergne,et al.  Cross-cultural perceptions of facial resemblance between kin. , 2009, Journal of vision.

[5]  Ling Shao,et al.  Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition , 2013, Pattern Recognit..

[6]  Jiwen Lu,et al.  Learning Deep Binary Descriptor with Multi-Quantization , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Xiaolong Wang,et al.  Kinship Measurement on Salient Facial Features , 2012, IEEE Transactions on Instrumentation and Measurement.

[8]  Jiwen Lu,et al.  Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments , 2012, ACM Multimedia.

[9]  Jiwen Lu,et al.  Prototype-Based Discriminative Feature Learning for Kinship Verification , 2015, IEEE Transactions on Cybernetics.

[10]  Richa Singh,et al.  Self-similarity representation of Weber faces for kinship classification , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[11]  Hamdi Dibeklioglu,et al.  Graph-Based Kinship Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[12]  Heng Tao Shen,et al.  Hashing on Nonlinear Manifolds , 2014, IEEE Transactions on Image Processing.

[13]  Jiwen Lu,et al.  Discriminative Multimetric Learning for Kinship Verification , 2014, IEEE Transactions on Information Forensics and Security.

[14]  Albert Ali Salah,et al.  Like Father, Like Son: Facial Expression Dynamics for Kinship Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Tsuhan Chen,et al.  Towards computational models of kinship verification , 2010, 2010 IEEE International Conference on Image Processing.

[16]  Jiwen Lu,et al.  Group-aware deep feature learning for facial age estimation , 2017, Pattern Recognit..

[17]  Jiwen Lu,et al.  Learning Rotation-Invariant Local Binary Descriptor , 2017, IEEE Transactions on Image Processing.

[18]  L. Maloney,et al.  Where are kin recognition signals in the human face? , 2006, Journal of vision.

[19]  Jiebo Luo,et al.  Understanding Kin Relationships in a Photo , 2012, IEEE Transactions on Multimedia.

[20]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jiwen Lu,et al.  Context-Aware Local Binary Feature Learning for Face Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  S. Dridi,et al.  Human ability to detect kinship in strangers' faces: effects of the degree of relatedness , 2009, Proceedings of the Royal Society B: Biological Sciences.

[23]  Jiwen Lu,et al.  Simultaneous Local Binary Feature Learning and Encoding for Homogeneous and Heterogeneous Face Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jiwen Lu,et al.  The FG 2015 Kinship Verification in the Wild Evaluation , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[25]  Jiwen Lu,et al.  Kinship verification in the wild: The first kinship verification competition , 2014, IEEE International Joint Conference on Biometrics.

[26]  Haibin Yan,et al.  Kinship verification using neighborhood repulsed correlation metric learning , 2017, Image Vis. Comput..

[27]  Susan C. Roberts,et al.  Kin recognition signals in adult faces , 2009, Vision Research.

[28]  Jiwen Lu,et al.  Learning Compact Binary Face Descriptor for Face Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Wei Liu,et al.  Supervised Discrete Hashing , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face and Kinship Verification , 2017, IEEE Transactions on Image Processing.

[31]  Chandra Kambhamettu,et al.  Can faces verify blood-relations? , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[32]  Ming Shao,et al.  Toward kinship verification using visual attributes , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[33]  Jiwen Lu,et al.  Two-Stream Transformer Networks for Video-Based Face Alignment , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Ling Shao,et al.  Multiview Alignment Hashing for Efficient Image Search , 2015, IEEE Transactions on Image Processing.

[35]  Tsuhan Chen,et al.  Kinship classification by modeling facial feature heredity , 2013, 2013 IEEE International Conference on Image Processing.

[36]  Fumin Shen,et al.  Inductive Hashing on Manifolds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Haibin Yan,et al.  Video-based kinship verification using distance metric learning , 2018, Pattern Recognit..

[38]  Jiwen Lu,et al.  Deep Metric Learning for Visual Understanding: An Overview of Recent Advances , 2017, IEEE Signal Processing Magazine.