Kinship Identification through Joint Learning Using Kinship Verification Ensemble

Kinship verification is a well-explored task: identifying whether or not two persons are kin. In contrast, kinship identification has been largely ignored so far. Kinship identification aims to further identify the particular type of kinship. An extension to kinship verification run short to properly obtain identification, because existing verification networks are individually trained on specific kinships and do not consider the context between different kinship types. Also, existing kinship verification datasets have biased positive-negative distributions which are different than real-world distributions. To this end, we propose a novel kinship identification approach based on joint training of kinship verification ensembles and classification modules. We propose to rebalance the training dataset to become more realistic. Large scale experiments demonstrate the appealing performance on kinship identification. The experiments further show significant performance improvement of kinship verification when trained on the same dataset with more realistic distributions.

[1]  M. Khoury,et al.  Inbreeding and prereproductive mortality in the Old Order Amish. I. Genealogic epidemiology of inbreeding. , 1987, American journal of epidemiology.

[2]  W. Hauck,et al.  Inbreeding effects on fertility in humans: evidence for reproductive compensation. , 1999, American journal of human genetics.

[3]  Gallup,et al.  Perceptions of paternal resemblance predict family violence. , 2000, Evolution and human behavior : official journal of the Human Behavior and Evolution Society.

[4]  D. Fessler,et al.  Third-party attitudes toward sibling incest: Evidence for Westermarck's hypotheses , 2004 .

[5]  Leslie A. Zebrowitz,et al.  Social Psychological Face Perception: Why Appearance Matters. , 2008, Social and personality psychology compass.

[6]  S. Dridi,et al.  Human ability to detect kinship in strangers' faces: effects of the degree of relatedness , 2009, Proceedings of the Royal Society B: Biological Sciences.

[7]  Susan C. Roberts,et al.  Kin recognition signals in adult faces , 2009, Vision Research.

[8]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Tsuhan Chen,et al.  Towards computational models of kinship verification , 2010, 2010 IEEE International Conference on Image Processing.

[10]  Jiwen Lu,et al.  Kinship verification from facial images under uncontrolled conditions , 2011, ACM Multimedia.

[11]  Ming Shao,et al.  Kinship Verification through Transfer Learning , 2011, IJCAI.

[12]  Hong-Yuan Mark Liao,et al.  Discovering informative social subgraphs and predicting pairwise relationships from group photos , 2012, ACM Multimedia.

[13]  Jiebo Luo,et al.  Understanding Kin Relationships in a Photo , 2012, IEEE Transactions on Multimedia.

[14]  Jiwen Lu,et al.  Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments , 2012, ACM Multimedia.

[15]  Honglak Lee,et al.  Learning hierarchical representations for face verification with convolutional deep belief networks , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Jiwen Lu,et al.  Neighborhood repulsed metric learning for kinship verification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Chunheng Wang,et al.  Deep nonlinear metric learning with independent subspace analysis for face verification , 2012, ACM Multimedia.

[18]  Albert Ali Salah,et al.  Like Father, Like Son: Facial Expression Dynamics for Kinship Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Tsuhan Chen,et al.  Kinship classification by modeling facial feature heredity , 2013, 2013 IEEE International Conference on Image Processing.

[20]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Hamdi Dibeklioglu,et al.  Graph-Based Kinship Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  Jiwen Lu,et al.  Discriminative Multimetric Learning for Kinship Verification , 2014, IEEE Transactions on Information Forensics and Security.

[23]  Jiwen Lu,et al.  Large Margin Multi-metric Learning for Face and Kinship Verification in the Wild , 2014, ACCV.

[24]  Yun Fu,et al.  Discriminative low-rank metric learning for face recognition , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[25]  Siti Zaiton Mohd Hashim,et al.  Automated kinship verification and identification through human facial images: a survey , 2015, Multimedia Tools and Applications.

[26]  Liang Wang,et al.  Kinship Verification with Deep Convolutional Neural Networks , 2015, BMVC.

[27]  Xiaoyi Feng,et al.  Kinship verification from videos using spatio-temporal texture features and deep learning , 2016, 2016 International Conference on Biometrics (ICB).

[28]  Ming Shao,et al.  Families in the Wild (FIW): Large-Scale Kinship Image Database and Benchmarks , 2016, ACM Multimedia.

[29]  Handong Zhao,et al.  Recognizing Families In the Wild (RFIW): Data Challenge Workshop in conjunction with ACM MM 2017 , 2017 .

[30]  Xiaolong Wang,et al.  Leveraging multiple cues for recognizing family photos , 2017, Image Vis. Comput..

[31]  Jiwen Lu,et al.  Facial Kinship Verification , 2017, SpringerBriefs in Computer Science.

[32]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face and Kinship Verification , 2017, IEEE Transactions on Image Processing.

[33]  Yun Fu,et al.  Kinship Verification on Families in the Wild with Marginalized Denoising Metric Learning , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[34]  Yun Fu,et al.  Kinship Classification through Latent Adaptive Subspace , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[35]  Jinhui Tang,et al.  Photo to Family Tree: Deep Kinship Understanding for Nuclear Family Photos , 2018 .

[36]  Ming Shao,et al.  Visual Kinship Recognition of Families in the Wild , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Roberto Cipolla,et al.  Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[38]  Yun Fu,et al.  Cross-Generation Kinship Verification with Sparse Discriminative Metric , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Haibin Yan,et al.  Learning part-aware attention networks for kinship verification , 2019, Pattern Recognit. Lett..

[40]  Richa Singh,et al.  Supervised Mixed Norm Autoencoder for Kinship Verification in Unconstrained Videos , 2018, IEEE Transactions on Image Processing.