The 5th Recognizing Families in the Wild Data Challenge: Predicting Kinship from Faces

Recognizing Families In the Wild (RFIW), held as a data challenge in conjunction with the 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG), is a large-scale, multi-track visual kinship recognition evaluation. For the fifth edition of RFIW, we continue to attract scholars, bring together professionals, publish new work, and discuss prospects. In this paper, we summarize submissions for the three tasks of this year's RFIW: specifically, we review the results for kinship verification, tri-subject verification, and family member search and retrieval. We look at the RFIW problem, share current efforts, and make recommendations for promising future directions.

[1]  Savas Özkan,et al.  Kinshipgan: Synthesizing of Kinship Faces from Family Photos by Regularizing a Deep Face Network , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[2]  Mei Wang,et al.  Deep Face Recognition: A Survey , 2018, Neurocomputing.

[3]  Min Xu,et al.  Adversarial Similarity Metric Learning for Kinship Verification , 2019, IEEE Access.

[4]  Zhipeng Luo,et al.  Challenge report Recognizing Families In the Wild Data Challenge , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[5]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[6]  Jun Yu,et al.  Retrieval of Family Members Using Siamese Neural Network , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[7]  Jiebo Luo,et al.  Understanding Kin Relationships in a Photo , 2012, IEEE Transactions on Multimedia.

[8]  Ming Shao,et al.  Families in the Wild (FIW): Large-Scale Kinship Image Database and Benchmarks , 2016, ACM Multimedia.

[9]  Joseph P Robinson.  Automatic Face Understanding: Recognizing Families in Photos , 2021, ArXiv.

[10]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yun Fu,et al.  Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Abdelmalik Taleb-Ahmed,et al.  Multi-view Deep Features for Robust Facial Kinship Verification , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[14]  Tsuhan Chen,et al.  Kinship classification by modeling facial feature heredity , 2013, 2013 IEEE International Conference on Image Processing.

[15]  S. Shan,et al.  KinNet: Fine-to-Coarse Deep Metric Learning for Kinship Verification , 2017 .

[16]  Gerhard Rigoll,et al.  A Multi-Task Comparator Framework for Kinship Verification , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[17]  Joseph P. Robinson,et al.  Recognizing Families In the Wild (RFIW): The 4th Edition , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[18]  J. Paul Robinson,et al.  What Will Your Child Look Like? DNA-Net: Age and Gender Aware Kin Face Synthesizer , 2019, ArXiv.

[19]  Liang Wang,et al.  Kinship Verification with Deep Convolutional Neural Networks , 2015, BMVC.

[20]  Wojciech Zaremba,et al.  Evaluating Large Language Models Trained on Code , 2021, ArXiv.

[21]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[22]  Handong Zhao,et al.  Recognizing Families In the Wild (RFIW): Data Challenge Workshop in conjunction with ACM MM 2017 , 2017 .

[23]  Jiwen Lu,et al.  Neighborhood repulsed metric learning for kinship verification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Li Bai,et al.  Cosine Similarity Metric Learning for Face Verification , 2010, ACCV.

[25]  Jun Yu,et al.  Deep Fusion Siamese Network for Automatic Kinship Verification , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[26]  Ming Shao,et al.  To Recognize Families In the Wild: A Machine Vision Tutorial , 2018, ACM Multimedia.

[27]  Yun Fu,et al.  Cross-Generation Kinship Verification with Sparse Discriminative Metric , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Guochen Xie,et al.  Deep Kinship Verification and Retrieval Based on Fusion Siamese Neural Network , 2021, 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021).

[29]  Yun Fu,et al.  Kinship Verification on Families in the Wild with Marginalized Denoising Metric Learning , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[30]  Ming Shao,et al.  Visual Kinship Recognition of Families in the Wild , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Hamdi Dibeklioglu,et al.  What Will Your Future Child Look Like? Modeling and Synthesis of Hereditary Patterns of Facial Dynamics , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[32]  Qingyan Duan,et al.  AdvNet: Adversarial Contrastive Residual Net for 1 Million Kinship Recognition , 2017 .

[33]  Iddo Drori,et al.  Top 3 in FG 2021 Families In the Wild Kinship Verification Challenge , 2021, ArXiv.

[34]  Yun Fu,et al.  Face Recognition: Too Bias, or Not Too Bias? , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Yun Fu,et al.  Kinship Classification through Latent Adaptive Subspace , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[36]  Anil K. Jain,et al.  IARPA Janus Benchmark-B Face Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[37]  Andrei Shadrikov,et al.  Achieving Better Kinship Recognition Through Better Baseline , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[38]  Yun Fu,et al.  Balancing Biases and Preserving Privacy on Balanced Faces in the Wild , 2021, ArXiv.

[39]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[40]  Guodong Guo,et al.  Supervised Contrastive Learning for Facial Kinship Recognition , 2021, 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021).

[41]  Ming Shao,et al.  Kinship Verification through Transfer Learning , 2011, IJCAI.

[42]  Bhiksha Raj,et al.  SphereFace: Deep Hypersphere Embedding for Face Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Tsuhan Chen,et al.  Towards computational models of kinship verification , 2010, 2010 IEEE International Conference on Image Processing.

[44]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Andrew Zisserman,et al.  From Same Photo: Cheating on Visual Kinship Challenges , 2018, ACCV.

[46]  Ning Zhang,et al.  Laplace Landmark Localization , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[47]  Ming Shao,et al.  Families in Wild Multimedia: A Multimodal Database for Recognizing Kinship , 2020, IEEE Transactions on Multimedia.

[48]  Fang Zhao,et al.  Multi-Prototype Networks for Unconstrained Set-based Face Recognition , 2019, IJCAI.

[49]  Xiaoyang Tan,et al.  Tri-subjects kinship verification: Understanding the core of a family , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[50]  Abdenour Hadid,et al.  Comments on the “Kinship Face in the Wild” Data Sets , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.