Multi-View Geometric Mean Metric Learning for Kinship Verification

This paper proposes a multi-view geometric mean metric learning (MvGMML) method for the real-world kinship verification from facial images. Unlike existing kinship verification methods which dramatically degrade their performance when facial images are not well aligned, we present an efficient misalignment-robust kinship verification framework. First, a facial feature detector is employed to localize several facial feature points such as the right and left corners of two eyes. Then, a dense SIFT descriptor is extracted around each feature point. Lastly, our proposed MvGMML method jointly learns multiple local geometric mean metrics, one geometric mean metric for each view (i.e., feature point), to better exploit complementary information of all views. Experimental results on two widely used kinship datasets are presented to show the efficacy of our method.

[1]  Jiwen Lu,et al.  The FG 2015 Kinship Verification in the Wild Evaluation , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[2]  Xiaoyang Tan,et al.  Tri-subjects kinship verification: Understanding the core of a family , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[5]  Tsuhan Chen,et al.  Towards computational models of kinship verification , 2010, 2010 IEEE International Conference on Image Processing.

[6]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[7]  Jiwen Lu,et al.  Discriminative Multimetric Learning for Kinship Verification , 2014, IEEE Transactions on Information Forensics and Security.

[8]  Albert Ali Salah,et al.  Like Father, Like Son: Facial Expression Dynamics for Kinship Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Georgios Tzimiropoulos,et al.  Project-Out Cascaded Regression with an application to face alignment , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ming Shao,et al.  Visual Kinship Recognition of Families in the Wild , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jiwen Lu,et al.  Kinship verification from facial images under uncontrolled conditions , 2011, ACM Multimedia.

[12]  Andrea Bottino,et al.  A multi-perspective holistic approach to Kinship Verification in the Wild , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[13]  Ming Shao,et al.  Toward kinship verification using visual attributes , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face and Kinship Verification , 2017, IEEE Transactions on Image Processing.

[15]  Guodong Guo,et al.  Learning deep compact similarity metric for kinship verification from face images , 2019, Inf. Fusion.

[16]  Xiaolong Wang,et al.  Leveraging appearance and geometry for kinship verification , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[17]  Suvrit Sra,et al.  Geometric Mean Metric Learning , 2016, ICML.

[18]  Chengjun Liu,et al.  Multiple Anthropological Fisher Kernel Framework and Its Application to Kinship Verification , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[19]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[20]  Richa Singh,et al.  Supervised Mixed Norm Autoencoder for Kinship Verification in Unconstrained Videos , 2018, IEEE Transactions on Image Processing.

[21]  Jiwen Lu,et al.  Local Large-Margin Multi-Metric Learning for Face and Kinship Verification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.