$k^{3}$-Sparse Graph Convolutional Networks for Face Recognition

In recent years, deep learning networks have substantially improved the performance of face recognition. Although deep learning networks have been very successful, there are limited to underlying Euclidean structure data. When dealing with complex signals such as medical imaging, genetics, social networks and computer vision, recently there has been a growing interest in trying to apply learning on non-Euclidean geometric data. Graph convolutional networks are a new deep learning architecture for analyzing non-Euclidean geometric data. In computer vision, a human face image is modeled as a graph in the irregular domain. A major technical challenge is how to optimize the structured face graph. Because, classification performance critically depends on the quality of the graph. In this paper, we explore an undirected graph convolutional network called $k^{3}$-SGCNs ($k^{3}$ - sparse graph convolutional networks). The main idea is to use sparsity-constrained optimization that obtain connected sparse subgraphs. A sparse graph of face image is composed of connected sparse subgraphs. Experiments demonstrate that the learned sparse graph has better performance than mutual $k$-nearest neighbor graph and $l1$ graph.

[1]  Xiaogang Wang,et al.  Hybrid Deep Learning for Face Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Xiaogang Wang,et al.  Deep Learning Identity-Preserving Face Space , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Rama Chellappa,et al.  HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Feng Chen,et al.  Graph-Structured Sparse Optimization for Connected Subgraph Detection , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[5]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[7]  L. Hood,et al.  A Genomic Regulatory Network for Development , 2002, Science.

[8]  Xiaogang Wang,et al.  DeepID3: Face Recognition with Very Deep Neural Networks , 2015, ArXiv.

[9]  Xiaogang Wang,et al.  Deeply learned face representations are sparse, selective, and robust , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[11]  Jian Sun,et al.  An associate-predict model for face recognition , 2011, CVPR 2011.

[12]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ming Yang,et al.  Web-scale training for face identification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  A. Pentland,et al.  Life in the network: The coming age of computational social science: Science , 2009 .

[15]  Piotr Indyk,et al.  A Nearly-Linear Time Framework for Graph-Structured Sparsity , 2015, ICML.

[16]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[18]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[19]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[21]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Jian Sun,et al.  Bayesian Face Revisited: A Joint Formulation , 2012, ECCV.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Toby P. Breckon,et al.  Face recognition via deep sparse graph neural networks. , 2017, BMVC 2017.