Latent Sparse Discriminative Learning for Face Image Set Classification

Image set classification has drawn much attention due to its promising performance to overcome various variations. Recently, the point-to-point distance-based methods have achieved the state-of-the-art performance by leveraging the distance between the gallery set and the probe set. However, there are two drawbacks that need to be defeated: 1) they do not fully exploit the discrimination that exists between different gallery sets; 2) they face the great challenge of high computational complexity as well as multi-parameters, usually caused by some obvious sparse constraints. To address these problems, this paper proposes a novel method, namely latent sparse discriminative learning (LSDL), for face image set classification. Specifically, a new term is proposed to exploit the relations between different gallery sets, which can boost the set discrimination so as to improve performance. Moreover, we use a latent sparse constraint to reduce the trade-off parameters and computational cost. Furthermore, an efficient solver is proposed to solve our LSDL. Experimental results on three benchmark datasets demonstrate the advantages of our propose.

[1]  Jian Yu,et al.  Group Collaborative Representation for Image Set Classification , 2019, International Journal of Computer Vision.

[2]  Xiaoqian Zhang,et al.  Image set classification using candidate sets selection and improved reverse training , 2019, Neurocomputing.

[3]  Ajmal S. Mian,et al.  Image Set Based Face Recognition Using Self-Regularized Non-Negative Coding and Adaptive Distance Metric Learning , 2013, IEEE Transactions on Image Processing.

[4]  David Zhang,et al.  Collaborative Representation based Classification for Face Recognition , 2012, ArXiv.

[5]  Zhenhua Guo,et al.  Dependency-Aware Attention Control for Image Set-Based Face Recognition , 2020, IEEE Transactions on Information Forensics and Security.

[6]  Simon C. K. Shiu,et al.  Image Set-Based Collaborative Representation for Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[7]  Chen Huang,et al.  Deep Imbalanced Learning for Face Recognition and Attribute Prediction , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Yicong Zhou,et al.  Pairwise Linear Regression Classification for Image Set Retrieval , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Hamido Fujita,et al.  A study of graph-based system for multi-view clustering , 2019, Knowl. Based Syst..

[10]  LinLin Shen,et al.  Joint regularized nearest points for image set based face recognition , 2017, Image Vis. Comput..

[11]  Zhanjie Song,et al.  Image set face recognition based on extended low rank recovery and collaborative representation , 2020, Int. J. Mach. Learn. Cybern..

[12]  Liang Chen,et al.  Survey: How good are the current advances in image set based face identification? - Experiments on three popular benchmarks with a naïve approach , 2017, Comput. Vis. Image Underst..

[13]  Shiguang Shan,et al.  A Benchmark and Comparative Study of Video-Based Face Recognition on COX Face Database , 2015, IEEE Transactions on Image Processing.

[14]  Zhenwen Ren,et al.  Learning Latent Low-Rank and Sparse Embedding for Robust Image Feature Extraction , 2020, IEEE Transactions on Image Processing.

[15]  Mohammed Bennamoun,et al.  Deep Reconstruction Models for Image Set Classification , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Hakan Cevikalp,et al.  Face recognition based on image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Shiguang Shan,et al.  Prototype Discriminative Learning for Face Image Set Classification , 2016, ACCV.

[18]  Ajmal S. Mian,et al.  Face Recognition Using Sparse Approximated Nearest Points between Image Sets , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Lei Zhang,et al.  Face recognition based on regularized nearest points between image sets , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[20]  Feiping Nie,et al.  The Constrained Laplacian Rank Algorithm for Graph-Based Clustering , 2016, AAAI.

[21]  Dong Wei,et al.  Prototype learning and collaborative representation using Grassmann manifolds for image set classification , 2020, Pattern Recognit..

[22]  Sung Bum Pan,et al.  A face recognition system based on convolution neural network using multiple distance face , 2017, Soft Comput..

[23]  Zhenwen Ren,et al.  Nonnegative discriminative encoded nearest points for image set classification , 2019, Neural Computing and Applications.

[24]  Jianqiang Gao,et al.  Multi-model fusion metric learning for image set classification , 2019, Knowl. Based Syst..

[25]  Zhenwen Ren,et al.  Simultaneous Global and Local Graph Structure Preserving for Multiple Kernel Clustering , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Hakan Cevikalp,et al.  Face Recognition Based on Videos by Using Convex Hulls , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Xindong Wu,et al.  Image set classification based on cooperative sparse representation , 2017, Pattern Recognit..