Symmetrical feature extraction via novel Mirror PCA

Abstract Symmetry is an important property of human faces. Many researchers exploit symmetry to improve face recognition. In this paper, we explore the symmetry of faces under the framework of PCA (Principal Component Analysis). Unlike previous studies that manipulate facial symmetry by averaging the two halves, we argue that well-estimated symmetrical faces lie in a low-dimensional subspace. Inspired by this, a PCA-like model, referred to as Mirror PCA, is proposed to extract low-rank symmetrical features of faces, as well as their principal directions. Although the optimization problem is non-convex, a suboptimal solution could be found under existing optimization frameworks such as ADMM, PGD, etc. A number of experiments are conducted to verify the effectiveness and robustness of our method.

[1]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[2]  De-Shuang Huang,et al.  Linear and Nonlinear Feedforward Neural Network Classifiers: A Comprehensive Understanding , 1999 .

[3]  Jake K. Aggarwal,et al.  A case for the average-half-face in 2D and 3D for face recognition , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Wei Jia,et al.  Palmprint recognition with 2DPCA+PCA based on modular neural networks , 2007, Neurocomputing.

[6]  De-Shuang Huang,et al.  The nearest-farthest subspace classification for face recognition , 2013, Neurocomputing.

[7]  De-Shuang Huang,et al.  Using FCMC, FVS, and PCA techniques for feature extraction of multispectral images , 2005, IEEE Geosci. Remote. Sens. Lett..

[8]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[9]  Jian Yang,et al.  Approximately symmetrical face images for image preprocessing in face recognition and sparse representation based classification , 2016, Pattern Recognit..

[10]  De-Shuang Huang,et al.  Locally linear discriminant embedding: An efficient method for face recognition , 2008, Pattern Recognit..

[11]  Marios Savvides,et al.  An Augmented Linear Discriminant Analysis Approach for Identifying Identical Twins with the Aid of Facial Asymmetry Features , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Chao Wang,et al.  Feature extraction using constrained maximum variance mapping , 2008, Pattern Recognit..

[13]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[14]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[15]  Ran He,et al.  Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Wei Chen,et al.  Face detection based on half face-template , 2009, 2009 9th International Conference on Electronic Measurement & Instruments.

[17]  Hong Liu,et al.  Using the original and 'symmetrical face' training samples to perform representation based two-step face recognition , 2013, Pattern Recognit..

[18]  Jian Yang,et al.  Integrating Conventional and Inverse Representation for Face Recognition , 2014, IEEE Transactions on Cybernetics.

[19]  Xiaogang Wang,et al.  A unified framework for subspace face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Li Shang,et al.  Feature selection in independent component subspace for microarray data classification , 2006, Neurocomputing.

[21]  Jian Yang,et al.  Rotational Invariant Dimensionality Reduction Algorithms , 2017, IEEE Transactions on Cybernetics.

[22]  I. Jolliffe Principal Component Analysis , 2005 .

[23]  Chris H. Q. Ding,et al.  R1-PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization , 2006, ICML.

[24]  Jian Yang,et al.  Integrate the original face image and its mirror image for face recognition , 2014, Neurocomputing.

[25]  Jian Yang,et al.  Multilinear Sparse Principal Component Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[26]  D. Perrett,et al.  Self-perceived attractiveness influences human female preferences for sexual dimorphism and symmetry in male faces , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[27]  Li Shang,et al.  Noise removal using a novel non-negative sparse coding shrinkage technique , 2006, Neurocomputing.

[28]  Xuelong Li,et al.  Robust Tensor Analysis With L1-Norm , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[30]  Xuelong Li,et al.  L1-Norm-Based 2DPCA , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Jake K. Aggarwal,et al.  3D face recognition with the average-half-face , 2008, 2008 19th International Conference on Pattern Recognition.

[32]  D. Perrett,et al.  Facial symmetry and judgements of apparent health: Support for a “good genes” explanation of the attractiveness–symmetry relationship , 2001 .

[33]  R. Montgomerie,et al.  Facial attractiveness signals different aspects of "quality" in women and men. , 2001, Evolution and human behavior : official journal of the Human Behavior and Evolution Society.

[34]  Gora Chand Nandi,et al.  Face recognition using facial symmetry , 2012, CCSEIT '12.

[35]  Lei Wang,et al.  Generalized 2D principal component analysis for face image representation and recognition , 2005, Neural Networks.

[36]  G. Rhodes,et al.  Facial symmetry and the perception of beauty , 1998 .

[37]  De-Shuang Huang,et al.  Optimized projections for sparse representation based classification , 2013, Neurocomputing.

[38]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[39]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Leslie A. Zebrowitz,et al.  Do facial averageness and symmetry signal health? , 2001, Evolution and human behavior : official journal of the Human Behavior and Evolution Society.

[41]  Jia Lu,et al.  Principal component analysis based on block-norm minimization , 2018, Applied Intelligence.

[42]  L. Mealey,et al.  Symmetry and perceived facial attractiveness: a monozygotic co-twin comparison. , 1999, Journal of personality and social psychology.

[43]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[44]  Chao Wang,et al.  Supervised feature extraction based on orthogonal discriminant projection , 2009, Neurocomputing.

[45]  Larry S. Davis,et al.  SSH: Single Stage Headless Face Detector , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[46]  Stan Z. Li,et al.  Towards Pose Robust Face Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[48]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Nojun Kwak,et al.  Principal Component Analysis Based on L1-Norm Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  De-Shuang Huang,et al.  Extracting nonlinear features for multispectral images by FCMC and KPCA , 2005, Digit. Signal Process..

[51]  Jian-Xun Mi,et al.  Mirror PCA: Exploiting Facial Symmetry for Feature Extraction , 2019, ICIC.

[52]  Jake K. Aggarwal,et al.  Is there a connection between face symmetry and face recognition? , 2011, CVPR 2011 WORKSHOPS.

[53]  De-Shuang Huang,et al.  Robust dimensionality reduction via feature space to feature space distance metric learning , 2019, Neural Networks.

[54]  Zhihui Lai,et al.  Principal Component Analysis based on Nuclear norm Minimization , 2019, Neural Networks.

[55]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[56]  Michael R. Lyu,et al.  Nonnegative independent component analysis based on minimizing mutual information technique , 2006, Neurocomputing.

[57]  Jie Wen,et al.  Improved the minimum squared error algorithm for face recognition by integrating original face images and the mirror images , 2016 .

[58]  Ioannis A. Kakadiaris,et al.  Using Facial Symmetry to Handle Pose Variations in Real-World 3D Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Michael R. Lyu,et al.  A novel adaptive sequential niche technique for multimodal function optimization , 2006, Neurocomputing.

[60]  Feiping Nie,et al.  Robust Principal Component Analysis with Non-Greedy l1-Norm Maximization , 2011, IJCAI.