Quadratic Projection Based Feature Extraction with Its Application to Biometric Recognition

This paper presents a novel quadratic projection based feature extraction framework, where a set of quadratic matrices is learned to distinguish each class from all other classes. We formulate quadratic matrix learning (QML) as a standard semidefinite programming (SDP) problem. However, the conventional interior-point SDP solvers do not scale well to the problem of QML for high-dimensional data. To solve the scalability of QML, we develop an efficient algorithm, termed DualQML, based on the Lagrange duality theory, to extract nonlinear features. To evaluate the feasibility and effectiveness of the proposed framework, we conduct extensive experiments on biometric recognition. Experimental results on three representative biometric recognition tasks, including face, palmprint, and ear recognition, demonstrate the superiority of the DualQML-based feature extraction algorithm compared to the current state-of-the-art algorithms. HighlightsA novel quadratic projection based feature extraction framework is developed.A set of quadratic matrices is learnt to distinguish each class from other classes.Quadratic matrix learning (QML) is formulated as an SDP problem.An efficient algorithm is developed to solve QML based on Lagrange duality theory.Experiments on biometric recognition show the effectiveness of our algorithm.

[1]  Marios Savvides,et al.  Correlation Pattern Recognition for Face Recognition , 2006, Proceedings of the IEEE.

[2]  Ping Yan,et al.  Biometric Recognition Using 3D Ear Shape , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Chenye Wu,et al.  Automated human identification using ear imaging , 2012, Pattern Recognit..

[4]  David Zhang,et al.  Online Palmprint Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jian Yang,et al.  Discriminative histograms of local dominant orientation (D-HLDO) for biometric image feature extraction , 2013, Pattern Recognit..

[6]  Lei Zhang,et al.  Shrinkage Expansion Adaptive Metric Learning , 2014, ECCV.

[7]  Maya R. Gupta,et al.  Dimensionality Reduction by Local Discriminative Gaussians , 2012, ICML.

[8]  Xilin Chen,et al.  Projection Metric Learning on Grassmann Manifold with Application to Video based Face Recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  David Zhang,et al.  On-Line Palmprint Identification , 2005 .

[10]  Haiping Lu,et al.  A survey of multilinear subspace learning for tensor data , 2011, Pattern Recognit..

[11]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[12]  Woo Chaw Seng,et al.  A review of biometric technology along with trends and prospects , 2014, Pattern Recognit..

[13]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[14]  J KriegmanDavid,et al.  Eigenfaces vs. Fisherfaces , 1997 .

[15]  Stefanos Zafeiriou,et al.  Regularized Kernel Discriminant Analysis With a Robust Kernel for Face Recognition and Verification , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Xudong Jiang,et al.  Linear Subspace Learning-Based Dimensionality Reduction , 2011, IEEE Signal Processing Magazine.

[17]  Yuandong Tian,et al.  Joint Boosting Feature Selection for Robust Face Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[19]  Salim Chikhi,et al.  An efficient feature selection scheme based on genetic algorithm for ear biometrics authentication , 2015, 2015 12th International Symposium on Programming and Systems (ISPS).

[20]  Wen Gao,et al.  Maximal Linear Embedding for Dimensionality Reduction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[22]  David Zhang,et al.  Optimal subset-division based discrimination and its kernelization for face and palmprint recognition , 2012, Pattern Recognit..

[23]  Rama Chellappa,et al.  Joint Sparse Representation for Robust Multimodal Biometrics Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[25]  Hongyuan Zha,et al.  Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment , 2002, ArXiv.

[26]  Jian Yang,et al.  KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[28]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[29]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  David Zhang,et al.  Biometric Recognition Using Feature Selection and Combination , 2005, AVBPA.

[32]  Tieniu Tan,et al.  Ordinal palmprint represention for personal identification [represention read representation] , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Songhwai Oh,et al.  Elastic-net regularization of singular values for robust subspace learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Francesca Odone,et al.  A Regularized Framework for Feature Selection in Face Detection and Authentication , 2009, International Journal of Computer Vision.

[35]  Arun Ross,et al.  Handbook of Biometrics , 2007 .

[36]  Tieniu Tan,et al.  Ordinal Feature Selection for Iris and Palmprint Recognition , 2014, IEEE Transactions on Image Processing.

[37]  YanShuicheng,et al.  Graph Embedding and Extensions , 2007 .

[38]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[39]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[41]  Zhenhua Guo,et al.  Feature Band Selection for Online Multispectral Palmprint Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[42]  H. Zha,et al.  Principal manifolds and nonlinear dimensionality reduction via tangent space alignment , 2004, SIAM J. Sci. Comput..

[43]  Xudong Jiang,et al.  Asymmetric Principal Component and Discriminant Analyses for Pattern Classification , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Nick Barnes,et al.  Fast and Robust Object Detection Using Asymmetric Totally Corrective Boosting , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[45]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[46]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[47]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[48]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Bernhard Schölkopf,et al.  A kernel view of the dimensionality reduction of manifolds , 2004, ICML.

[50]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[51]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[52]  Yu-Jin Zhang,et al.  1D correlation filter based class-dependence feature analysis for face recognition , 2008, Pattern Recognit..

[53]  Mehrtash Tafazzoli Harandi,et al.  From Manifold to Manifold: Geometry-Aware Dimensionality Reduction for SPD Matrices , 2014, ECCV.

[54]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[55]  Stephen Lin,et al.  Marginal Fisher Analysis and Its Variants for Human Gait Recognition and Content- Based Image Retrieval , 2007, IEEE Transactions on Image Processing.

[56]  Xudong Jiang,et al.  Eigenfeature Regularization and Extraction in Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.