Discriminative orthogonal elastic preserving projections for classification

The traditional manifold learning methods can preserve the local sub-manifold structure or the global geometry effectively, such as elastic preserving projections (EPP). Many experimental results have been shown that EPP, a recently developed linear algorithm, is a strong analyzer for high-dimensional data. However, for classification problems, the traditional methods focused on the geometrical information and ignores discriminative information of different classes. In this paper, we propose a novel discriminative orthogonal elastic preserving projections (DOEPP) by imposing the discriminant information and the orthogonal constraint to improve its classification performance. DOEPP does not only preserve the elasticity of the training set, but also sufficiently utilizes the discriminant information by adding maximum margin criterion and the orthogonality of the projection matrix into its objective function. Extensive experiments on two well-known synthetic manifold data sets and four publicly available databases illustrate the effectiveness of our method.

[1]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, CVPR.

[2]  Wei Jia,et al.  Locality preserving discriminant projections for face and palmprint recognition , 2010, Neurocomputing.

[3]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[5]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Deli Zhao,et al.  Linear local tangent space alignment and application to face recognition , 2007, Neurocomputing.

[7]  H. Sebastian Seung,et al.  The Manifold Ways of Perception , 2000, Science.

[8]  Xuelong Li,et al.  Patch Alignment for Dimensionality Reduction , 2009, IEEE Transactions on Knowledge and Data Engineering.

[9]  Wei Jia,et al.  Discriminant sparse neighborhood preserving embedding for face recognition , 2012, Pattern Recognit..

[10]  YanShuicheng,et al.  Graph Embedding and Extensions , 2007 .

[11]  Deng Cai,et al.  Orthogonal locality preserving indexing , 2005, SIGIR '05.

[12]  Stephen Lin,et al.  Marginal Fisher Analysis and Its Variants for Human Gait Recognition and Content- Based Image Retrieval , 2007, IEEE Transactions on Image Processing.

[13]  Wei Li,et al.  Discriminative uncorrelated neighborhood preserving projection for facial expression recognition , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[14]  Jie Gui,et al.  Multi-step dimensionality reduction and semi-supervised graph-based tumor classification using gene expression data , 2010, Artif. Intell. Medicine.

[15]  Dong Xu,et al.  Patch Distribution Compatible Semisupervised Dimension Reduction for Face and Human Gait Recognition , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Jie Gui,et al.  Feature extraction using orthogonal discriminant local tangent space alignment , 2011, Pattern Analysis and Applications.

[17]  Feiping Nie,et al.  Multiple view semi-supervised dimensionality reduction , 2010, Pattern Recognit..

[18]  Yousef Saad,et al.  Orthogonal neighborhood preserving projections , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[19]  Thomas L Griffiths,et al.  A multidimensional scaling approach to mental multiplication , 2002, Memory & cognition.

[20]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[21]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[22]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[23]  Zilan Hu,et al.  Comment on: "Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition" , 2008, Pattern Recognit..

[24]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[25]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[26]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[27]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[28]  Jiang-She Zhang,et al.  Face recognition using Elasticfaces , 2012, Pattern Recognit..

[29]  Daniel Engel,et al.  A Survey of Dimension Reduction Methods for High-dimensional Data Analysis and Visualization , 2011, VLUDS.

[30]  Zhang Jun,et al.  Speed up junction detector based on azimuth consensus by Harris corner , 2014 .

[31]  Dewen Hu,et al.  Comment on: "Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition" , 2008, Pattern Recognit..

[32]  Nicolas Le Roux,et al.  Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering , 2003, NIPS.

[33]  Tommy W. S. Chow,et al.  A two-dimensional Neighborhood Preserving Projection for appearance-based face recognition , 2012, Pattern Recognit..

[34]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[35]  Yi Wu,et al.  Stable local dimensionality reduction approaches , 2009, Pattern Recognit..

[36]  M. Naderi Think globally... , 2004, HIV prevention plus!.

[37]  Yousef Saad,et al.  Orthogonal Neighborhood Preserving Projections: A Projection-Based Dimensionality Reduction Technique , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Geoffrey E. Hinton,et al.  Global Coordination of Local Linear Models , 2001, NIPS.

[39]  Tao Jiang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.