Sparse concept discriminant matrix factorization for image representation

Over the past few decades, matrix factorization has attracted considerable attention for image representation. It is desired for a matrix factorization technique to find the basis that is able to capture highly discriminant information as well as to preserve the intrinsic manifold structure. Besides, the basis has to generate a sparse representation for a given image. In this paper, we propose a matrix factorization method called Sparse concept Discriminant Matrix Factorization (SDMF) by combining a novel fisher-like criterion with the sparse coding. The criterion is discriminant enough across different feature spaces, and meanwhile maintains locally neighboring structures. The proposed method is general for both cases with and without class labels, hence yielding supervised and un-supervised SDMFs. Experimental results show that SDMF provides better representation with higher performance on two tasks (image recognition and clustering) compared with the existing matrix factorization methods.

[1]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[2]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[3]  Hujun Bao,et al.  Sparse concept coding for visual analysis , 2011, CVPR 2011.

[4]  Chuang Lin,et al.  Neighbourhood sensitive preserving embedding for pattern classification , 2014, IET Image Process..

[5]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[8]  Xuelong Li,et al.  Non-negative graph embedding , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Wei Liu,et al.  Nonnegative Local Coordinate Factorization for Image Representation , 2011, IEEE Transactions on Image Processing.

[10]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[11]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[12]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[13]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[14]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Xuelong Li,et al.  Local Coordinate Concept Factorization for Image Representation , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Xudong Jiang,et al.  Discriminative sparsity preserving embedding for face recognition , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Siwei Luo,et al.  A Supervised Subspace Learning Algorithm: Supervised Neighborhood Preserving Embedding , 2007, ADMA.

[18]  Chuang Lin,et al.  Graph regularized non-negative matrix factorization with sparse coding , 2013, 2013 IEEE China Summit and International Conference on Signal and Information Processing.

[19]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[20]  Jiawei Han,et al.  Spectral Regression for Efficient Regularized Subspace Learning , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Xudong Jiang,et al.  Linear Subspace Learning-Based Dimensionality Reduction , 2011, IEEE Signal Processing Magazine.

[22]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[23]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[24]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.