Sparse Non-negative Pattern Learning for image representation

In this paper, we propose sparse non-negative pattern learning (SNPL) based on self-taught learning framework. In the algorithm, visual patterns are first learned from unlabeled data by non-negative matrix approximation with sparseness constraints, and then features are extracted by the second part of the algorithm, a conjugate family based non-negative sparse feature extraction method. By combining sparse and non-negative constraints of patterns together, SNPL model gives a better representation for images than state-of-art methods. Beyond that, we give an analytical solution for feature extraction although it is approximate, and thereby we extract the features for self-taught learning framework in a faster and more stable way. We apply the new model to various areas, including pattern coding, feature extraction, and recognition. Experimental results show the advantages of SNPL model.

[1]  Stan Z. Li,et al.  Local non-negative matrix factorization as a visual representation , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[2]  V. Rohatgi,et al.  An introduction to probability and statistics , 1968 .

[3]  Vijay K. Rohatgi,et al.  An Introduction to Probability and Statistics: Rohatgi/An Introduction , 2000 .

[4]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[5]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[6]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[7]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[8]  W. J. DeCoursey,et al.  Introduction: Probability and Statistics , 2003 .

[9]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[10]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[11]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Le Li,et al.  SENSC: a Stable and Efficient Algorithm for Nonnegative Sparse Coding: SENSC: a Stable and Efficient Algorithm for Nonnegative Sparse Coding , 2009 .

[13]  William Mendenhall,et al.  Introduction to Probability and Statistics , 1961, The Mathematical Gazette.