Probabilistic semi-supervised random subspace sparse representation for classification

In this paper, we present a novel approach for classification named Probabilistic Semi-supervised Random Subspace Sparse Representation (P-RSSR). In many random subspaces based methods, all features have the same probability to be selected to compose the random subspace. However, in the real world, especially in images, some regions or features are important for classification and some are not. In the proposed P-RSSR, firstly, we calculate the distribution probability of the image and determine which feature is selected to compose the random subspace. Then, we use Sparse Representation (SR) to construct graphs to characterize the distribution of samples in random subspaces, and train classifiers under the framework of Manifold Regularization (MR) in these random subspaces. Finally, we fuse the results in all random subspaces and obtain the classified results through majority vote. Experimental results on face image datasets have demonstrated the effectiveness of the proposed P-RSSR.

[1]  Hongbin Zha,et al.  Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[2]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[3]  Yu Zheng,et al.  Urban Water Quality Prediction Based on Multi-Task Multi-View Learning , 2016, IJCAI.

[4]  Hujun Bao,et al.  A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning , 2014, IEEE Transactions on Image Processing.

[5]  Julien Mairal,et al.  Proximal Methods for Sparse Hierarchical Dictionary Learning , 2010, ICML.

[6]  Jian Yang,et al.  Sparse Approximation to the Eigensubspace for Discrimination , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[9]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[10]  Bo Zhang,et al.  Sparse regularization for semi-supervised classification , 2011, Pattern Recognit..

[11]  Zili Zhang,et al.  Semi-supervised classification based on subspace sparse representation , 2013, Knowledge and Information Systems.

[12]  Guillermo Sapiro,et al.  Classification and clustering via dictionary learning with structured incoherence and shared features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Choujun Zhan,et al.  Semi-Supervised Image Classification Based on Local and Global Regression , 2015, IEEE Signal Processing Letters.

[14]  Yu Zheng,et al.  Predicting Urban Water Quality With Ubiquitous Data - A Data-Driven Approach , 2016, IEEE Transactions on Big Data.

[15]  Tommy W. S. Chow,et al.  Automatic image annotation via compact graph based semi-supervised learning , 2015, Knowl. Based Syst..

[16]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[17]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[18]  Hongbin Zha,et al.  Visual analysis of child-adult interactive behaviors in video sequences , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[19]  Guoliang Fan,et al.  Multilayer Joint Gait-Pose Manifolds for Human Gait Motion Modeling , 2015, IEEE Transactions on Cybernetics.

[20]  Jiang Yue,et al.  Kernel maximum likelihood scaled locally linear embedding for night vision images , 2014 .

[21]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  David L. Donoho,et al.  Solution of l1Minimization Problems by LARS/Homotopy Methods , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[23]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[24]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[25]  Xiaoyang Tan,et al.  Sparsity preserving discriminant analysis for single training image face recognition , 2010, Pattern Recognit. Lett..

[26]  Lyle H. Ungar,et al.  Beyond Binary Labels: Political Ideology Prediction of Twitter Users , 2017, ACL.

[27]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[29]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Li Liu,et al.  Recognizing Complex Activities by a Probabilistic Interval-Based Model , 2016, AAAI.

[31]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Jian Yang,et al.  Sparse two-dimensional local discriminant projections for feature extraction , 2011, Neurocomputing.

[33]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[34]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Jane You,et al.  Semi-supervised ensemble classification in subspaces , 2012, Appl. Soft Comput..

[36]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[37]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[38]  Wenhua Wang,et al.  Classification by semi-supervised discriminative regularization , 2010, Neurocomputing.

[39]  Federico Girosi,et al.  An Equivalence Between Sparse Approximation and Support Vector Machines , 1998, Neural Computation.

[40]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[41]  Neil D. Lawrence,et al.  Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data , 2003, NIPS.

[42]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[43]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[44]  Hongbin Zha,et al.  Tracking Generic Human Motion via Fusion of Low- and High-Dimensional Approaches , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[45]  Chao Wang,et al.  Feature extraction using constrained maximum variance mapping , 2008, Pattern Recognit..

[46]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[47]  Ke Chen,et al.  Semi-Supervised Learning via Regularized Boosting Working on Multiple Semi-Supervised Assumptions , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[49]  Michael Elad,et al.  Image Sequence Denoising via Sparse and Redundant Representations , 2009, IEEE Transactions on Image Processing.

[50]  Jane You,et al.  Semi-supervised classification based on random subspace dimensionality reduction , 2012, Pattern Recognit..

[51]  Hakan Cevikalp,et al.  Semi-Supervised Dimensionality Reduction Using Pairwise Equivalence Constraints , 2008, VISAPP.

[52]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Luming Zhang,et al.  Fortune Teller: Predicting Your Career Path , 2016, AAAI.

[54]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  A. Martínez,et al.  The AR face databasae , 1998 .

[56]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[57]  Lei Zhang,et al.  A multi-manifold discriminant analysis method for image feature extraction , 2011, Pattern Recognit..

[58]  Julien Mairal,et al.  Network Flow Algorithms for Structured Sparsity , 2010, NIPS.

[59]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[60]  Aleksandar Dogandžić,et al.  Automatic hard thresholding for sparse signal reconstruction from NDE measurements , 2010 .

[61]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[62]  Zhang Hua-xiang,et al.  Semi-supervised Image Classification Learning Based on Random Feature Subspace , 2014 .

[63]  Y. Smulders,et al.  1,8 , 2019, Huisarts en wetenschap.

[64]  Yi Liu,et al.  SemiBoost: Boosting for Semi-Supervised Learning , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Akira Shiozaki,et al.  Edge extraction using entropy operator , 1986, Comput. Vis. Graph. Image Process..