Mixture of Bilateral-Projection Two-Dimensional Probabilistic Principal Component Analysis

The probabilistic principal component analysis (PPCA) is built upon a global linear mapping, with which it is insufficient to model complex data variation. This paper proposes a mixture of bilateral-projection probabilistic principal component analysis model (mixB2DPPCA) on 2D data. With multi-components in the mixture, this model can be seen as a 'soft' cluster algorithm and has capability of modeling data with complex structures. A Bayesian inference scheme has been proposed based on the variational EM (Expectation-Maximization) approach for learning model parameters. Experiments on some publicly available databases show that the performance of mixB2DPPCA has been largely improved, resulting in more accurate reconstruction errors and recognition rates than the existing PCA-based algorithms.

[1]  Junbin Gao,et al.  Image Outlier Detection and Feature Extraction via L1-Norm-Based 2D Probabilistic PCA , 2015, IEEE Transactions on Image Processing.

[2]  Junbin Gao,et al.  Robust L1 Principal Component Analysis and Its Bayesian Variational Inference , 2008, Neural Computation.

[3]  Michel Verleysen,et al.  Robust probabilistic projections , 2006, ICML.

[4]  Hyun-Chul Kim,et al.  An efficient model order selection for PCA mixture model , 2003, Pattern Recognit. Lett..

[5]  Christopher M. Bishop,et al.  A Hierarchical Latent Variable Model for Data Visualization , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jian Yang,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[8]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[9]  Vojtech Franc,et al.  Robust subspace mixture models using t-distributions , 2003, BMVC.

[10]  David E. Booth,et al.  Applied Multivariate Analysis , 2003, Technometrics.

[11]  Cédric Archambeau,et al.  Probabilistic models in noisy environments : and their application to a visual prosthesis for the blind/ , 2005 .

[12]  Hans-Peter Kriegel,et al.  A General Framework for Increasing the Robustness of PCA-Based Correlation Clustering Algorithms , 2008, SSDBM.

[13]  Geoffrey E. Hinton,et al.  The EM algorithm for mixtures of factor analyzers , 1996 .

[14]  Bin Luo,et al.  Probabilistic two-dimensional principal component analysis and its mixture model for face recognition , 2008, Neural Computing and Applications.

[15]  Ting Su,et al.  Automated hierarchical mixtures of probabilistic principal component analyzers , 2004, ICML.

[16]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[17]  Jing Wang,et al.  2DPCA with L1-norm for simultaneously robust and sparse modelling , 2013, Neural Networks.

[18]  Jieping Ye,et al.  Generalized Low Rank Approximations of Matrices , 2004, Machine Learning.

[19]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[20]  Jieping Ye,et al.  Matrix-variate and higher-order probabilistic projections , 2011, Data Mining and Knowledge Discovery.

[21]  Junbin Gao,et al.  Mixture of the Robust L1 Distributions and Its Applications , 2007, Australian Conference on Artificial Intelligence.

[22]  Shuicheng Yan,et al.  Matrix-Variate Factor Analysis and Its Applications , 2008, IEEE Transactions on Neural Networks.

[23]  P O Hoyer,et al.  Independent component analysis applied to feature extraction from colour and stereo images , 2000, Network.

[24]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[25]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[27]  Konstantinos N. Plataniotis,et al.  Ensemble-based discriminant learning with boosting for face recognition , 2006, IEEE Transactions on Neural Networks.