Batch-incremental principal component analysis with exact mean update

Incremental principal component analysis (IPCA) has been of great interest in computer vision and machine learning. In this paper, we introduce a new incremental learning procedure for principal component analysis (PCA). The proposed method can keep an accurate track of the mean of the data, and can deal with a set of new observed data in batch each time in subspace updating. Furthermore, a weighting function is proposed for contribution balance of the current data and the new observed data to the new subspace. The performance of our method is illustrated in the experiments on face modeling and face recognition.

[1]  Yongmin Li,et al.  On incremental and robust subspace learning , 2004, Pattern Recognit..

[2]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[3]  Haitao Zhao,et al.  A novel incremental principal component analysis and its application for face recognition , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Danijel Skocaj,et al.  Incremental and robust learning of subspace representations , 2008, Image Vis. Comput..

[5]  Juyang Weng,et al.  Candid Covariance-Free Incremental Principal Component Analysis , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[7]  E. Oja,et al.  On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix , 1985 .

[8]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[10]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Ralph R. Martin,et al.  Adding and subtracting eigenspaces with eigenvalue decomposition and singular value decomposition , 2002, Image and Vision Computing.

[12]  Danijel Skocaj,et al.  Weighted and robust incremental method for subspace learning , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.