论文信息 - On the convergence of SIPEX: a simultaneous principal components extraction algorithm

On the convergence of SIPEX: a simultaneous principal components extraction algorithm

We have previously proposed SIPEX as a fast-converging and accurate principal components algorithm (Erdogmus, D. et al., Proc. ICASSP'02, vol.1, p.1069-72, 2002; Proc. EUSIPCO'02, vol.2, p.335-8, 2002). Its superiority in terms of data efficiency and solution accuracy was demonstrated through Monte Carlo simulations. We focus on the convergence properties of the original gradient-based algorithm as well as two modified versions of SIPEX based on approximations to the Hessian matrix of the cost function. We provide practical bounds on the step sizes of these algorithms and compare their convergence properties.

[1] Erkki Oja,et al. Subspace methods of pattern recognition , 1983 .

[2] Terence D. Sanger,et al. Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[3] Lei Xu,et al. Least mean square error reconstruction principle for self-organizing neural-nets , 1993, Neural Networks.

[4] Gene H. Golub,et al. Matrix computations , 1983 .

[5] Jing Zhao,et al. Simultaneous extraction of Principal Components using givens rotations and output variances , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6] S.Y. Kung,et al. Adaptive Principal component EXtraction (APEX) and applications , 1994, IEEE Trans. Signal Process..

[7] Deniz Erdogmus,et al. An efficient, robust, and fast converging principal components extraction algorithm: SIPEX-G , 2002, 2002 11th European Signal Processing Conference.