A Modified Oja–Xu MCA Learning Algorithm and Its Convergence Analysis

The original Oja-Xu minor component analysis (MCA) learning algorithm is not convergent. This brief shows that by modifying Oja-Xu MCA learning algorithm with a normalization step the modified one could be convergent subject to some conditions satisfied. The convergence of the modified MCA learning algorithm is studied by analyzing the convergence of an associated deterministic discrete time system. Necessary and sufficient conditions for convergence are obtained. Simulations further confirm the results

[1]  Erkki Oja,et al.  Principal components, minor components, and linear neural networks , 1992, Neural Networks.

[2]  Zhang Yi,et al.  Convergence analysis of a deterministic discrete time system of Oja's PCA learning algorithm , 2005, IEEE Transactions on Neural Networks.

[3]  Guanrong Chen,et al.  Global Exponential Convergence of Multitime-Scale , 2005 .

[4]  Mao Ye,et al.  Convergence Analysis for Oja+ MCA Learning Algorithm , 2004, ISNN.

[5]  Lennart Ljung,et al.  Analysis of recursive stochastic algorithms , 1977 .

[6]  Vwani P. Roychowdhury,et al.  Algorithms for accelerated convergence of adaptive PCA , 2000, IEEE Trans. Neural Networks Learn. Syst..

[7]  Sabine Van Huffel,et al.  The MCA EXIN neuron for the minor component analysis , 2002, IEEE Trans. Neural Networks.

[8]  Qingfu Zhang,et al.  On the discrete-time dynamics of a PCA learning algorithm , 2003, Neurocomputing.

[9]  Qin Lin,et al.  A unified algorithm for principal and minor components extraction , 1998, Neural Networks.

[10]  Erkki Oja,et al.  Modified Hebbian learning for curve and surface fitting , 1992, Neural Networks.

[11]  Jar-Ferr Yang,et al.  Adaptive eigensubspace algorithms for direction or frequency estimation and tracking , 1988, IEEE Trans. Acoust. Speech Signal Process..

[12]  Pedro J. Zufiria,et al.  On the discrete-time dynamics of the basic Hebbian neural network node , 2002, IEEE Trans. Neural Networks.

[13]  M. Simaan,et al.  IN ThE PRESENCE OF WHITE NOISE , 1985 .

[14]  Fa-Long Luo,et al.  A Minor Component Analysis Algorithm , 1997, Neural Networks.

[15]  Jun Wang,et al.  Global output convergence of a class of continuous-time recurrent neural networks with time-varying thresholds , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.