Convergence analysis of online linear discriminant analysis

Convergence of a matrix dynamics for online LDA is analyzed. Especially, stable spurious solutions are pointed out and two schemes to prevent the spurious solutions are proposed. The performance of the algorithm is confirmed by simulations of face identification.

[1]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[2]  Anil K. Jain,et al.  Artificial neural networks for feature extraction and multivariate data projection , 1995, IEEE Trans. Neural Networks.

[3]  Vwani P. Roychowdhury,et al.  On self-organizing algorithms and networks for class-separability features , 1997, IEEE Trans. Neural Networks.

[4]  Satoru Hayamizu,et al.  Gesture recognition using HLAC features of PARCOR images and HMM based recognizer , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.