Adaptive minor component extraction with modular structure

An information criterion for adaptively estimating multiple minor eigencomponents of a covariance matrix is proposed. It is proved that the proposed criterion has a unique global minimum at the minor subspace and that all other equilibrium points are saddle points. Based on the gradient search approach of the proposed information criterion, an adaptive algorithm called adaptive minor component extraction (AMEX) is developed. The proposed algorithm automatically performs the multiple minor component extraction in parallel without the inflation procedure. Similar to the adaptive lattice filter structure, the AMEX algorithm also has the flexibility wherein increasing the number of the desired minor component does not affect the previously extracted minor components. The AMEX algorithm has a highly modular structure and the various modules operate completely in parallel without any delay. Simulation results are given to demonstrate the effectiveness of the AMEX algorithm for both the minor component analysis (MCA) and the minor subspace analysis (MSA).

[1]  Fa-Long Luo,et al.  A minor subspace analysis algorithm , 1997, IEEE Trans. Neural Networks.

[2]  Soura Dasgupta,et al.  Adaptive estimation of eigensubspace , 1995, IEEE Trans. Signal Process..

[3]  Guisheng Liao,et al.  Adaptive step-size minor component extraction algorithm , 1999 .

[4]  Zheng Bao,et al.  Total least mean squares algorithm , 1998, IEEE Trans. Signal Process..

[5]  Qingfu Zhang,et al.  Energy function for the one-unit Oja algorithm , 1995, IEEE Trans. Neural Networks.

[6]  T. Kailath,et al.  Least squares type algorithm for adaptive implementation of Pisarenko's harmonic retrieval method , 1982 .

[7]  Erkki Oja,et al.  Principal components, minor components, and linear neural networks , 1992, Neural Networks.

[8]  Yingbo Hua,et al.  Fast subspace tracking and neural network learning by a novel information criterion , 1998, IEEE Trans. Signal Process..

[9]  Juha Karhunen,et al.  A Unified Neural Bigradient Algorithm for robust PCA and MCA , 1996, Int. J. Neural Syst..

[10]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics (Revised Edition) , 1999 .

[11]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[12]  Jar-Ferr Yang,et al.  Adaptive eigensubspace algorithms for direction or frequency estimation and tracking , 1988, IEEE Trans. Acoust. Speech Signal Process..

[13]  Mark D. Plumbley Lyapunov functions for convergence of principal component algorithms , 1995, Neural Networks.

[14]  George Mathew,et al.  Orthogonal eigensubspace estimation using neural networks , 1994, IEEE Trans. Signal Process..

[15]  V. Pisarenko The Retrieval of Harmonics from a Covariance Function , 1973 .

[16]  Wei-Yong Yan,et al.  Global convergence of Oja's subspace algorithm for principal component extraction , 1998, IEEE Trans. Neural Networks.

[17]  S. Amari,et al.  A self-stabilized minor subspace rule , 1998, IEEE Signal Processing Letters.

[18]  K. Sharman,et al.  Eigenfilter approaches to adaptive array processing , 1983 .

[19]  R. Kumaresan,et al.  Estimating the Angles of Arrival of Multiple Plane Waves , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[20]  Erkki Oja,et al.  Modified Hebbian learning for curve and surface fitting , 1992, Neural Networks.

[21]  Bede Liu,et al.  Rotational search methods for adaptive Pisarenko harmonic retrieval , 1986, IEEE Trans. Acoust. Speech Signal Process..

[22]  Victor Solo,et al.  Performance analysis of adaptive eigenanalysis algorithms , 1998, IEEE Trans. Signal Process..

[23]  Ching-Tai Chiang,et al.  On the inflation method in adaptive noise-subspace estimator , 1999, IEEE Trans. Signal Process..