Adaptive Quasi-Newton Algorithm for Source Extraction via CCA Approach

This paper addresses the problem of adaptive source extraction via the canonical correlation analysis (CCA) approach. Based on Liu's analysis of CCA approach, we propose a new criterion for source extraction, which is proved to be equivalent to the CCA criterion. Then, a fast and efficient online algorithm using quasi-Newton iteration is developed. The stability of the algorithm is also analyzed using Lyapunov's method, which shows that the proposed algorithm asymptotically converges to the global minimum of the criterion. Simulation results are presented to prove our theoretical analysis and demonstrate the merits of the proposed algorithm in terms of convergence speed and successful rate for source extraction.

[1]  Klaus Obermayer,et al.  Blind Source Separation of Single Components from Linear Mixtures , 2001, ICANN.

[2]  Hans Knutsson,et al.  Exploratory fMRI Analysis by Autocorrelation Maximization , 2002, NeuroImage.

[3]  Andrzej Cichocki,et al.  Blind source extraction based on a linear predictor , 2007 .

[4]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[5]  Xianda Zhang,et al.  Sequential Blind Extraction Adopting Second-Order Statistics , 2007, IEEE Signal Processing Letters.

[6]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[7]  Zhang Yi,et al.  Robust extraction of specific signals with temporal structure , 2006, Neurocomputing.

[8]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[9]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[10]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[11]  George-Othon Glentis,et al.  Efficient least squares adaptive algorithms for FIR transversal filtering , 1999, IEEE Signal Process. Mag..

[12]  R. Fletcher,et al.  Practical Methods of Optimization: Fletcher/Practical Methods of Optimization , 2000 .

[13]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[14]  Andrzej Cichocki,et al.  On-line Algorithm for Blind Signal Extraction of Arbitrarily Distributed, but Temporally Correlated Sources Using Second Order Statistics , 2000, Neural Processing Letters.

[15]  Ana Maria Tomé,et al.  The generalized eigendecomposition approach to the blind source separation problem , 2006, Digit. Signal Process..

[16]  Jun Wang,et al.  Sequential blind extraction of instantaneously mixed sources , 2002, IEEE Trans. Signal Process..

[17]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[18]  Allan Kardec Barros,et al.  A blind extraction of temporally correlated but statistically dependent acoustic signals , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[19]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[20]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[21]  Wei Liu,et al.  Blind Second-Order Source Extraction of Instantaneous Noisy Mixtures , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[22]  Wei Liu,et al.  A class of novel blind source extraction algorithms based on a linear predictor , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[23]  Allan Kardec Barros,et al.  Extraction of Specific Signals with Temporal Structure , 2001, Neural Computation.

[24]  Wei Liu,et al.  Analysis and Online Realization of the CCA Approach for Blind Source Separation , 2007, IEEE Transactions on Neural Networks.

[25]  Yong Xiang,et al.  Nonnegative Blind Source Separation by Sparse Component Analysis Based on Determinant Measure , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Yong Xiang,et al.  Time-Frequency Approach to Underdetermined Blind Source Separation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Hans Knutsson,et al.  A canonical correlation approach to blind source separation , 2001 .

[28]  Mark D. Plumbley.  Lyapunov functions for convergence of principal component algorithms , 1995, Neural Networks.

[29]  A. Cichocki,et al.  Robust whitening procedure in blind source separation context , 2000 .

[30]  Zied Malouche,et al.  Adaptive unsupervised extraction of one component of a linear mixture with a single neuron , 1998, IEEE Trans. Neural Networks.

[31]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[32]  W.-T. Zhang,et al.  Iterative Algorithm for Joint Zero Diagonalization With Application in Blind Source Separation , 2011, IEEE Transactions on Neural Networks.