An iterative inversion approach to blind source separation

In this paper we present an iterative inversion (II) approach to blind source separation (BSS). It consists of a quasi-Newton method for the resolution of an estimating equation obtained from the implicit inversion of a robust estimate of the mixing system. The resulting learning rule includes several existing algorithms for BSS as particular cases giving them a novel and unified interpretation.It also provides a justification of the Cardoso and Laheld step size normalization. The II method is first presented for instantaneous mixtures and then extended to the problem of blind separation of convolutive mixtures. Finally, we derive the necessary and sufficient asymptotic stability conditions for both the instantaneous and convolutive methods to converge.

[1]  J. R. Ragazzini,et al.  Sampled-Data Control Systems , 1959 .

[2]  Alston S. Householder,et al.  The Theory of Matrices in Numerical Analysis , 1964 .

[3]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[4]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[5]  Victor Y. Pan,et al.  Efficient parallel solution of linear systems , 1985, STOC '85.

[6]  Jürgen Ackermann,et al.  Sampled-Data Control Systems , 1985 .

[7]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[8]  C. Kelley.  Iterative Methods for Linear and Nonlinear Equations , 1987 .

[9]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[10]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[11]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .

[12]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[13]  Esfandiar Sorouchyari,et al.  Blind separation of sources, part III: Stability analysis , 1991, Signal Process..

[14]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[15]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[16]  E. Oja.  The Nonlinear PCA Learning Rule and Signal Separation - Mathematical Analysis , 1995 .

[17]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[18]  Christian Jutten,et al.  Blind source separation for convolutive mixtures , 1995, Signal Process..

[19]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[20]  Barak A. Pearlmutter,et al.  A Context-Sensitive Generalization of ICA , 1996 .

[21]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[22]  Ruey-Wen Liu,et al.  General approach to blind source separation , 1996, IEEE Trans. Signal Process..

[23]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[24]  Shun-ichi Amari,et al.  Blind source separation-semiparametric statistical approach , 1997, IEEE Trans. Signal Process..

[25]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.

[26]  S.C. Douglas,et al.  Multichannel blind deconvolution and equalization using the natural gradient , 1997, First IEEE Signal Processing Workshop on Signal Processing Advances in Wireless Communications.

[27]  Shun-ichi Amari,et al.  Adaptive Online Learning Algorithms for Blind Separation: Maximum Entropy and Minimum Mutual Information , 1997, Neural Computation.

[28]  J. Cardoso.  Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[29]  Andrzej Cichocki,et al.  Stability Analysis of Learning Algorithms for Blind Source Separation , 1997, Neural Networks.

[30]  Andrzej Cichocki,et al.  Neural networks for blind decorrelation of signals , 1997, IEEE Trans. Signal Process..

[31]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[32]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[33]  Andrzej Cichocki,et al.  Robust techniques for independent component analysis (ICA) with noisy data , 1998, Neurocomputing.

[34]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[35]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[36]  Erkki Oja,et al.  The nonlinear PCA criterion in blind source separation: Relations with other approaches , 1998, Neurocomputing.

[37]  Yannick Deville,et al.  Self-adaptive separation of convolutively mixed signals with a recursive structure. Part I: Stability analysis and optimization of asymptotic behaviour , 1999, Signal Process..

[38]  Kari Torkkola,et al.  Blind Separation For Audio Signals - Are We There Yet? , 1999 .

[39]  William H. Press,et al.  Numerical recipes in C , 2002 .