Stochastic gradient adaptive algorithms for blind source separation

Abstract The aim in blind source separation is to separate linear mixtures of statistically independent non-Gaussian signals without resorting to an a priori knowledge of the sources or the mixing system. In this paper we propose a new family of adaptive algorithms that recursively compute the optimum separating system. The algorithms are of the gradient ascent type and maximize a statistical criterion that involves only second- and fourth-order cumulants. We present a complete analysis of all the stationary points in the proposed criterion for an arbitrary number of complex sources. We demonstrate that the algorithms can only converge to points where perfect separation is achieved provided that the mixing system is a square invertible matrix and all the sources have the same kurtosis sign. We also prove that the criterion is free of undesirable maxima.

[1]  S. Amari,et al.  Gradient Learning in Structured Parameter Spaces: Adaptive Blind Separation of Signal Sources , 1996 .

[2]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[3]  Esfandiar Sorouchyari,et al.  Blind separation of sources, part III: Stability analysis , 1991, Signal Process..

[4]  Carlos J. Escudero,et al.  A blind signal separation method for multiuser communications , 1997, IEEE Trans. Signal Process..

[5]  P. Comon Independent Component Analysis , 1992 .

[6]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[7]  Ali Mansour,et al.  Blind Separation of Sources , 1999 .

[8]  J. Nadal,et al.  Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer Network 5 , 1994 .

[9]  Eric Moreau,et al.  A one stage self-adaptive algorithm for source separation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixture of sources via an independent component analysis , 1996, IEEE Trans. Signal Process..

[11]  Eric Moreau,et al.  High order contrasts for self-adaptive source separation criteria for complex source separation , 1996 .

[12]  Andrzej Cichocki,et al.  Stability Analysis of Learning Algorithms for Blind Source Separation , 1997, Neural Networks.

[13]  C. Burrus,et al.  Array Signal Processing , 1989 .

[14]  Ehud Weinstein,et al.  New criteria for blind deconvolution of nonminimum phase systems (channels) , 1990, IEEE Trans. Inf. Theory.

[15]  Ruey-Wen Liu,et al.  General approach to blind source separation , 1996, IEEE Trans. Signal Process..

[16]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[17]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[18]  Eric Moreau,et al.  Self-adaptive source separation. II. Comparison of the direct, feedback, and mixed linear network , 1998, IEEE Trans. Signal Process..

[19]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[20]  B. A. D. H. Brandwood A complex gradient operator and its applica-tion in adaptive array theory , 1983 .

[21]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..