A simple geometric blind source separation method for bounded magnitude sources

A novel blind source separation approach and the corresponding adaptive algorithm is presented. It is assumed that the observation mixture is obtained through an unknown memoryless linear mapping of independent and bounded magnitude sources. We further assume an initial adaptive prewhitening of the original observation vector which transforms it into a white vector with the same dimension as the original source vector. Our approach is centered around the basic geometric fact that, under a certain boundedness assumption, the unitary mapping which transforms the whitening output vector into an independent vector has the minimum value of maximum (real component) magnitude output over the ensemble of all output components. Therefore, the related criterion is the minimization of the infinity norm of the real component of the unitary separator's output over all possible output combinations. For the minimization of the corresponding nondifferentiable cost function, we propose the use of subgradient optimization methods to obtain a low complexity iterative adaptive solution. The resulting algorithm is fairly intuitive and simple, and provides a low complexity solution especially to a class of multiuser digital communications problems. We provide examples at the end of this paper to illustrate the performance of our algorithm.

[1]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[2]  Rodney A. Kennedy,et al.  Convex cost functions in blind equalization , 1994, IEEE Trans. Signal Process..

[3]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[4]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals , 2000, Int. J. Neural Syst..

[5]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[6]  D. Bertsekas,et al.  Convergen e Rate of In remental Subgradient Algorithms , 2000 .

[7]  Naum Zuselevich Shor,et al.  Minimization Methods for Non-Differentiable Functions , 1985, Springer Series in Computational Mathematics.

[8]  Alper T. Erdogan,et al.  Fast and low complexity blind equalization via subgradient projections , 2005, IEEE Transactions on Signal Processing.

[9]  Constantinos B. Papadias,et al.  Globally convergent blind source separation based on a multiuser kurtosis maximization criterion , 2000, IEEE Trans. Signal Process..

[10]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[11]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[12]  Jean-Louis Goffin,et al.  On convergence rates of subgradient optimization methods , 1977, Math. Program..

[13]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[14]  Claude Lemaréchal,et al.  Convergence of some algorithms for convex minimization , 1993, Math. Program..

[15]  N. Z. Shor The rate of convergence of the generalized gradient descent method , 1968 .

[16]  Jean-Louis Goffin,et al.  Convergence of a simple subgradient level method , 1999, Math. Program..

[17]  Dinh-Tuan Pham,et al.  Mutual information approach to blind separation of stationary sources , 2002, IEEE Trans. Inf. Theory.

[18]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[19]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[20]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[21]  Hanif D. Sherali,et al.  A variable target value method for nondifferentiable optimization , 2000, Oper. Res. Lett..

[22]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .