A spectral clustering approach to underdetermined postnonlinear blind source separation of sparse sources

This letter proposes a clustering-based approach for solving the underdetermined (i.e., fewer mixtures than sources) postnonlinear blind source separation (PNL BSS) problem when the sources are sparse. Although various algorithms exist for the underdetermined BSS problem for sparse sources, as well as for the PNL BSS problem with as many mixtures as sources, the nonlinear problem in an underdetermined scenario has not been satisfactorily solved yet. The method proposed in this letter aims at inverting the different nonlinearities, thus reducing the problem to linear underdetermined BSS. To this end, first a spectral clustering technique is applied that clusters the mixture samples into different sets corresponding to the different sources. Then, the inverse nonlinearities are estimated using a set of multilayer perceptrons (MLPs) that are trained by minimizing a specifically designed cost function. Finally, transforming each mixture by its corresponding inverse nonlinearity results in a linear underdetermined BSS problem, which can be solved using any of the existing methods

[1]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[2]  Jun Wang,et al.  Nonlinear Blind Source Separation Using Higher Order Statistics and a Genetic Algorithm , 2001 .

[3]  Russell H. Lambert,et al.  OVERDETERMINED BLIND SOURCE SEPARATION: USING MORE SENSORS THAN SOURCE SIGNALS IN A NOISY MIXTURE , 2000 .

[4]  Terrence J. Sejnowski,et al.  Blind source separation of more sources than mixtures using overcomplete representations , 1999, IEEE Signal Processing Letters.

[5]  Fabian J. Theis,et al.  Postnonlinear Overcomplete Blind Source Separation Using Sparse Sources , 2004, ICA.

[6]  Deniz Erdogmus,et al.  Estimation of the mixing matrix for underdetermined blind source separation using spectral estimation techniques , 2002, 2002 11th European Signal Processing Conference.

[7]  Tong Heng Lee,et al.  Evolutionary algorithms with dynamic population size and local exploration for multiobjective optimization , 2001, IEEE Trans. Evol. Comput..

[8]  David Luengo,et al.  A general solution to blind inverse problems for sparse input signals , 2005, Neurocomputing.

[9]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[10]  Fabian J. Theis,et al.  A geometric algorithm for overcomplete linear ICA , 2004, Neurocomputing.

[11]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[12]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[13]  Pierre Comon,et al.  Blind separation of sources, part II: Problems statement , 1991, Signal Process..

[14]  Raffaele Parisi,et al.  BLIND SOURCE SEPARATION IN NONLINEAR MIXTURES BY ADAPTIVE SPLINE NEURAL NETWORKS , 2001 .

[15]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[16]  Christian Jutten,et al.  A geometric approach for separating post non-linear mixtures , 2002, 2002 11th European Signal Processing Conference.

[17]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[18]  Deniz Erdogmus,et al.  Nonparametric Estimation and Tracking of the Mixing Matrix for Underdetermined Blind Source Separation , 2001 .