A maximum entropy based nonlinear blind source separation approach using a two-layer perceptron network

This paper addresses the problem of blind separation of nonlinear mixed signals. A nonlinear blind source separation method is developed, in which a two-layer perceptron network is employed as the separating system to separate sources from the observed non-linear mixture signals. The learning algorithms for the parameters of the separating system are derived based on the maximum entropy (ME) criterion. Instead of choosing non-linear functions empirically, the nonparametric kernel density estimation is exploited to estimate the score function of the perceptron's outputs directly. Simulations show good performance of the proposed algorithm.

[1]  Wady Naanaa,et al.  A geometric approach to blind separation of nonnegative and dependent source signals , 2010, 2010 18th European Signal Processing Conference.

[2]  Jack D. Cowan,et al.  Source Separation and Density Estimation by Faithful Equivariant SOM , 1996, NIPS.

[3]  Gustavo Deco,et al.  Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures , 1995, Neural Networks.

[4]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[5]  Michael W. Berry,et al.  Text Mining Using Non-Negative Matrix Factorizations , 2004, SDM.

[6]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[7]  Christian Jutten,et al.  Source separation in post nonlinear mixtures: an entropy-based algorithm , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[8]  Guy J. Brown,et al.  Separation of Speech by Computational Auditory Scene Analysis , 2005 .

[9]  Jenq-Neng Hwang,et al.  Nonparametric multivariate density estimation: a comparative study , 1994, IEEE Trans. Signal Process..

[10]  A. Hyvärinen,et al.  Nonlinear Blind Source Separation by Self-Organizing Maps , 1996 .

[11]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[12]  Hong-Min Lu,et al.  Fast nonunitary joint block diagonalization with degenerate solution elimination for convolutive blind source separation , 2012, Digit. Signal Process..

[13]  HwangJenq-Neng,et al.  Nonparametric multivariate density estimation , 1994 .

[14]  Pierre Comon Independent component analysis - a new concept? signal processing , 1994 .