A Non-Linear Blind Source Separation Method Based on Perceptron Structure and Conjugate Gradient Algorithm

The linear mixing model has been considered previously in most of the researches which are devoted to the blind source separation (BSS) problem. In practice, a more realistic BSS mixing model should be the non-linear one. In this paper, we propose a non-linear BSS method, in which a two-layer perceptron network is employed as the separating system to separate sources from observed non-linear mixture signals. The learning rules for the parameters of the separating system are derived based on the minimum mutual information criterion with conjugate gradient algorithm. Instead of choosing a proper non-linear functions empirically, the adaptive kernel density estimation is used in order to estimate the probability density functions and their derivatives of the separated signals. As a result, the score function of the perceptron’s outputs can be estimated directly. Simulations show good performance of the proposed non-linear BSS algorithm.

[1]  Peng Jia,et al.  Blind Source Separation Based on Nonparametric Density Estimation , 2003 .

[2]  Yujie Zhang,et al.  Linear and nonlinear ICA based on mutual information , 2007, 2007 International Symposium on Intelligent Signal Processing and Communication Systems.

[3]  Juha Karhunen,et al.  Blind separation of nonlinear mixtures by variational Bayesian learning , 2007, Digit. Signal Process..

[4]  Rui Li,et al.  Harmonic Signals Retrieval Approach Based on Blind Source Separation , 2010, Circuits Syst. Signal Process..

[5]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[6]  Dinh Tuan Pham,et al.  BLIND SOURCE SEPARATION IN POST NONLINEAR MIXTURES , 2001 .

[7]  Shun-ichi Amari,et al.  Adaptive Online Learning Algorithms for Blind Separation: Maximum Entropy and Minimum Mutual Information , 1997, Neural Computation.

[8]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[9]  Yingtao Jiang,et al.  Blind source separation with time series variational Bayes expectation maximization algorithm , 2012, Digit. Signal Process..

[10]  Liqing Zhang,et al.  Self-adaptive blind source separation based on activation functions adaptation , 2004, IEEE Transactions on Neural Networks.

[11]  Wady Naanaa,et al.  A geometric approach to blind separation of nonnegative and dependent source signals , 2010, 2010 18th European Signal Processing Conference.

[12]  Soo-Young Lee.  Blind Source Separation and Independent Component Analysis: A Review , 2005 .

[13]  Christian Jutten,et al.  Source separation in post nonlinear mixtures: an entropy-based algorithm , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[14]  Yannick Deville,et al.  Recurrent networks for separating extractable-target nonlinear mixtures. Part II. Blind configurations , 2013, Signal Process..

[15]  Jack D. Cowan,et al.  Source Separation and Density Estimation by Faithful Equivariant SOM , 1996, NIPS.

[16]  Seungjin Choi.  Blind Source Separation and Independent Component Analysis : A Review , 2004 .

[17]  Luís B. Almeida,et al.  MISEP -- Linear and Nonlinear ICA Based on Mutual Information , 2003, J. Mach. Learn. Res..

[18]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[19]  E. Oja,et al.  Independent Component Analysis , 2013 .

[20]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[21]  Samuel L. Braunstein,et al.  Sure Success Partial Search , 2007, Quantum Inf. Process..

[22]  Lieven De Lathauwer,et al.  Tensor-based techniques for the blind separation of DS-CDMA signals , 2007, Signal Process..

[23]  Halima Bahi,et al.  Type–2 Fuzzy Gaussian mixture models for singing voice classification in commercial music production , 2013 .

[24]  Ganesh R. Naik,et al.  Edge Effect Elimination in Single-Mixture Blind Source Separation , 2013, Circuits, Systems, and Signal Processing.

[25]  Jacek M. Zurada,et al.  Nonlinear Blind Source Separation Using a Radial Basis Function Network , 2001 .

[26]  Luís B. Almeida,et al.  Linear and nonlinear ICA based on mutual information - the MISEP method , 2004, Signal Process..

[27]  A. Hyvärinen,et al.  Nonlinear Blind Source Separation by Self-Organizing Maps , 1996 .

[28]  A. J. Shaka,et al.  Postprocessing and sparse blind source separation of positive and partially overlapped data , 2011, Signal Process..