Blind Source Separation with Neural Networks: Demixing Sources From Mixtures with Different Parameters

The goal of this research is to develop multilayer neural network topology for independent component analysis (ICA) which maximizes the entropy of the outputs with logistic transfer function. The purpose of the hidden layers is: a) whitening of the input data for yielding good separation results; b) separation of the independent sources (components); c) estimation of the basis vectors. The performed simulations were based on different choice of source signals, noise and parameters of the mixing matrices in order to study the ability of the NN to solve the blind source separation problem. The results were compared with those received by Karhunen-Oja nonlinear PCA algorithm

[1]  Natacha Gueorguieva,et al.  Multilayer Feedforward Neural Network for Image Feature Extraction Using Independent Component Analysis , 2003, IC-AI.

[2]  Erkki Oja,et al.  Independent component approach to the analysis of EEG and MEG recordings , 2000, IEEE Transactions on Biomedical Engineering.

[3]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[4]  A. J. Bell,et al.  A Unifying Information-Theoretic Framework for Independent Component Analysis , 2000 .

[5]  Alberto Prieto,et al.  An adaptive geometrical procedure for blind separation of sources , 2006, Neural Processing Letters.

[6]  Te-Won Lee,et al.  A Unifying Information-Theoretic Framework for ICA , 1998 .

[7]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[8]  Fabian J. Theis,et al.  Generalizing Geometric ICA to Nonlinear Settings , 2009, IWANN.

[9]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[10]  Juha Karhunen,et al.  Blind source separation using least-squares type adaptive algorithms , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Elmar Lang,et al.  Probabilistic and geometric ICA applied to the separation of EEG signals , 2000 .

[12]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[13]  S Makeig,et al.  Analysis of fMRI data by blind separation into independent spatial components , 1998, Human brain mapping.

[14]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[15]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[16]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[17]  Erkki Oja,et al.  Image Feature Extraction Using Independent Component Analysis , 1996 .

[18]  Ralph Linsker,et al.  An Application of the Principle of Maximum Information Preservation to Linear Systems , 1988, NIPS.

[19]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[20]  Terrence J. Sejnowski,et al.  Blind source separation of more sources than mixtures using overcomplete representations , 1999, IEEE Signal Processing Letters.

[21]  Abraham Silberschatz,et al.  What Makes Patterns Interesting in Knowledge Discovery Systems , 1996, IEEE Trans. Knowl. Data Eng..

[22]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[23]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[24]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Iren Valova,et al.  ICA based neural network for image denoising , 2004, Circuits, Signals, and Systems.

[26]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[27]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[28]  Aapo Hyvärinen,et al.  The Fixed-Point Algorithm and Maximum Likelihood Estimation for Independent Component Analysis , 1999, Neural Processing Letters.

[29]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.