Dual cascade networks for blind signal extraction

A new neural-network approach is presented for extracting independent source signals one-by-one from a linear mixture of them when the number of noisy mixed signals is equal to or larger than the number of sources. In this approach, two types of cascade neural networks, having similar structures, are employed. The first cascade network performs prewhitening (preprocessing) of the mixed signals by sequentially extracting principal components. From the normalized (to unit variance) prewhitened signals, the second network, then sequentially extracts the original source signals in order according to their stochastic properties, namely, in decreasing order of absolute valves of normalized kurtosis. Extensive computer simulations confirm the validity and high performance of our approach.

[1]  Aapo Hyvärinen,et al.  A neuron that learns to separate one signal from a mixture of independent sources , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[2]  Shun-ichi Amari,et al.  Self-adaptive neural networks for blind separation of sources , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[3]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[4]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[5]  Andrzej Cichocki,et al.  Blind extraction of source signals with specified stochastic features , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[7]  E. Oja,et al.  On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix , 1985 .

[8]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[9]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[10]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.

[11]  Zied Malouche,et al.  Extended anti-Hebbian adaptation for unsupervised source extraction , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[12]  Shun-ichi Amari,et al.  Blind signal extraction using self-adaptive nonlinear Hebbian learning rule , 1996 .

[13]  Marimuthu Palaniswami,et al.  Computational Intelligence: A Dynamic System Perspective , 1995 .

[14]  Andrzej Cichocki,et al.  Neural network approach to blind separation and enhancement of images , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[15]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[16]  Andrzej Cichocki,et al.  Robust estimation of principal components by using neural network learning algorithms , 1993 .