Modified Herault-Jutten Algorithms for Blind Separation of Sources

Abstract We present several modifications of blind separation adaptive algorithms which have significant advantages over the well-known Herault–Jutten learning algorithm in handling ill-conditioned signals. In particular, the proposed algorithms are more stable and converge to the correct solutions in cases where previous algorithms did not. The problem is the classical one in which several independent source signals s j ( t ) ( j  = 1, 2,…,  n ) are linearly combined via unknown mixing coefficients (parameters) a ij to form observations x i ( t ) = ∑ j =1 n a ij s j ( t ), i = 1, 2, …, n . The synaptic weights w ij of a linear system (often referred to as a single-layer feedforward neural network) must be adapted to combine the observations x i ( t ) to form optimal estimates of the source signals ŝ p ( t ) = y p ( t ) = ∑ i =1 n w pi x i ( t ). The optimal weights correspond to the statistical independence of the output signals y p ( t ) and they simultaneously ensure self-normalization of these signals. Starting from the modified Herault–Jutten recursive neural network model, we have derived a family of on-line adaptive learning algorithms for feedback (fully recurrent) and feedforward architectures. The validity and high performance of the proposed neural network are illustrated by simulation.

[1]  Christian Jutten,et al.  Space or time adaptive signal processing by neural network models , 1987 .

[2]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[3]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[4]  John C. Platt,et al.  Networks for the Separation of Sources that Are Superimposed and Delayed , 1991, NIPS.

[5]  Pierre Comon,et al.  Blind separation of sources, part II: Problems statement , 1991, Signal Process..

[6]  Gilles Burel,et al.  Blind separation of sources: A nonlinear neural algorithm , 1992, Neural Networks.

[7]  Jean-Louis Lacoume,et al.  Separation of independent sources from correlated inputs , 1992, IEEE Trans. Signal Process..

[8]  Y. Bar-Ness,et al.  Bootstrap: a fast blind adaptive signal separator , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Meir Feder,et al.  Multi-channel signal separation by decorrelation , 1993, IEEE Trans. Speech Audio Process..

[10]  Adel Belouchrani,et al.  A new composite criterion for adaptive and iterative blind source separation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Juha Karhunen,et al.  Representation and separation of signals using nonlinear PCA type learning , 1994, Neural Networks.

[12]  Gene H. Golub,et al.  Fast algorithms for updating signal subspaces , 1994 .

[13]  Xieting Ling,et al.  A neural network for blind signal separation , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.

[14]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[15]  Shun-ichi Amari,et al.  Multi-Layer Neural Networks with a Local Adaptive Learning Rule for Blind Separation of Source Signa , 1995 .

[16]  Erkki Oja,et al.  Signal Separation by Nonlinear Hebbian Learning , 1995 .

[17]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[18]  Sun-Yuan Kung,et al.  Principal Component Neural Networks: Theory and Applications , 1996 .

[19]  Shun-ichi Amari,et al.  Adaptive approach to blind source separation with cancellation of additive and convolutional noise , 1996, Proceedings of Third International Conference on Signal Processing (ICSP'96).

[20]  Kenneth J. Pope,et al.  Blind Signal Separation I. Linear, Instantaneous Combinations: I. Linear, Instantaneous Combinations , 1996, Digit. Signal Process..

[21]  Shun-ichi Amari,et al.  Self-adaptive neural networks for blind separation of sources , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[22]  A. Cichocki,et al.  Hierarchical Neural Network for Robust PCA Computation of Complex Valued Signals , 1996 .

[23]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[24]  Andrzej Cichocki,et al.  Neural network approach to blind separation and enhancement of images , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).