Temporal decorrelation using teacher forcing anti-Hebbian learning and its application in adaptive blind source separation

This paper proposes a network architecture to compute on-line the temporal crosscorrelation function between two signals, either stationary or locally stationary. We show that the weights of a multi-FIR (finite impulse response) filter trained with a teacher forcing anti-Hebbian rule encode the crosscorrelation function between the input and the desired response. We extend this network to the Gamma filter which is an IIR (infinite impulse response) filter and also to nonlinear filters. This temporal correlation idea is applied to the blind source separation problem. From these networks we build a recurrent system trained on-line with anti-Hebbian learning which performs temporal decorrelation on the mixed signals. The system performance is tested in speech signals mixed in time with good results. A comparison of the performance among the different topologies is also presented in the paper.

[1]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[2]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[3]  P. Foldiak,et al.  Adaptive network for optimal linear feature extraction , 1989, International 1989 Joint Conference on Neural Networks.

[4]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[5]  Jing Peng,et al.  An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories , 1990, Neural Computation.

[6]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[7]  Erkki Oja,et al.  Principal components, minor components, and linear neural networks , 1992, Neural Networks.

[8]  Meir Feder,et al.  Multi-channel signal separation by decorrelation , 1993, IEEE Trans. Speech Audio Process..

[9]  José Carlos Príncipe,et al.  The gamma-filter-a new class of adaptive IIR filters with restricted feedback , 1993, IEEE Trans. Signal Process..

[10]  Sun-Yuan Kung,et al.  Cross-correlation neural network models , 1994, IEEE Trans. Signal Process..

[11]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[12]  Dirk Van Compernolle,et al.  Signal separation by symmetric adaptive decorrelation: stability, convergence, and uniqueness , 1995, IEEE Trans. Signal Process..

[13]  Kiyotoshi Matsuoka,et al.  A neural net for blind separation of nonstationary signals , 1995, Neural Networks.

[14]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .