Aadaptive signal de-noising based on feedback networks and counterpropagation network

The main purpose of this paper is to realize adaptive signal denoising simulation of some kind of feedback neural network models. The bidirectional associative memory (BAM) neural network, the discrete Hopfield feedback network (DHN), and the counterpropagation network (CPN) are discussed under the conditions of outside and within the maximal memory capacity. The experimental simulations of the three kind of networks are realized to data de-noise, the experimental results are compared and analyzed, show that both BAM network and discrete Hopfield network within the maximal memory capacity have all good de-noise effect, fewer iterations, less training time, and operation stability. The CPN is sensitive to initial weight values, good de-noising effect, but more iterations. When noise is increased and outside the maximal memory capacity of BAM network or DHN, we find that the CPN is of better de-noise performance than discrete Hopfield networks and Kosko's BAM net under the condition of overstepping the maximal memory capacity. Full CPN is of better de-noise performance than one-way CPN, but the former takes a longer training time.

[1]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[2]  Jehoshua Bruck On the convergence properties of the Hopfield model , 1990, Proc. IEEE.

[3]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[4]  Ma Jinwen The asymmetric Hopfield model for associative memory , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[5]  R. Hecht-Nielsen Counterpropagation networks. , 1987, Applied optics.

[6]  Xinghui Zhang,et al.  Sensitivity to noise in bidirectional associative memory (BAM) , 2005, IEEE Transactions on Neural Networks.

[7]  Peng Chu,et al.  Stability Conditions for Discrete Delayed Hopfield Neural Networks , 2007, Third International Conference on Natural Computation (ICNC 2007).

[8]  R. V. Patel,et al.  A counter-propagation neural network for function approximation , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.