Quantum Gate Elman Neural Network and Its Quantized Extended Gradient Back-propagation Training Algorithm

A novel Elman neural model with hybrid quantum gate structure and a quantized extended-gradient backpropagation(BP) training algorithm are proposed for improving the performance of the conventional Elman network.The novel model is comprised of qubit neurons and classical neurons.The quantum map layer is employed to address the pattern mismatch between the context layer and the input layer.The complementary relationships between the outputs of qubit neurons and the quantum gate parameters are applied to improve the updated ability of the conventional Elman network.The learning rate is adaptively adjusted by the searching and convergent learning strategy,which makes the new neural model achieving convergence with high speed.The context-layer weights are extended into the hidden-layer weights matrix for obtaining the extra gradient information,such that the context-layer patterns match the input-layer patterns with high level.The numerical experiments are carried out to verify the theoretical results and clearly show that the hybrid quantized Elman network using quantized training ofers a good performance in terms of both weight convergence and generalization ability.

[1]  N. Matsui,et al.  A network model based on qubitlike neuron corresponding to quantum circuit , 2000 .

[2]  Nobuyuki Matsui,et al.  An Examination of Qubit Neural Network in Controlling an Inverted Pendulum , 2005, Neural Processing Letters.

[3]  Xiang Li,et al.  Chaotifying linear Elman networks , 2002, IEEE Trans. Neural Networks.

[4]  Qing Song,et al.  On the Weight Convergence of Elman Networks , 2010, IEEE Transactions on Neural Networks.

[5]  Yung C. Shin,et al.  Constructive training of recurrent neural networks using hybrid optimization , 2010, Neurocomputing.

[6]  Hua Xu,et al.  An Elman neural network-based model for predicting anti-germ performances and ingredient levels with limited experimental data , 2011, Expert Syst. Appl..

[7]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[8]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[9]  N. Suha Bayindir,et al.  Speed estimation of an induction motor using Elman neural network , 2003, Neurocomputing.

[10]  DeLiang Wang,et al.  On Temporal Generalization of Simple Recurrent Networks , 1996, Neural Networks.

[11]  Syuan-Yi Chen,et al.  Direct decentralized neural control for nonlinear MIMO magnetic levitation system , 2009, Neurocomputing.

[12]  Cheng-Yuan Liou,et al.  Modeling word perception using the Elman network , 2008, Neurocomputing.

[13]  Ganesh K. Venayagamoorthy,et al.  Quantum inspired PSO for the optimization of simultaneous recurrent neural networks as MIMO learning systems , 2010, Neural Networks.