Convergence of Batch Split-Complex Backpropagation Algorithm for Complex-Valued Neural Networks

The batch split-complex backpropagation (BSCBP) algorithm for training complex-valued neural networks is considered. For constant learning rate, it is proved that the error function of BSCBP algorithm is monotone during the training iteration process, and the gradient of the error function tends to zero. By adding a moderate condition, the weights sequence itself is also proved to be convergent. A numerical example is given to support the theoretical analysis.

[1]  Cris Koutsougeras,et al.  Complex domain backpropagation , 1992 .

[2]  Sammy Siu,et al.  Analysis of the Initial Values in Split-Complex Backpropagation Algorithm , 2008, IEEE Transactions on Neural Networks.

[3]  Tohru Nitta,et al.  Orthogonality of Decision Boundaries in Complex-Valued Neural Networks , 2004, Neural Computation.

[4]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[5]  Junhai Ma,et al.  Multivariate Nonlinear Analysis and Prediction of Shanghai Stock Market , 2008 .

[6]  Tohru Nitta,et al.  An Extension of the Back-Propagation Algorithm to Complex Numbers , 1997, Neural Networks.

[7]  T. Adalı,et al.  Fully complex backpropagation for constant envelope signal processing , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[8]  Francesco Piazza,et al.  On the complex backpropagation algorithm , 1992, IEEE Trans. Signal Process..

[9]  R. D. Murphy,et al.  Iterative solution of nonlinear equations , 1994 .

[10]  Danilo P. Mandic,et al.  Stochastic Gradient-Adaptive Complex-Valued Nonlinear Neural Adaptive Filters With a Gradient-Adaptive Step Size , 2007, IEEE Transactions on Neural Networks.

[11]  Yonggang Chen,et al.  Delay-Dependent Exponential Stability for Discrete-Time BAM Neural Networks with Time-Varying Delays , 2008 .

[12]  Danilo P. Mandic,et al.  A Data-Reusing Nonlinear Gradient Descent Algorithm for a Class of Complex-Valued Neural Adaptive Filters , 2003, Neural Processing Letters.

[13]  Qiang Zhang,et al.  On Global Exponential Stability of Discrete-Time Hopfield Neural Networks with Variable Delays , 2007 .