Complex-valued neural networks for the Takagi vector of complex symmetric matrices

Abstract This paper proposes complex-valued neural network for computing the Takagi vectors corresponding to the largest Takagi value of complex symmetric matrices. We establish some properties of the complex-valued neural network. Based on the Takagi factorization of complex symmetric matrices, we establish an explicit representation for the solution of the neural network and analyze its convergence property. Under certain conditions, we design a strategy to computing the Takagi factorization of a complex symmetric matrix by the proposed neural network. As an application, we consider the left and right singular vectors associated with the largest singular value for complex Toeplitz matrices. We illustrate our theory via numerical examples.

[1]  Andrzej Cichocki,et al.  Neural networks for computing eigenvalues and eigenvectors , 1992, Biological Cybernetics.

[2]  Nikola Samardzija,et al.  A neural network for computing eigenvectors and eigenvalues , 1991, Biological Cybernetics.

[3]  Zhenjiang Zhao,et al.  Impulsive effects on stability of discrete-time complex-valued neural networks with both discrete and distributed time-varying delays , 2015, Neurocomputing.

[4]  Jun Wang,et al.  A Complex-Valued Projection Neural Network for Constrained Optimization of Real Functions in Complex Variables , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Benedikt Loesch,et al.  Cramér-Rao Bound for Circular and Noncircular Complex Independent Component Analysis , 2013, IEEE Transactions on Signal Processing.

[6]  Jun Wang,et al.  Global Stability of Complex-Valued Recurrent Neural Networks With Time-Delays , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Gang Feng,et al.  A neural network for robust LCMP beamforming , 2006, Signal Process..

[8]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[9]  Peter Arbenz,et al.  On solving complex-symmetric eigenvalue problems arising in the design of axisymmetric VCSEL devices , 2008 .

[10]  Wei Xu,et al.  Block Lanczos tridiagonalization of complex symmetric matrices , 2005, SPIE Optics + Photonics.

[11]  T. Sogabe,et al.  A COCR method for solving complex symmetric linear systems , 2007 .

[12]  Yiguang Liu,et al.  A simple functional neural network for computing the largest and smallest eigenvalues and corresponding eigenvectors of a real symmetric matrix , 2005, Neurocomputing.

[13]  Tohru Nitta.  Complex-valued Neural Networks: Utilizing High-dimensional Parameters , 2009 .

[14]  N. N. Vakhania,et al.  Random Vectors with Values in Complex Hilbert Spaces , 1997 .

[15]  Zhenjiang Zhao,et al.  Stability analysis of complex-valued neural networks with probabilistic time-varying delays , 2015, Neurocomputing.

[16]  Igor N. Aizenberg,et al.  Complex-Valued Neural Networks with Multi-Valued Neurons , 2011, Studies in Computational Intelligence.

[17]  Wei Xing Zheng,et al.  A complex-valued neural dynamical optimization approach and its stability analysis , 2015, Neural Networks.

[18]  M. Bohner,et al.  Global Stability of Complex-Valued Neural Networks on Time Scales , 2011 .

[19]  Shi-Liang Wu,et al.  Several variants of the Hermitian and skew‐Hermitian splitting method for a class of complex symmetric linear systems , 2015, Numer. Linear Algebra Appl..

[20]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[21]  D. Bertaccini.  EFFICIENT PRECONDITIONING FOR SEQUENCES OF PARAMETRIC COMPLEX SYMMETRIC LINEAR SYSTEMS , 2004 .

[22]  W. Gragg,et al.  Singular value decompositions of complex symmetric matrices , 1988 .

[23]  Peter Arbenz,et al.  A Jacobi-Davidson Method for Solving Complex Symmetric Eigenvalue Problems , 2004, SIAM J. Sci. Comput..

[24]  L. Trefethen.  Near-circularity of the error curve in complex Chebyshev approximation , 1981 .

[25]  T. Tam,et al.  Toeplitz matrices are unitarily similar to symmetric matrices , 2017 .

[26]  Benedikt Loesch,et al.  Cramér-Rao Bound for Circular Complex Independent Component Analysis , 2012, LVA/ICA.

[27]  Stephen A. Vavasis,et al.  A norm bound for projections with complex weights , 2000 .

[28]  Fang Chen,et al.  On preconditioned MHSS iteration methods for complex symmetric linear systems , 2011, Numerical Algorithms.

[29]  Akira Hirose,et al.  Complex-Valued Neural Networks: Theories and Applications , 2003 .

[30]  Simon R. Arridge,et al.  Preconditioning of complex symmetric linear systems with applications in optical tomography , 2013 .

[31]  Stephen A. Vavasis,et al.  An Iterative Method for Solving Complex-Symmetric Systems Arising in Electrical Power Modeling , 2005, SIAM J. Matrix Anal. Appl..

[32]  Sk. Safique Ahmad.  Perturbation analysis for complex symmetric, skew symmetric, even and odd matrix polynomials , 2011 .

[33]  Zhengqiu Zhang,et al.  Global asymptotic stability for a class of complex-valued Cohen-Grossberg neural networks with time delays , 2016, Neurocomputing.

[34]  Wei Xu,et al.  A Divide-and-Conquer Method for the Takagi Factorization , 2008, SIAM J. Matrix Anal. Appl..

[35]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[36]  Jeffrey Danciger,et al.  A min–max theorem for complex symmetric matrices , 2006 .

[37]  Teiji Takagi,et al.  On an Algebraic Problem Reluted to an Analytic Theorem of Carathéodory and Fejér and on an Allied Theorem of Landau , 1924 .

[38]  Sabine Van Huffel,et al.  Enhanced resolution based on minimum variance estimation and exponential data modeling , 1993, Signal Process..

[39]  Cui-Xia Li,et al.  A Double-Parameter GPMHSS Method for a Class of Complex Symmetric Linear Systems from Helmholtz Equation , 2014 .

[40]  Raf Vandebril,et al.  A comparison between the complex symmetric based and classical computation of the singular value decomposition of normal matrices , 2014, Numerical Algorithms.

[41]  Xiaohui Xu,et al.  Exponential stability of complex-valued neural networks with mixed delays , 2014, Neurocomputing.

[42]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[43]  Yan Fu,et al.  Neural networks based approach for computing eigenvectors and eigenvalues of symmetric matrix , 2004 .

[44]  Wei Xu,et al.  A twisted factorization method for symmetric SVD of a complex symmetric tridiagonal matrix , 2009, Numer. Linear Algebra Appl..

[45]  James Demmel,et al.  LAPACK Users' Guide, Third Edition , 1999, Software, Environments and Tools.

[46]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[47]  O. Axelsson,et al.  Real valued iterative methods for solving complex symmetric linear systems , 2000 .

[48]  V. Hasanov.  An iterative method for solving the spectral problem of complex symmetric matrices , 2004 .

[49]  Gene H. Golub,et al.  Matrix computations , 1983 .

[50]  Alex D. Bain,et al.  Chemical exchange in NMR , 2003 .