Continuous-Time Varying Complex QR Decomposition via Zeroing Neural Dynamics

QR decomposition (QRD) is of fundamental importance for matrix factorization in both real and complex cases. In this paper, by using zeroing neural dynamics method, a continuous-time model is proposed for solving the time-varying problem of QRD in real-time. The proposed dynamics use time derivative information from a known real or complex matrix. Furthermore, its theoretical analysis is provided to substantiate the convergence and effectiveness of solving the time-varying QRD problem. In addition, numerical experiments in four different-dimensional time-varying matrices show that the proposed model is effective for solving the time-varying QRD problem both in the case of a real or a complex matrix as input.

[1]  Lin Xiao,et al.  A finite-time convergent neural dynamics for online solution of time-varying linear complex matrix equation , 2015, Neurocomputing.

[2]  Jun Yu,et al.  Click Prediction for Web Image Reranking Using Multimodal Sparse Coding , 2014, IEEE Transactions on Image Processing.

[3]  Yang Zhang,et al.  QR decomposition architecture using the iteration look-ahead modified Gram-Schmidt algorithm , 2016, IET Circuits Devices Syst..

[4]  Shuai Li,et al.  Modified ZNN for Time-Varying Quadratic Programming With Inherent Tolerance to Noises and Its Application to Kinematic Redundancy Resolution of Robot Manipulators , 2016, IEEE Transactions on Industrial Electronics.

[5]  Stephen Becker,et al.  Improved Fixed-Rank Nyström Approximation via QR Decomposition: Practical and Theoretical Aspects , 2017, Neurocomputing.

[6]  Cheng He,et al.  New Parameter-Identification Method Based on QR Decomposition for Nonlinear Time-Varying Systems , 2019 .

[7]  Zhiliang Qiu,et al.  Novel noise reduction algorithm for LS channel estimation in OFDM system with frequency selective channels , 2010, 2010 IEEE International Conference on Communication Systems.

[8]  Vasilios N. Katsikis,et al.  Higher-Order ZNN Dynamics , 2019, Neural Processing Letters.

[9]  S. Qiao,et al.  Generalized Inverses: Theory and Computations , 2018 .

[10]  Predrag S. Stanimirovic,et al.  Full-rank representations of outer inverses based on the QR decomposition , 2012, Appl. Math. Comput..

[11]  Zhihua Wei,et al.  QRKISS: A Two-Stage Metric Learning via QR-Decomposition and KISS for Person Re-Identification , 2018, Neural Processing Letters.

[12]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[13]  Omair Inam,et al.  QR-decomposition based SENSE reconstruction using parallel architecture , 2018, Comput. Biol. Medicine.

[14]  Lin Xiao,et al.  A nonlinearly-activated neurodynamic model and its finite-time solution to equality-constrained quadratic optimization with nonstationary coefficients , 2016, Appl. Soft Comput..

[15]  Dongsheng Guo,et al.  Novel Discrete-Time Zhang Neural Network for Time-Varying Matrix Inversion , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Long Jin,et al.  Taylor-type 1-step-ahead numerical differentiation rule for first-order derivative approximation and ZNN discretization , 2015, J. Comput. Appl. Math..

[17]  Long Jin,et al.  Continuous and discrete Zhang dynamics for real-time varying nonlinear optimization , 2015, Numerical Algorithms.

[18]  Shuai Li,et al.  Varying-parameter Zhang neural network for approximating some expressions involving outer inverses , 2020, Optim. Methods Softw..

[19]  Abhishek K Gupta,et al.  Numerical Methods using MATLAB , 2014, Apress.

[20]  Uwe Helmke,et al.  Singular value decomposition of time-varying matrices , 2003, Future Gener. Comput. Syst..

[21]  Yunong Zhang,et al.  Online singular value decomposition of time-varying matrix via zeroing neural dynamics , 2020, Neurocomputing.

[22]  Shuai Li,et al.  Integration enhanced and noise tolerant ZNN for computing various expressions involving outer inverses , 2019, Neurocomputing.

[23]  Erricos John Kontoghiorghes,et al.  Parallel algorithms for computing all possible subset regression models using the QR decomposition , 2003, Parallel Comput..

[24]  Vasilios N. Katsikis,et al.  Modified discrete iterations for computing the inverse and pseudoinverse of the time-varying matrix , 2018, Neurocomputing.

[25]  Wolfgang Fichtner,et al.  Gram-Schmidt-based QR decomposition for MIMO detection: VLSI implementation and comparison , 2008, APCCAS 2008 - 2008 IEEE Asia Pacific Conference on Circuits and Systems.

[26]  R. Penrose.  On best approximate solutions of linear matrix equations , 1956, Mathematical Proceedings of the Cambridge Philosophical Society.

[27]  Mark A. Richards,et al.  QR decomposition on GPUs , 2009, GPGPU-2.

[28]  Yunong Zhang,et al.  New zeroing neural dynamics models for diagonalization of symmetric matrix stream , 2019, Numerical Algorithms.

[29]  Alexander Graham,et al.  Kronecker Products and Matrix Calculus: With Applications , 1981 .

[30]  Konstantinos G. Margaritis,et al.  Managing the computational cost of model selection and cross-validation in extreme learning machines via Cholesky, SVD, QR and eigen decompositions , 2018, Neurocomputing.

[31]  Yunong Zhang,et al.  Different Complex ZFs Leading to Different Complex ZNN Models for Time-Varying Complex Generalized Inverse Matrices , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Yunong Zhang,et al.  Zhang Neural Networks and Neural-Dynamic Method , 2011 .

[33]  James Demmel,et al.  Communication-Avoiding QR Decomposition for GPUs , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[34]  Jun Yu,et al.  Hierarchical Deep Click Feature Prediction for Fine-Grained Image Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Pengfei Shi,et al.  An efficient and effective method to solve kernel Fisher discriminant analysis , 2004, Neurocomputing.

[36]  Afshin Ebrahimi,et al.  Time-varying singular value decomposition analysis of electrodermal activity: A novel method of cognitive load estimation , 2018, Measurement.

[37]  Abdelhak Bennia,et al.  A Simplified Architecture of the Zhang Neural Network for Toeplitz Linear Systems Solving , 2017, Neural Processing Letters.

[38]  Yunong Zhang,et al.  From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion , 2014, Neurocomputing.

[39]  Shuai Li,et al.  Hybrid GNN-ZNN models for solving linear matrix equations , 2018, Neurocomputing.

[40]  Chih-Hung Lin,et al.  Iterative QR Decomposition Architecture Using the Modified Gram-Schmidt Algorithm for MIMO Systems , 2010, IEEE Trans. Circuits Syst. I Regul. Pap..

[41]  Ning Ye,et al.  Fast orthogonal linear discriminant analysis with application to image classification , 2015, Neurocomputing.