Control Design for Iterative Methods in Solving Linear Algebraic Equations

In the interaction between control and mathematics, mathematical tools are fundamental for all the control methods, but it is unclear how control impacts mathematics. This is the first part of our paper that attempts to give an answer with focus on solving linear algebraic equations (LAEs) from the perspective of systems and control, where it mainly introduces the controllability-based design results. By proposing an iterative method that integrates a learning control mechanism, a class of tracking problems for iterative learning control (ILC) is explored for the problem solving of LAEs. A trackability property of ILC is newly developed, by which analysis and synthesis results are established to disclose the equivalence between the solvability of LAEs and the controllability of discrete control systems. Hence, LAEs can be solved by equivalently achieving the perfect tracking tasks of resulting ILC systems via the classic state feedback-based design and analysis methods. It is shown that the solutions for any solvable LAE can all be calculated with different selections of the initial input. Moreover, the presented ILC method is applicable to determining all the least squares solutions of any unsolvable LAE. In particular, a deadbeat design is incorporated to ILC such that the solving of LAEs can be completed within finite iteration steps. The trackability property is also generalized to conventional two-dimensional ILC systems, which creates feedback-based methods, instead of the common used contraction mapping-based methods, for the design and convergence analysis of ILC.

[1]  Samer S. Saab Selection of the learning gain matrix of an iterative learning control algorithm in presence of measurement noise , 2005, IEEE Transactions on Automatic Control.

[2]  Jon Crowcroft,et al.  Parallel iterative solution method for large sparse linear equation systems , 2005 .

[3]  Emre Kural,et al.  96 A Survey of Iterative Learning Control Al earning-based method for high-performance tracking control , 2006 .

[4]  Y. Saad,et al.  Iterative solution of linear systems in the 20th century , 2000 .

[5]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[6]  Danwei Wang,et al.  Enhanced Data-Driven Optimal Terminal ILC Using Current Iteration Control Knowledge , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Ji Liu,et al.  Exponential convergence of a distributed algorithm for solving linear algebraic equations , 2017, Autom..

[8]  Jian-Xin Xu,et al.  A survey on iterative learning control for nonlinear systems , 2011, Int. J. Control.

[9]  Zhongsheng Hou,et al.  Notes on Data-driven System Approaches , 2009 .

[10]  Deyuan Meng,et al.  Convergence Conditions for Solving Robust Iterative Learning Control Problems Under Nonrepetitive Model Uncertainties , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Frank Allgöwer,et al.  Iterative Learning and Extremum Seeking for Repetitive Time-Varying Mappings , 2015, IEEE Transactions on Automatic Control.

[12]  C. Kelley Iterative Methods for Linear and Nonlinear Equations , 1987 .

[13]  Deyuan Meng,et al.  Contraction Mapping-Based Robust Convergence of Iterative Learning Control With Uncertain, Locally Lipschitz Nonlinearity , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  P. Lancaster,et al.  The theory of matrices : with applications , 1985 .

[15]  Jm Jeroen Willems,et al.  Iterative Learning Control of Iteration-Varying Systems via Robust Update Laws with Experimental Implementation , 2017 .

[16]  Eugenius Kaszkurewicz,et al.  A Control-Theoretic Approach to the Design of Zero Finding Numerical Methods , 2007, IEEE Transactions on Automatic Control.

[17]  Kevin L. Moore,et al.  Robust Iterative Learning Control for Nonrepetitive Uncertain Systems , 2017, IEEE Transactions on Automatic Control.

[18]  Kevin L. Moore,et al.  Iterative Learning Control: Brief Survey and Categorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[19]  Jianxin Xu,et al.  Observer-based iterative learning control for a class of time-varying nonlinear systems , 2003 .

[20]  Xinghuo Yu,et al.  Iterative learning control for discrete-time systems with event-triggered transmission strategy and quantization , 2016, Autom..

[21]  Deyuan Meng,et al.  From Control to Mathematics-Part II: Observability-Based Design for Iterative Methods in Solving Linear Equations , 2021, ArXiv.

[22]  Shaoshuai Mou,et al.  A distributed algorithm for solving a linear algebraic equation , 2015, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[23]  S. Campbell Numerical analysis and systems theory , 2001 .

[24]  Mingxuan Sun,et al.  Initial shift issues on discrete-time iterative learning control with system relative degree , 2003, IEEE Trans. Autom. Control..

[25]  Mikael Norrlöf,et al.  Some Controllability Aspects for Iterative Learning Control , 2019 .

[26]  Dong Shen,et al.  An Iterative Learning Control Algorithm With Gain Adaptation for Stochastic Systems , 2020, IEEE Transactions on Automatic Control.

[27]  Uwe Helmke,et al.  A control theory approach to linear equation solvers , 2006 .

[28]  Kevin L. Moore,et al.  Monotonically convergent iterative learning control for linear discrete-time systems , 2005, Autom..

[29]  N. Elia,et al.  A Distributed Algorithm for Solving Linear Algebraic Equations Over Random Networks , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[30]  Minyue Fu,et al.  A Fast Distributed Solver for Linear Systems Under Generalized Diagonal Dominance , 2021, IEEE Transactions on Automatic Control.

[31]  Mingxuan Sun,et al.  Iterative learning control with initial rectifying action , 2002, Autom..

[32]  Eugenius Kaszkurewicz,et al.  Iterative methods as dynamical systems with feedback control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[33]  Jens Jordan,et al.  Optimal Control of Iterative Solution Methods for Linear Systems of Equations , 2005 .

[34]  Anne Greenbaum,et al.  Iterative methods for solving linear systems , 1997, Frontiers in applied mathematics.

[35]  Hou Zhong,et al.  On Data-driven Control Theory:the State of the Art and Perspective , 2009 .

[36]  Xuefang Li,et al.  An Iterative Learning Control Approach for Linear Systems With Randomly Varying Trial Lengths , 2014, IEEE Transactions on Automatic Control.