Data-driven Learning of Minimum-Energy Controls for Linear Systems

In this paper we study the problem of learning minimum-energy controls for linear systems from experimental data. The design of open-loop minimum-energy control inputs to steer a linear system between two different states in finite time is a classic problem in control theory, whose solution can be computed in closed form using the system matrices and its controllability Gramian. Yet, the computation of these inputs is known to be ill-conditioned, especially when the system is large, the control horizon long, and the system model uncertain. Due to these limitations, open-loop minimum-energy controls and the associated state trajectories have remained primarily of theoretical value. Surprisingly, in this paper we show that open-loop minimum-energy controls can be learned exactly from experimental data, with a finite number of control experiments over the same time horizon, without knowledge or estimation of the system model, and with an algorithm that is significantly more reliable than the direct model-based computation. These findings promote a new philosophy of controlling large, uncertain, linear systems where data is abundantly available.

[1]  John Lygeros,et al.  On Submodularity and Controllability in Complex Dynamical Networks , 2014, IEEE Transactions on Control of Network Systems.

[2]  R. Skelton,et al.  Markov Data-Based LQG Control , 2000 .

[3]  M. Steinbuch,et al.  Data-based optimal control , 2005, Proceedings of the 2005, American Control Conference, 2005..

[4]  Michel Gevers Identification for Control: From the Early Achievements to the Revival of Experiment Design , 2005, CDC 2005.

[5]  Alexandre S. Bazanella,et al.  Data-Driven LQR Control Design , 2018, IEEE Control Systems Letters.

[6]  R. Skelton,et al.  The data-based LQG control problem , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[7]  Katsuhisa Furuta,et al.  Discrete-time LQG dynamic controller design using plant Markov parameters , 1995, Autom..

[8]  Claudio Altafini,et al.  Minimum energy control for complex networks , 2016, Scientific Reports.

[9]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[10]  Francesco Bullo,et al.  Controllability Metrics, Limitations and Algorithms for Complex Networks , 2014, IEEE Trans. Control. Netw. Syst..

[11]  Thomas Kailath,et al.  Linear Systems , 1980 .

[12]  Jorge Cortés,et al.  Gramian-Based Reachability Metrics for Bilinear Networks , 2015, IEEE Transactions on Control of Network Systems.

[13]  Shiyu Zhao,et al.  Networks with diagonal controllability Gramian: Analysis, graphical conditions, and design algorithms , 2019, Autom..

[14]  Francesco Bullo,et al.  Controllability Metrics, Limitations and Algorithms for Complex Networks , 2013, IEEE Transactions on Control of Network Systems.

[15]  Alexander Olshevsky,et al.  Minimal Controllability Problems , 2013, IEEE Transactions on Control of Network Systems.

[16]  Jie Sun,et al.  Controllability transition and nonlocality in network control. , 2013, Physical review letters.