Stability and Identification of Random Asynchronous Linear Time-Invariant Systems

In many computational tasks and dynamical systems, asynchrony and randomization are naturally present and have been considered as ways to increase the speed and reduce the cost of computation while compromising the accuracy and convergence rate. In this work, we show the additional benefits of randomization and asynchrony on the stability of linear dynamical systems. We introduce a natural model for random asynchronous linear time-invariant (LTI) systems which generalizes the standard (synchronous) LTI systems. In this model, each state variable is updated randomly and asynchronously with some probability according to the underlying system dynamics. We examine how the mean-square stability of random asynchronous LTI systems vary with respect to randomization and asynchrony. Surprisingly, we show that the stability of random asynchronous LTI systems does not imply or is not implied by the stability of the synchronous variant of the system and an unstable synchronous system can be stabilized via randomization and/or asynchrony. We further study a special case of the introduced model, namely randomized LTI systems, where each state element is updated randomly with some fixed but unknown probability. We consider the problem of system identification of unknown randomized LTI systems using the precise characterization of mean-square stability via extended Lyapunov equation. For unknown randomized LTI systems, we propose a systematic identification method to recover the underlying dynamics. Given a single input/output trajectory, our method estimates the model parameters that govern the system dynamics, the update probability of state variables, and the noise covariance using the correlation matrices of collected data and the extended Lyapunov equation. Finally, we empirically demonstrate that the proposed method consistently recovers the underlying system dynamics with the optimal rate.

[1]  Lixian Zhang,et al.  Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities , 2009, Autom..

[2]  Ming Yan,et al.  ARock: an Algorithmic Framework for Asynchronous Parallel Coordinate Updates , 2015, SIAM J. Sci. Comput..

[3]  W. Singer,et al.  Neural Synchrony in Brain Disorders: Relevance for Cognitive Dysfunctions and Pathophysiology , 2006, Neuron.

[4]  Chin-Tzong Pang,et al.  On the Convergence to Zero of Infinite Products of Interval Matrices , 2003, SIAM J. Matrix Anal. Appl..

[5]  P König,et al.  Synchronization of oscillatory neuronal responses between striate and extrastriate visual cortical areas of the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Munther A. Dahleh,et al.  Nonparametric System identification of Stochastic Switched Linear Systems , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[7]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[8]  Haim Avron,et al.  Revisiting Asynchronous Linear Solvers: Provable Convergence Rate through Randomization , 2013, 2014 IEEE 28th International Parallel and Distributed Processing Symposium.

[9]  Biao Huang,et al.  A new method for stabilization of networked control systems with random delays , 2005, Proceedings of the 2005, American Control Conference, 2005..

[10]  Hai Lin,et al.  Switched Linear Systems: Control and Design , 2006, IEEE Transactions on Automatic Control.

[11]  Palghat P. Vaidyanathan,et al.  Random Node-Asynchronous Updates on Graphs , 2019, IEEE Transactions on Signal Processing.

[12]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[13]  Babak Hassibi,et al.  Logarithmic Regret Bound in Partially Observable Linear Dynamical Systems , 2020, NeurIPS.

[14]  Oguzhan Teke.  Signals on Networks: Random Asynchronous and Multirate Processing, and Uncertainty Principles , 2020 .

[15]  W. Singer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Neural Synchrony in Cortical Networks: History, Concept and Current Status , 2022 .

[16]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[17]  H. Scheich,et al.  Stimulus-related gamma oscillations in primate auditory cortex. , 2002, Journal of neurophysiology.

[18]  L. Elsner,et al.  Convergence of infinite products of matrices and inner-outer iteration schemes , 1994 .

[19]  Constantino M. Lagoa,et al.  Set membership identification of switched linear systems with known number of subsystems , 2015, Autom..

[20]  George J. Pappas,et al.  Flocking in Fixed and Switching Networks , 2007, IEEE Transactions on Automatic Control.

[21]  Gérard M. Baudet,et al.  Asynchronous Iterative Methods for Multiprocessors , 1978, JACM.

[22]  D. J. Hartfiel.  On Infinite Products of Nonnegative Matrices , 1974 .

[23]  Gérard Bloch,et al.  Hybrid System Identification: Theory and Algorithms for Learning Switching Models , 2019 .

[24]  V. Müller.  On the joint spectral radius , 1997 .

[25]  Suresh Jagannathan,et al.  Asynchronous Algorithms in MapReduce , 2010, 2010 IEEE International Conference on Cluster Computing.

[26]  Charalambos D. Aliprantis,et al.  Positive Operators , 2006 .

[27]  Lennart Ljung,et al.  Subspace identification from closed loop data , 1996, Signal Process..

[28]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[29]  Sandro Zampieri,et al.  Randomized consensus algorithms over large scale networks , 2007, 2007 Information Theory and Applications Workshop.