On connectivity, observability, and stability in distributed estimation

We introduce a new model of social learning and distributed estimation in which the state to be estimated is governed by a potentially unstable linear model driven by noise. The state is observed by a network of agents, each with its own linear noisy observation models. We assume the state to be globally observable, but no agent is able to estimate the state with its own observations alone. We propose a single consensus-step estimator that consists of an innovation step and a consensus step, both performed at the same time-step. We show that if the instability of the dynamics is strictly less than the Network Tracking Capacity (NTC), a function of network connectivity and the observation matrices, the single consensus-step estimator results in a bounded estimation error. We further quantify the trade-off between: (i) (in)stability of the parameter dynamics, (ii) connectivity of the underlying network, and (iii) the observation structure, in the context of single timescale algorithms. This contrasts with prior work on distributed estimation that either assumes scalar dynamics (which removes local observability issues) or assumes that enough iterates can be carried out for the consensus to converge between each innovation (observation) update.

[1]  Michael G. Safonov A course in robust control theory: a convex approach [Book Reviews] , 2001, IEEE Transactions on Automatic Control.

[2]  Randy A. Freeman,et al.  Multi-Agent Coordination by Decentralized Estimation and Control , 2008, IEEE Transactions on Automatic Control.

[3]  Roy S. Smith,et al.  Closed-Loop Dynamics of Cooperative Vehicle Formations With Parallel Estimators and Communication , 2007, IEEE Transactions on Automatic Control.

[4]  R. Olfati-Saber,et al.  Distributed Kalman Filter with Embedded Consensus Filters , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[5]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[6]  José M. F. Moura,et al.  Distributing the Kalman Filter for Large-Scale Systems , 2007, IEEE Transactions on Signal Processing.

[7]  Stergios I. Roumeliotis,et al.  Decentralized Quantized Kalman Filtering With Scalable Communication Cost , 2008, IEEE Transactions on Signal Processing.

[8]  E. Yaz Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[9]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[10]  Ruggero Carli,et al.  Distributed Kalman filtering using consensus strategies , 2007, 2007 46th IEEE Conference on Decision and Control.

[11]  Asuman E. Ozdaglar,et al.  Convergence of rule-of-thumb learning rules in social networks , 2008, 2008 47th IEEE Conference on Decision and Control.

[12]  Béla Bollobás,et al.  Modern Graph Theory , 2002, Graduate Texts in Mathematics.

[13]  Ali Jadbabaie,et al.  Non-Bayesian Social Learning , 2011, Games Econ. Behav..

[14]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[15]  J. A. Fax,et al.  Graph Laplacians and Stabilization of Vehicle Formations , 2002 .

[16]  Reza Olfati-Saber,et al.  Kalman-Consensus Filter : Optimality, stability, and performance , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[17]  Ilse C. F. Ipsen,et al.  Refined Perturbation Bounds for Eigenvalues of Hermitian and Non-Hermitian Matrices , 2009, SIAM J. Matrix Anal. Appl..

[18]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[19]  J. Doyle,et al.  Essentials of Robust Control , 1997 .

[20]  G. Dullerud,et al.  A Course in Robust Control Theory: A Convex Approach , 2005 .