Decentralized Parameter Estimation by Consensus Based Stochastic Approximation

In this paper, an algorithm for decentralized multi-agent estimation of parameters in linear discrete-time regression models is proposed in the form of a combination of local stochastic approximation algorithms and a global consensus strategy. An analysis of the asymptotic properties of the proposed algorithm is presented, taking into account both the multi-agent network structure and the probabilities of getting local measurements and implementing exchange of inter-agent messages. In the case of non-vanishing gains in the stochastic approximation algorithms, an asymptotic estimation error covariance matrix bound is defined as the solution of a Lyapunov-like matrix equation. In the case of asymptotically vanishing gains, the mean-square convergence is proved and the rate of convergence estimated. In the discussion, the problem of additive communication noise is treated in a methodologically consistent way. It is also demonstrated how the consensus scheme in the algorithm can contribute to the overall reduction of measurement noise influence. Some simulation results illustrate the obtained theoretical results.

[1]  Christos G. Cassandras,et al.  Sensor Networks and Cooperative Control , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[2]  Srdjan S. Stankovic,et al.  Decentralized Parameter Estimation by Consensus Based Stochastic Approximation , 2007, IEEE Transactions on Automatic Control.

[3]  R.W. Beard,et al.  Multi-agent Kalman consensus with relative uncertainty , 2005, Proceedings of the 2005, American Control Conference, 2005..

[4]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[5]  G. Saridis.  Stochastic approximation methods for identification and control--A survey , 1974 .

[6]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[7]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[8]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[9]  Milos S. Stankovic,et al.  Consensus Based Overlapping Decentralized Estimator , 2009, IEEE Transactions on Automatic Control.

[10]  V. Borkar,et al.  Asymptotic agreement in distributed estimation , 1982 .

[11]  Richard Bellman,et al.  Introduction to Matrix Analysis , 1972 .

[12]  J.N. Tsitsiklis,et al.  Convergence Rates in Distributed Consensus and Averaging , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[13]  G. Yin.  Recent progress in parallel stochastic approximations , 1991 .

[14]  Björn Wittenmark,et al.  Stochastic Analysis and Control of Real-time Systems with Random Time Delays , 1999 .

[15]  Manfredi Maggiore,et al.  Necessary and sufficient graphical conditions for formation control of unicycles , 2005, IEEE Transactions on Automatic Control.

[16]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[17]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[18]  Philip Ferguson,et al.  Decentralized Estimation Algorithms for Formation Flying Spacecraft , 2003 .

[19]  Han-Fu Chen.  Stochastic approximation and its applications , 2002 .

[20]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[21]  S.S. Stankovic,et al.  A consensus based overlapping decentralized estimator in lossy networks: Stability and denoising effects , 2008, 2008 American Control Conference.

[22]  Randy A. Freeman,et al.  Multi-Agent Coordination by Decentralized Estimation and Control , 2008, IEEE Transactions on Automatic Control.

[23]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[24]  John N. Tsitsiklis,et al.  Convergence and asymptotic agreement in distributed decision problems , 1982 .

[25]  Johan Nilsson,et al.  Analysis and Design of Real-Time Systems with Random Delays , 1996 .

[26]  Han-Fu Chen,et al.  Recursive system identification by stochastic approximation , 2006, Commun. Inf. Syst..

[27]  Han-Fu Chen,et al.  Recursive identification for multivariate errors-in-variables systems , 2007, Autom..

[28]  Eugenius Kaszkurewicz,et al.  Parallel Asynchronous Team Algorithms: Convergence and Performance Analysis , 1996, IEEE Trans. Parallel Distributed Syst..

[29]  Dragoslav D. Šiljak,et al.  Large-Scale Dynamic Systems: Stability and Structure , 1978 .

[30]  H. Kushner,et al.  Stochastic approximation algorithms for parallel and distributed processing , 1987 .

[31]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[32]  V. Solo.  Stochastic approximation with dependent noise , 1982 .

[33]  Satish Kumar,et al.  Next century challenges: scalable coordination in sensor networks , 1999, MobiCom.

[34]  Jonathan H. Manton,et al.  Stochastic approximation for consensus seeking: Mean square and almost sure convergence , 2007, 2007 46th IEEE Conference on Decision and Control.

[35]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[36]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[37]  Milos S. Stankovic,et al.  Consensus based overlapping decentralized estimation with missing observations and communication faults , 2009, Autom..

[38]  K. Chung.  On a Stochastic Approximation Method , 1954 .

[39]  J.H. Manton,et al.  Stochastic Lyapunov Analysis for Consensus Algorithms with Noisy Measurements , 2007, 2007 American Control Conference.

[40]  H. Kushner,et al.  Asymptotic properties of distributed and communication stochastic approximation algorithms , 1987 .

[41]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[42]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[43]  John N. Tsitsiklis,et al.  Distributed asynchronous deterministic and stochastic gradient optimization algorithms , 1986 .

[44]  K.H. Johansson,et al.  Distributed and Collaborative Estimation over Wireless Sensor Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[45]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[46]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[47]  Dragoslav D. Šiljak,et al.  Decentralized control of complex systems , 2012 .

[48]  D. Siljak,et al.  Convergence and stability of distributed stochastic iterative processes , 1990 .

[49]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[50]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..