Decentralized Parameter Estimation by Consensus Based Stochastic Approximation

In this paper, an algorithm for decentralized multi-agent estimation of parameters in linear discrete-time regression models is proposed in the form of a combination of local stochastic approximation algorithms and a global consensus strategy. An analysis of the asymptotic properties of the proposed algorithm is presented, taking into account both the multi-agent network structure and the probabilities of getting local measurements and implementing exchange of inter-agent messages. In the case of non-vanishing gains in the stochastic approximation algorithms, an asymptotic estimation error covariance matrix bound is defined as the solution of a Lyapunov-like matrix equation. In the case of asymptotically vanishing gains, the mean-square convergence is proved and the rate of convergence estimated. In the discussion, the problem of additive communication noise is treated in a methodologically consistent way. It is also demonstrated how the consensus scheme in the algorithm can contribute to the overall reduction of measurement noise influence. Some simulation results illustrate the obtained theoretical results.

[1]  Richard Bellman,et al.  Introduction to Matrix Analysis , 1972 .

[2]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[3]  Purdue Universit.  Stochastic Approximation Methods for Identification and Control-A Survey , 1974 .

[4]  Dragoslav D. Šiljak,et al.  Large-Scale Dynamic Systems: Stability and Structure , 1978 .

[5]  V. Solo.  Stochastic approximation with dependent noise , 1982 .

[6]  V. Borkar,et al.  Asymptotic agreement in distributed estimation , 1982 .

[7]  Michael Athans,et al.  Convergence and asymptotic agreement in distributed decision problems , 1982, 1982 21st IEEE Conference on Decision and Control.

[8]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[9]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[10]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[11]  H. Kushner,et al.  Asymptotic properties of distributed and communication stochastic approximation algorithms , 1987 .

[12]  H. Kushner,et al.  Stochastic approximation algorithms for parallel and distributed processing , 1987 .

[13]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[14]  D. Siljak,et al.  Convergence and stability of distributed stochastic iterative processes , 1990 .

[15]  G. Yin.  Recent progress in parallel stochastic approximations , 1991 .

[16]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[17]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[18]  Eugenius Kaszkurewicz,et al.  Parallel Asynchronous Team Algorithms: Convergence and Performance Analysis , 1996, IEEE Trans. Parallel Distributed Syst..

[19]  Johan Nilsson,et al.  Stochastic Analysis and Control of Real-Time Systems with Random Time Delays , 1996 .

[20]  Johan Nilsson,et al.  Analysis and Design of Real-Time Systems with Random Delays , 1996 .

[21]  T. Wassmer.  6 , 1900, EXILE.

[22]  Satish Kumar,et al.  Next century challenges: scalable coordination in sensor networks , 1999, MobiCom.

[23]  Srdjan S. Stankovic,et al.  Decentralized overlapping control of a platoon of vehicles , 2000, IEEE Trans. Control. Syst. Technol..

[24]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[25]  Richard M. Murray,et al.  INFORMATION FLOW AND COOPERATIVE CONTROL OF VEHICLE FORMATIONS , 2002 .

[26]  Han-Fu Chen.  Stochastic approximation and its applications , 2002 .

[27]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[28]  Philip Ferguson,et al.  Decentralized Estimation Algorithms for Formation Flying Spacecraft , 2003 .

[29]  Michael I. Jordan,et al.  Kalman filtering with intermittent observations , 2003, IEEE Transactions on Automatic Control.

[30]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[31]  G. Orman.  On stochastic approximation methods in genetics , 2004, 26th International Conference on Information Technology Interfaces, 2004..

[32]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[33]  Richard M. Murray,et al.  DISTRIBUTED SENSOR FUSION USING DYNAMIC CONSENSUS , 2005 .

[34]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[35]  Manfredi Maggiore,et al.  Necessary and sufficient graphical conditions for formation control of unicycles , 2005, IEEE Transactions on Automatic Control.

[36]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[37]  R.W. Beard,et al.  Multi-agent Kalman consensus with relative uncertainty , 2005, Proceedings of the 2005, American Control Conference, 2005..

[38]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[39]  Christos G. Cassandras,et al.  Sensor Networks and Cooperative Control , 2005, CDC 2005.

[40]  Han-Fu Chen,et al.  Recursive system identification by stochastic approximation , 2006, Commun. Inf. Syst..

[41]  Han-Fu Chen.  Recursive Identification of Errors-in-Variables Systems , 2006, 2006 Chinese Control Conference.

[42]  J.N. Tsitsiklis,et al.  Convergence Rates in Distributed Consensus and Averaging , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[43]  K.H. Johansson,et al.  Distributed and Collaborative Estimation over Wireless Sensor Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[44]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[45]  Jonathan H. Manton,et al.  Stochastic approximation for consensus seeking: Mean square and almost sure convergence , 2007, 2007 46th IEEE Conference on Decision and Control.

[46]  J.H. Manton,et al.  Stochastic Lyapunov Analysis for Consensus Algorithms with Noisy Measurements , 2007, 2007 American Control Conference.

[47]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[48]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[49]  S.S. Stankovic,et al.  A consensus based overlapping decentralized estimator in lossy networks: Stability and denoising effects , 2008, 2008 American Control Conference.

[50]  Randy A. Freeman,et al.  Multi-Agent Coordination by Decentralized Estimation and Control , 2008, IEEE Transactions on Automatic Control.

[51]  Milos S. Stankovic,et al.  Consensus based overlapping decentralized estimation with missing observations and communication faults , 2009, Autom..

[52]  Milos S. Stankovic,et al.  Consensus Based Overlapping Decentralized Estimator , 2009, IEEE Transactions on Automatic Control.

[53]  Milos S. Stankovic,et al.  Decentralized Parameter Estimation by Consensus Based Stochastic Approximation , 2011, IEEE Trans. Autom. Control..

[54]  Dragoslav D. Šiljak,et al.  Decentralized control of complex systems , 2012 .