On a consistent procedure for distributed recursive nonlinear least-squares estimation

This paper studies recursive nonlinear least squares parameter estimation in inference networks with observations distributed across multiple agents and sensed sequentially over time. Conforming to a given inter-agent communication or interaction topology, distributed recursive estimators of the consensus + innovations type are presented in which at every observation sampling epoch the network agents exchange a single round of messages with their communication neighbors and recursively update their local parameter estimates by simultaneously processing the received neighborhood data and the new information (innovation) embedded in the observation sample. Under rather weak conditions on the connectivity of the inter-agent communication and a global observability criterion, it is shown that the proposed algorithms lead to consistent parameter estimates at each agent. Furthermore, under standard smoothness assumptions on the sensing nonlinearities, the distributed estimators are shown to yield order-optimal convergence rates, i.e., as far as the order of pathwise convergence is concerned, the local agent estimates are as good as the optimal centralized nonlinear least squares estimator having access to the entire network observation data at all times.

[1]  V. Fabian On Asymptotically Efficient Recursive Estimation , 1978 .

[2]  Soummya Kar,et al.  Asymptotically Efficient Distributed Estimation With Exponential Family Statistics , 2013, IEEE Transactions on Information Theory.

[3]  Soummya Kar,et al.  Consensus + innovations distributed inference over networks: cooperation and sensing in networked systems , 2013, IEEE Signal Processing Magazine.

[4]  H. Vincent Poor,et al.  Distributed detection in noisy sensor networks , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[5]  Soummya Kar,et al.  Distributed Parameter Estimation in Sensor Networks: Nonlinear Observation Models and Imperfect Communication , 2008, IEEE Transactions on Information Theory.

[6]  R. Jennrich Asymptotic Properties of Non-Linear Least Squares Estimators , 1969 .

[7]  D. Sakrison Efficient recursive estimation; application to estimating the parameters of a covariance function , 1965 .

[8]  Ioannis D. Schizas,et al.  Stability analysis of the consensus-based distributed LMS algorithm , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..

[10]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[11]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[12]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[13]  Angelia Nedic,et al.  Distributed and Recursive Parameter Estimation in Parametrized Linear State-Space Models , 2008, IEEE Transactions on Automatic Control.

[14]  Soummya Kar,et al.  Convergence Rate Analysis of Distributed Gossip (Linear Parameter) Estimation: Fundamental Limits and Tradeoffs , 2010, IEEE Journal of Selected Topics in Signal Processing.

[15]  H. Vincent Poor,et al.  QD-Learning: A Collaborative Distributed Strategy for Multi-Agent Reinforcement Learning Through Consensus + Innovations , 2012, IEEE Trans. Signal Process..

[16]  José M. F. Moura,et al.  Distributed Detection via Gaussian Running Consensus: Large Deviations Asymptotic Analysis , 2011, IEEE Transactions on Signal Processing.

[17]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[18]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[19]  José M. F. Moura,et al.  Distributed Detection Over Noisy Networks: Large Deviations Analysis , 2011, IEEE Transactions on Signal Processing.

[20]  Srdjan S. Stankovic,et al.  Decentralized Parameter Estimation by Consensus Based Stochastic Approximation , 2007, IEEE Transactions on Automatic Control.

[21]  John N. Tsitsiklis,et al.  Convergence theories of distributed iterative processes: A survey , 1986 .

[22]  C. J. Stone,et al.  Adaptive Maximum Likelihood Estimators of a Location Parameter , 1975 .

[23]  H. Vincent Poor,et al.  Bandit problems in networks: Asymptotically efficient distributed allocation rules , 2011, IEEE Conference on Decision and Control and European Control Conference.

[24]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[25]  H. Vincent Poor,et al.  Distributed Linear Parameter Estimation: Asymptotically Efficient Adaptive Strategies , 2011, SIAM J. Control. Optim..

[26]  H. Kushner,et al.  Asymptotic properties of distributed and communication stochastic approximation algorithms , 1987 .

[27]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..