A mixed time-scale algorithm for distributed parameter estimation : Nonlinear observation models and imperfect communication

The paper considers the algorithm NLU for distributed (vector) parameter estimation in sensor networks, where, the local observation models are nonlinear, and inter-sensor communication is imperfect, in the sense, that the network links fail randomly and inter-sensor transmission is quantized. The paper introduces the class of separably estimable observation models, which generalizes the notion of observability in centralized linear estimation to distributed nonlinear estimation. We show that the NLU algorithm leads to consistent and asymptotically unbiased estimates of the parameter at each sensor for separably estimable observation models. In other words, the sensors reach consensus almost sure (a.s.) to the true parameter value. The algorithm NLU is a mixed time scale stochastic algorithm, characterized by two different decreasing weight sequences associated with the consensus and innovation updates. The analysis of the NLU algorithm, thus, does not follow under the purview of standard stochastic approximation, making the analysis developed in the paper of independent theoretical interest.

[1]  Angelia Nedic,et al.  Distributed and Recursive Parameter Estimation in Parametrized Linear State-Space Models , 2008, IEEE Transactions on Automatic Control.

[2]  Srdjan S. Stankovic,et al.  Decentralized Parameter Estimation by Consensus Based Stochastic Approximation , 2007, IEEE Transactions on Automatic Control.

[3]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks: Quantized Data and Random Link Failures , 2007, IEEE Transactions on Signal Processing.

[4]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[5]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[6]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[7]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[8]  Ioannis D. Schizas,et al.  Stability analysis of the consensus-based distributed LMS algorithm , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  L. Schuchman Dither Signals and Their Effect on Quantization Noise , 1964 .

[10]  John Vanderkooy,et al.  Quantization and Dither: A Theoretical Survey , 1992 .