Distributed Estimation From Relative Measurements of Heterogeneous and Uncertain Quality

This paper studies the problem of estimation from relative measurements in a graph, in which a vector indexed over the nodes has to be reconstructed from pairwise measurements of differences between its components associated with nodes connected by an edge. In order to model heterogeneity and uncertainty of the measurements, we assume them to be affected by additive noise distributed according to a Gaussian mixture. In this original setup, we formulate the problem of computing the maximum-likelihood estimates and we design two novel algorithms, based on least squares (LS) regression and expectation maximization (EM). The first algorithm (LS-EM) is centralized and performs the estimation from relative measurements, the soft classification of the measurements, and the estimation of the noise parameters. The second algorithm (Distributed LS-EM) is distributed and performs estimation and soft classification of the measurements, but requires the knowledge of the noise parameters. We provide rigorous proofs of convergence for both algorithms and we present numerical experiments to evaluate their performance and compare it with solutions from the literature. The experiments show the robustness of the proposed methods against different kinds of noise and, for the Distributed LS-EM, against errors in the knowledge of noise parameters.

[1]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[2]  Ruggero Carli,et al.  An Asynchronous Consensus-Based Algorithm for Estimation From Noisy Relative Measurements , 2014, IEEE Transactions on Control of Network Systems.

[3]  João Pedro Hespanha,et al.  Error Scaling Laws for Linear Optimal Estimation From Relative Measurements , 2009, IEEE Transactions on Information Theory.

[4]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[5]  Charles Elkan,et al.  Expectation Maximization Algorithm , 2010, Encyclopedia of Machine Learning.

[6]  Fabio Fagnani,et al.  Distributed Estimation From Relative and Absolute Measurements , 2017, IEEE Transactions on Automatic Control.

[7]  Damiano Varagnolo,et al.  Consensus‐based distributed sensor calibration and least‐square parameter identification in WSNs , 2010 .

[8]  Ruggero Carli,et al.  Multi-robot localization via GPS and relative measurements in the presence of asynchronous and lossy communication , 2016, 2016 European Control Conference (ECC).

[9]  Stanley Osher,et al.  Optimal Data Collection for Improved Rankings Expose Well-Connected Graphs , 2012, ArXiv.

[10]  Chiara Ravazzi,et al.  Distributed randomized algorithms for opinion formation, centrality computation and power systems estimation: A tutorial overview , 2015, Eur. J. Control.

[11]  Nikolaos M. Freris,et al.  Fast distributed smoothing of relative measurements , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[12]  Frank Dellaert,et al.  Selecting good measurements via ℓ1 relaxation: A convex approach for robust estimation over graphs , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Tarek F. Abdelzaher,et al.  Maximum likelihood analysis of conflicting observations in social sensing , 2014, TOSN.

[14]  Yuan Yao,et al.  Statistical ranking and combinatorial Hodge theory , 2008, Math. Program..

[15]  Fabio Fagnani,et al.  Transient and limit performance of distributed relative localization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[16]  Emery N. Brown,et al.  Convergence and Stability of Iteratively Re-weighted Least Squares Algorithms , 2014, IEEE Transactions on Signal Processing.

[17]  Robert D. Nowak,et al.  Distributed EM algorithms for density estimation and clustering in sensor networks , 2003, IEEE Trans. Signal Process..

[18]  Chiara Ravazzi,et al.  Ergodic Randomized Algorithms and Dynamics Over Networks , 2013, IEEE Transactions on Control of Network Systems.

[19]  Enrico Magli,et al.  Gaussian Mixtures Based IRLS for Sparse Recovery With Quadratic Convergence , 2015, IEEE Transactions on Signal Processing.

[20]  W. Steiger,et al.  Least Absolute Deviations: Theory, Applications and Algorithms , 1984 .

[21]  N. Chan On Analysis and Design of Algorithms for Robust Estimation from Relative Measurements , 2016 .

[22]  Alessandro Chiuso,et al.  Gossip Algorithms for Simultaneous Distributed Estimation and Classification in Sensor Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[23]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[24]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[25]  Dong Wang,et al.  Social Sensing: Building Reliable Systems on Unreliable Data , 2015 .

[26]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[27]  Dongbing Gu,et al.  Distributed EM Algorithm for Gaussian Mixtures in Sensor Networks , 2008, IEEE Transactions on Neural Networks.

[28]  Ruggero Carli,et al.  Robust Distributed Estimation for Localization in Lossy Sensor Networks , 2016 .

[29]  Fabio Fagnani,et al.  Introduction to Averaging Dynamics over Networks , 2017 .

[30]  Chiara Ravazzi,et al.  CONSENSUS-LIKE ALGORITHMS FOR ESTIMATION OF GAUSSIAN MIXTURES OVER LARGE SCALE NETWORKS , 2014 .

[31]  Fabio Fagnani,et al.  Limited benefit of cooperation in distributed relative localization , 2013, 52nd IEEE Conference on Decision and Control.

[32]  Georgios B. Giannakis,et al.  Distributed Robust Power System State Estimation , 2012, IEEE Transactions on Power Systems.

[33]  João Pedro Hespanha,et al.  Estimation From Relative Measurements: Electrical Analogy and Large Graphs , 2008, IEEE Transactions on Signal Processing.

[34]  Sophie Fosson,et al.  A Distributed Classification/Estimation Algorithm for Sensor Networks , 2014, SIAM J. Control. Optim..

[35]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[36]  Maya R. Gupta,et al.  Theory and Use of the EM Algorithm , 2011, Found. Trends Signal Process..

[37]  P.R. Kumar,et al.  Distributed Clock Synchronization over Wireless Networks: Algorithms and Analysis , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.