Fast distributed estimation of empirical mass functions over anonymous networks

The aggregation and estimation of values over networks is fundamental for distributed applications, such as wireless sensor networks. Estimating the average, minimal and maximal values has already been extensively studied in the literature. In this paper, we focus on estimating empirical distributions of values in a network with anonymous agents. In particular, we compare two different estimation strategies in terms of their convergence speed, accuracy and communication costs. The first strategy is deterministic and based on the average consensus protocol, while the second strategy is probabilistic and based on the max consensus protocol.

[1]  Hua Chen,et al.  Distributed Density Estimation Using Non-parametric Statistics , 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07).

[2]  Sandro Zampieri,et al.  Randomized consensus algorithms over large scale networks , 2007, 2007 Information Theory and Applications Workshop.

[3]  Divyakant Agrawal,et al.  Medians and beyond: new aggregation techniques for sensor networks , 2004, SenSys '04.

[4]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[5]  Raquel Menezes,et al.  Extrema Propagation: Fast Distributed Estimation of Sums and Network Sizes , 2012, IEEE Transactions on Parallel and Distributed Systems.

[6]  H. N. Nagaraja,et al.  Order Statistics, Third Edition , 2005, Wiley Series in Probability and Statistics.

[7]  Viktor Witkovský,et al.  Computing the Distribution of a Linear Combination of Inverted Gamma Variables , 2001, Kybernetika.

[8]  Anne-Marie Kermarrec,et al.  Peer counting and sampling in overlay networks: random walk methods , 2006, PODC '06.

[9]  Michael I. Jordan,et al.  Nonparametric decentralized detection using kernel methods , 2005, IEEE Transactions on Signal Processing.

[10]  Ling Shi,et al.  Decentralised minimal-time consensus , 2011, IEEE Conference on Decision and Control and European Control Conference.

[11]  Damiano Varagnolo,et al.  Distributed statistical estimation of the number of nodes in sensor networks , 2010, 49th IEEE Conference on Decision and Control (CDC).

[12]  Robert D. Nowak,et al.  Distributed EM algorithms for density estimation and clustering in sensor networks , 2003, IEEE Trans. Signal Process..

[13]  Wojciech Szpankowski,et al.  Two-phase cardinality estimation protocols for sensor networks with provable precision , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[14]  Paulo Sérgio Almeida,et al.  Spectra: Robust Estimation of Distribution Functions in Networks , 2012, DAIS.

[15]  Sanjeev Khanna,et al.  Power-conserving computation of order-statistics over sensor networks , 2004, PODS.

[16]  Robert L. Wolpert,et al.  Statistical Inference , 2019, Encyclopedia of Social Network Analysis and Mining.

[17]  Matthias Klusch,et al.  Distributed Clustering Based on Sampling Local Density Estimates , 2003, IJCAI.

[18]  Karl Henrik Johansson,et al.  Distributed size estimation of dynamic anonymous networks , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[19]  Ruggero Carli,et al.  Gossip consensus algorithms via quantized communication , 2009, Autom..

[20]  Shudong Jin,et al.  Scalable and Robust Aggregation Techniques for Extracting Statistical Information in Sensor Networks , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[21]  T. C. Aysal,et al.  Accelerated Distributed Average Consensus via Localized Node State Prediction , 2009, IEEE Transactions on Signal Processing.

[22]  Robbert van Renesse,et al.  Gossip-based distribution estimation in peer-to-peer networks , 2008, IPTPS.

[23]  Lei Yu,et al.  Bernoulli sampling based (ε, δ)-approximate aggregation in large-scale sensor networks , 2010, INFOCOM 2010.

[24]  Jorge C. S. Cardoso,et al.  Probabilistic Estimation of Network Size and Diameter , 2009, 2009 Fourth Latin-American Symposium on Dependable Computing.

[25]  Kiyohito Yoshihara,et al.  DAG based in-network aggregation for sensor network monitoring , 2006, International Symposium on Applications and the Internet (SAINT'06).

[26]  Georgios B. Giannakis,et al.  Consensus-based distributed expectation-maximization algorithm for density estimation and classification using wireless sensor networks , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Karl Henrik Johansson,et al.  Distributed Estimation of Diameter, Radius and Eccentricities in Anonymous Networks , 2012 .

[28]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[29]  Guillaume Pierre,et al.  Adam2: Reliable Distribution Estimation in Decentralised Environments , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[30]  Nikos A. Vlassis,et al.  Gossip-Based Greedy Gaussian Mixture Learning , 2005, Panhellenic Conference on Informatics.