Sequential estimation of distributed parameters in networks

The problem of estimating a set of unknown parameters in a multi-agent network is considered. Each agent can make noisy observations from a subset of the unknown parameters, and different agents can potentially observe common parameters. The objective of each agent is to estimate its observed unknown parameters. This paper focuses on sequentially estimating the parameters such that, in the quickest fashion, all the agents form reliable estimates for their designated parameters. A proper estimation cost function is adopted in order to signify the fidelity of the estimates to the ground truth, and to ensure consistency in the estimates of different agents. By imposing practical constraints on the number of data points that the network affords to process, the sequential strategy dynamically decides about the minimum number of measurements required to form reliable estimates, the agents from which these measurements should be collected, and the optimal estimators for each agent. Specifically, a sequential strategy is proposed, which consists of the stopping rule of the sampling process, a data-adaptive control policy for selecting the agents over time, and a set of estimators, combination of which admits asymptotic optimality.

[1]  Julio Saez-Rodriguez,et al.  Network topology and parameter estimation: from experimental design methods to gene regulatory network kinetics using a community based approach , 2014, BMC Systems Biology.

[2]  Kamiar Rahnama Rad,et al.  Distributed parameter estimation in networks , 2010, 49th IEEE Conference on Decision and Control (CDC).

[3]  Georgios Fellouris Asymptotically optimal parameter estimation under communication constraints , 2011, 1102.0369.

[4]  Pradeep Shenoy,et al.  Rational Decision-Making in Inhibitory Control , 2011, Front. Hum. Neurosci..

[5]  Victor J. Yohai,et al.  Asymptotically Optimal Bayes Sequential Design of Experiments for Estimation , 1973 .

[6]  Jonathan M. Garibaldi,et al.  Parameter Estimation Using Metaheuristics in Systems Biology: A Comprehensive Review , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[7]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.

[8]  George V. Moustakides,et al.  Sequential Joint Detection and Estimation , 2013, 1302.6058.

[9]  George Atia,et al.  Controlled Sensing for Multihypothesis Testing , 2012, IEEE Transactions on Automatic Control.

[10]  Robert D. Nowak,et al.  The Geometry of Generalized Binary Search , 2009, IEEE Transactions on Information Theory.

[11]  George Atia,et al.  Asymptotic optimality results for controlled sequential estimation , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[12]  Ali H. Sayed,et al.  Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation Over Adaptive Networks , 2012, IEEE Transactions on Signal Processing.

[13]  H. Vincent Poor,et al.  Quickest detection of Markov networks , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[14]  Sirin Nitinawarat,et al.  Controlled Sensing for Sequential Multihypothesis Testing with Controlled Markovian Observations and Non-Uniform Control Cost , 2013 .

[15]  Bradley P. Carlin,et al.  Bayesian Adaptive Methods for Clinical Trials , 2010 .

[16]  P. Grambsch Sequential Sampling Based on the Observed Fisher Information to Guarantee The Accuracy of the Maximum Likelihood Estimator , 1983 .

[17]  George K. Atia,et al.  A Controlled Sensing Approach to Graph Classification , 2014, IEEE Trans. Signal Process..

[18]  Alfred O. Hero,et al.  Sensor Management: Past, Present, and Future , 2011, IEEE Sensors Journal.

[19]  Jeremy L. Muhlich,et al.  Properties of cell death models calibrated and compared using Bayesian approaches , 2013, Molecular systems biology.

[20]  Shahin Shahrampour,et al.  Exponentially fast parameter estimation in networks using distributed dual averaging , 2013, 52nd IEEE Conference on Decision and Control.

[21]  Ali Tajer Diversified parameter estimation in complex networks , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[22]  H. Poor,et al.  Fully Distributed State Estimation for Wide-Area Monitoring Systems , 2012, IEEE Transactions on Smart Grid.

[23]  Xiaodong Wang,et al.  Joint Detection and Estimation: Optimum Tests and Applications , 2011, IEEE Transactions on Information Theory.

[24]  Geoffrey A. Hollinger,et al.  Active planning for underwater inspection and the benefit of adaptivity , 2012, Int. J. Robotics Res..

[25]  P. Bickel,et al.  Asymptotically pointwise optimal procedures in sequential analysis , 1967 .

[26]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[27]  Yajun Mei,et al.  Sequential estimation based on conditional cost , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[28]  A. Dasgupta Asymptotic Theory of Statistics and Probability , 2008 .

[29]  Matthew O. Jackson,et al.  Naïve Learning in Social Networks and the Wisdom of Crowds , 2010 .

[30]  George Atia,et al.  Controlled sensing for sequential multihypothesis testing , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.