Decentralized sequential decision making with asynchronous communication

Decentralized sequential decision making with asynchronous communication Georgios Fellouris We consider three statistical problems – hypothesis testing, change detection and parameter estimation– when the relevant information is acquired sequentially by remote sensors; all sensors transmit quantized versions of their observations to a central processor, which is called fusion center and is responsible for making the final decision. Under this decentralized setup, the challenge is to choose a quantization rule at the sensors and a fusion center policy that will rely only on the transmitted quantized messages. We suggest that the sensors transmit messages at stopping times of their observed filtrations, inducing in that way asynchronous communication between sensors and fusion center. Based on such communication schemes, we propose fusion center policies that mimic the corresponding optimal centralized policies. We prove that the resulting decentralized schemes are asymptotically optimal under different statistical models for the observations. These asymptotic optimality properties require moderate, or even rare, communication between sensors and fusion center, which is a very desirable characteristic in applications.

[1]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[2]  Albert N. Shiryaev,et al.  Optimal Stopping Rules , 1980, International Encyclopedia of Statistical Science.

[3]  Subhrakanti Dey,et al.  Dynamic Quantizer Design for Hidden Markov State Estimation Via Multiple Sensors With Fusion Center Feedback , 2006, IEEE Transactions on Signal Processing.

[4]  Maben Rabi,et al.  Packet based Inference and Control , 2006 .

[5]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[6]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[7]  H. Vincent Poor,et al.  Decentralized Sequential Detection with a Fusion Center Performing the Sequential Test , 1992 .

[8]  D. Siegmund Sequential Analysis: Tests and Confidence Intervals , 1985 .

[9]  Y. Kutoyants Statistical Inference for Ergodic Diffusion Processes , 2004 .

[10]  Venugopal V. Veeravalli Comments on "Decentralized sequential detection , 1992 .

[11]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[12]  W. Shewhart The Economic Control of Quality of Manufactured Product. , 1932 .

[13]  Alejandro Ribeiro,et al.  Bandwidth-constrained distributed estimation for wireless sensor networks-part II: unknown probability density function , 2006, IEEE Transactions on Signal Processing.

[14]  N. Schmitz,et al.  On the optimality of the sprt for processes with continuous time parameter , 1984 .

[15]  John S. Baras,et al.  Adaptive Sampling for Linear State Estimation , 2009, SIAM J. Control. Optim..

[16]  Yongguo Mei,et al.  Information bounds and quickest change detection in decentralized decision systems , 2005, IEEE Transactions on Information Theory.

[17]  Ishwar V. Basawa Statistical inference for stochastic processes , 1980 .

[18]  Subhrakanti Dey,et al.  A Constrained MDP Approach to Dynamic Quantizer Design for HMM State Estimation , 2009, IEEE Transactions on Signal Processing.

[19]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[20]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[21]  George V. Moustakides,et al.  Asymptotically optimum tests for decentralized sequential testing in continuous time , 2008, 2008 11th International Conference on Information Fusion.

[22]  G. Moustakides SEQUENTIAL CHANGE DETECTION REVISITED , 2008, 0804.0741.

[23]  Zhi-Quan Luo An isotropic universal decentralized estimation scheme for a bandwidth constrained ad hoc sensor network , 2005, IEEE Journal on Selected Areas in Communications.

[24]  Robert R. Tenney,et al.  Detection with distributed sensors , 1980 .

[25]  Subhrakanti Dey,et al.  Dynamic Quantization for Multisensor Estimation Over Bandlimited Fading Channels , 2007, IEEE Transactions on Signal Processing.

[26]  B. K. Ghosh,et al.  Handbook of sequential analysis , 1991 .

[27]  George V. Moustakides Quickest Detection of Abrupt Changes for a Class of Random Processes , 1998, IEEE Trans. Inf. Theory.

[28]  Pramod K. Varshney,et al.  SEQUENTIAL APPROACH TO ASYNCHRONOUS DECISION FUSION , 1996 .

[29]  P. Varshney,et al.  A simple multi-sensor sequential detection procedure , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[30]  T. Lai SEQUENTIAL ANALYSIS: SOME CLASSICAL PROBLEMS AND NEW CHALLENGES , 2001 .

[31]  A. Irle Extended Optimality of Sequential Probability Ratio Tests , 1984 .

[32]  George V. Moustakides,et al.  Decentralized CUSUM Change Detection , 2006, 2006 9th International Conference on Information Fusion.

[33]  D. Hawkins,et al.  Cumulative Sum Charts and Charting for Quality Improvement , 1998, Statistics for Engineering and Physical Science.

[35]  T. Lai Likelihood Ratio Identities and Their Applications to Sequential Analysis , 2004 .

[36]  J. Tsitsiklis On threshold rules in decentralized detection , 1986, 1986 25th IEEE Conference on Decision and Control.

[37]  Venugopal V. Veeravalli,et al.  Sequential decision fusion: theory and applications , 1999 .

[38]  A. Shiryayev,et al.  Statistics of Random Processes Ii: Applications , 2000 .

[39]  G. Lorden On Excess Over the Boundary , 1970 .

[40]  J. Tsitsiklis Decentralized Detection' , 1993 .

[41]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[42]  K. Åström,et al.  Comparison of Riemann and Lebesgue sampling for first order stochastic systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[43]  A. M. Hussain,et al.  Multisensor distributed sequential detection , 1994 .

[44]  George V. Moustakides,et al.  Optimality of the CUSUM procedure in continuous time , 2003 .

[45]  A. Shiryaev,et al.  Sequential testing problems for Poisson processes , 2000 .

[46]  George V. Moustakides,et al.  Asymptotically optimum tests for decentralized change detection , 2008 .

[47]  William H. Woodall,et al.  The State of Statistical Process Control as We Proceed into the 21st Century , 2000 .

[48]  Y. Ritov Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[49]  Hongjoong Kim,et al.  Performance of Certain Decentralized Distributed Change Detection Procedures , 2006, 2006 9th International Conference on Information Fusion.

[50]  Venugopal V. Veeravalli,et al.  An efficient sequential procedure for detecting changes in multichannel and distributed systems , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[51]  Yajun Mei Asymptotic Optimality Theory for Decentralized Sequential Hypothesis Testing in Sensor Networks , 2008, IEEE Transactions on Information Theory.

[52]  Prakasa Rao Statistical inference for diffusion type processes , 1999 .

[53]  George V. Moustakides,et al.  Decentralized Sequential Hypothesis Testing Using Asynchronous Communication , 2009, IEEE Transactions on Information Theory.

[54]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .