Quickest search over multiple sequences with mixed observations

The problem of sequentially finding an independent and identically distributed (i.i.d.) sequence that is drawn from a probability distribution F1 by searching over multiple sequences, some of which are drawn from F1 and the others of which are drawn from a different distribution F0, is considered. The sensor is allowed to take one observation at a time. It has been shown in a recent work that if each observation comes from one sequence, Cumulative Sum (CUSUM) test is optimal. In this paper, we propose a new approach in which each observation can be a linear combination of samples from multiple sequences. The test has two stages. In the first stage, namely scanning stage, one takes a linear combination of a pair of sequences with the hope of scanning through sequences that are unlikely to be generated from F1 and quickly identifying a pair of sequences such that at least one of them is highly likely to be generated by F1. In the second stage, namely refinement stage, one examines the pair identified from the first stage more closely and picks one sequence to be the final sequence. The problem under this setup belongs to a class of multiple stopping time problems. In particular, it is an ordered two concatenated Markov stopping time problem. We obtain the optimal solution using the tools from the multiple stopping time theory. Numerical simulation results show that this search strategy can significantly reduce the searching time, especially when F1 is rare.

[1]  Marie-Claire Quenez,et al.  Optimal multiple stopping time problem , 2009, 0910.2788.

[2]  Matthew Malloy,et al.  The Sample Complexity of Search Over Multiple Populations , 2012, IEEE Transactions on Information Theory.

[3]  Taposh Banerjee,et al.  Data-Efficient Quickest Change Detection in Minimax Settings , 2013, IEEE Transactions on Information Theory.

[4]  D. Siegmund Sequential Analysis: Tests and Confidence Intervals , 1985 .

[5]  H. Vincent Poor,et al.  Quick search for rare events through adaptive group sampling , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[6]  V. I. Lotov On some boundary crossing problems for Gaussian random walks , 1996 .

[7]  D. Siegmund Corrected diffusion approximations in certain random walk problems , 1979, Advances in Applied Probability.

[8]  H. Vincent Poor,et al.  Hypothesis testing for partial sparse recovery , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[9]  R. Carmona,et al.  OPTIMAL MULTIPLE STOPPING AND VALUATION OF SWING OPTIONS , 2008 .

[10]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[11]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[12]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[13]  Yuval Peres,et al.  Ladder heights, Gaussian random walks and the Riemann zeta function , 1997 .

[14]  H. Vincent Poor,et al.  Cognitive Radio: How to Maximally Utilize Spectrum Opportunities in Sequential Sensing , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[15]  Huaiyu Dai,et al.  Quickest spectrum sensing in cognitive radio , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[16]  A. Sterrett On the Detection of Defective Members of Large Populations , 1957 .

[17]  René Carmona,et al.  Optimal Multiple Stopping of Linear Diffusions , 2008, Math. Oper. Res..

[18]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[19]  Albrecht Irle,et al.  Optimal Multiple Stopping with Random Waiting Times , 2012, 1205.1966.

[20]  H. Vincent Poor,et al.  Quickest Search Over Multiple Sequences , 2011, IEEE Transactions on Information Theory.

[21]  Erhan Bayraktar,et al.  Quickest search over Brownian channels , 2012, ArXiv.