Blind Group Testing

The main goal in group testing is to recover a small subset of defective items from a larger population while efficiently reducing the total number of (possibly noisy) required tests/measurements. Under the assumption that the input-output statistical relationship (i.e., channel law) is known to the recovery algorithm, the fundamental as well as the computational limits of the group testing problem are relatively better understood than when these statistical relationships are unknown. Practical considerations, however, render this assumption inapplicable, and “blind” recovery/estimation procedures, independent of the input-output statistics, are desired. In this paper, we analyze the fundamental limits of a general noisy group testing problem, when this relationship is unknown. Specifically, in the first part of this paper, we propose an efficient scheme, based on the idea of separate-decoding of items (where each item is recovered separately), for which we derive sufficient conditions on the number of tests required for exact recovery. The difficulty in obtaining these conditions stems from the fact that we allow the number of defective items to grow with the population size, which in turn requires delicate concentration analysis of certain probabilities. Furthermore, we show that in several scenarios, our proposed scheme achieves the same performance as that of the corresponding non-blind recovery algorithm (where the input-output statistics are known), implying that the proposed blind scheme is robust/universal. Finally, in the second part of this paper, we propose also an inefficient combinatorial-based scheme (or, “joint-decoding”), for which we derive similar sufficient conditions.

[1]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[2]  Gábor Lugosi,et al.  Concentration Inequalities - A Nonasymptotic Theory of Independence , 2013, Concentration Inequalities.

[3]  R. Vershynin,et al.  One sketch for all: fast algorithms for compressed sensing , 2007, STOC '07.

[4]  Matthew Aldridge,et al.  The capacity of adaptive group testing , 2013, 2013 IEEE International Symposium on Information Theory.

[5]  Matthew Aldridge Adaptive group testing as channel coding with feedback , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[6]  Robert J. Piechocki,et al.  The capacity of non-identical adaptive group testing , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[7]  Peter Damaschke,et al.  Competitive Group Testing and Learning Hidden Vertex Covers with Minimum Adaptivity , 2010, Discret. Math. Algorithms Appl..

[8]  Kannan Ramchandran,et al.  SAFFRON: A fast, efficient, and robust framework for group testing based on sparse-graph codes , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[9]  Michael T. Goodrich,et al.  Improved adaptive group testing algorithms with applications to multiple access channels and dead sensor diagnosis , 2009, J. Comb. Optim..

[10]  Alon Orlitsky,et al.  Estimating the number of defectives with group testing , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[11]  Zoltán Füredi On r-Cover-free Families , 1996, J. Comb. Theory, Ser. A.

[12]  Sidharth Jaggi,et al.  Non-Adaptive Group Testing: Explicit Bounds and Novel Algorithms , 2014, IEEE Trans. Inf. Theory.

[13]  D. Du,et al.  Pooling Designs And Nonadaptive Group Testing: Important Tools For Dna Sequencing , 2006 .

[14]  Matthew Aldridge,et al.  Almost separable matrices , 2017, J. Comb. Optim..

[15]  Volkan Cevher,et al.  Limits on Support Recovery With Probabilistic Models: An Information-Theoretic Framework , 2015, IEEE Transactions on Information Theory.

[16]  A.C. Gilbert,et al.  Group testing and sparse signal recovery , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[17]  Wenhao Huang,et al.  Group testing with prior statistics , 2014, 2014 IEEE International Symposium on Information Theory.

[18]  A. Antos,et al.  Convergence properties of functional estimates for discrete distributions , 2001 .

[19]  Matthew Aldridge,et al.  Group Testing Algorithms: Bounds and Simulations , 2013, IEEE Transactions on Information Theory.

[20]  Dmitry M. Malioutov,et al.  Boolean compressed sensing: LP relaxation for group testing , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Volkan Cevher,et al.  Phase Transitions in Group Testing , 2016, SODA.

[22]  Matthew Aldridge,et al.  Performance of Group Testing Algorithms With Near-Constant Tests Per Item , 2016, IEEE Transactions on Information Theory.

[23]  Sidharth Jaggi,et al.  Novel Impossibility Results for Group-Testing , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[24]  Thijs Laarhoven,et al.  Asymptotics of Fingerprinting and Group Testing: Tight Bounds From Channel Capacities , 2014, IEEE Transactions on Information Forensics and Security.

[25]  M. Malyutov,et al.  Maximization of ESI. Jaynes principle in testing significant inputs of linear model , 1998 .

[26]  Yanjun Han,et al.  Maximum Likelihood Estimation of Functionals of Discrete Distributions , 2014, IEEE Transactions on Information Theory.

[27]  George Atia,et al.  Strong Impossibility Results for Sparse Signal Processing , 2014, IEEE Signal Processing Letters.

[28]  Volkan Cevher,et al.  Efficient and Near-Optimal Noisy Group Testing: An Information-Theoretic Framework , 2017, ArXiv.

[29]  A. Sahai,et al.  Codes to unmask spectrum violators in cognitive radio systems , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[30]  R. Sibson Information radius , 1969 .

[31]  Matthew Aldridge,et al.  The Capacity of Bernoulli Nonadaptive Group Testing , 2015, IEEE Transactions on Information Theory.

[32]  M. Malyutov The separating property of random matrices , 1978 .

[33]  Mary Wootters,et al.  Unconstraining graph-constrained group testing , 2018, APPROX-RANDOM.

[34]  Mayank Bakshi,et al.  GROTESQUE: Noisy Group Testing (Quick and Efficient) , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[35]  Dino Sejdinovic,et al.  Note on noisy group testing: Asymptotic bounds and belief propagation reconstruction , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[36]  Mikhail B. Malyutov,et al.  Search for Sparse Active Inputs: A Review , 2013, Information Theory, Combinatorics, and Search Theory.

[37]  Yanjun Han,et al.  Minimax Estimation of Functionals of Discrete Distributions , 2014, IEEE Transactions on Information Theory.

[38]  Neri Merhav,et al.  Erasure/List Random Coding Error Exponents Are Not Universally Achievable , 2016, IEEE Transactions on Information Theory.

[39]  Chandra R. Murthy,et al.  Computationally Tractable Algorithms for Finding a Subset of Non-Defective Items From a Large Population , 2017, IEEE Transactions on Information Theory.

[40]  Ely Porat,et al.  Pattern matching with don't cares and few errors , 2010, J. Comput. Syst. Sci..

[41]  R. Dorfman The Detection of Defective Members of Large Populations , 1943 .

[42]  Matthew Aldridge On the optimality of some group testing algorithms , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[43]  Matthew Aldridge,et al.  Individual Testing Is Optimal for Nonadaptive Group Testing in the Linear Regime , 2018, IEEE Transactions on Information Theory.

[44]  Arkadii G. D'yachkov,et al.  A survey of superimposed code theory , 1983 .

[45]  George Atia,et al.  Boolean Compressed Sensing and Noisy Group Testing , 2009, IEEE Transactions on Information Theory.

[46]  Antonio Fernández,et al.  Unbounded Contention Resolution in Multiple-Access Channels , 2011, PODC '11.

[47]  Graham Cormode,et al.  What's hot and what's not: tracking most frequent items dynamically , 2003, TODS.

[48]  Venkatesh Saligrama,et al.  Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[49]  A. Sahai,et al.  Spectrum Enforcement and Liability Assignment in Cognitive Radio Systems , 2008, 2008 3rd IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[50]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .