Querying Policies Based on Sparse Matrices for Noisy 20 Questions

This paper shows that the error probability of a querying policy for noisy 20 questions is upper bounded by the minimum Hamming distance of its querying matrix. Following this distance principle, sparse querying matrices with the row-column constraint are constructed for the scenarios, where only limited areas can be detected at each querying round. It demonstrates that the row-column constraint promises a large minimum distance to ensure low error probability of queries. Moreover, the proposed sparse matrices with random block coding provide unequal error-protection capability to further improve the querying accuracy under the scenarios of detecting half of the areas. Simulation results verify that the quantized mean squared errors of our proposed policies outperform those of the existing policies under the above scenarios.

[1]  G. D. J. Forney,et al.  On exponential error bounds for random codes on the BSC , 2001 .

[2]  Alfred O. Hero,et al.  Fundamental Limits on Data Acquisition: Trade-offs Between Sample Complexity and Query Difficulty , 2017, 2018 IEEE International Symposium on Information Theory (ISIT).

[3]  Qiuju Diao,et al.  Cyclic and Quasi-Cyclic LDPC Codes on Constrained Parity-Check Matrices and Their Trapping Sets , 2012, IEEE Transactions on Information Theory.

[4]  Ehsan Variani,et al.  NON-adaptive policies for 20 questions target localization , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[5]  Alfred O. Hero,et al.  Collaborative 20 Questions for Target Localization , 2013, IEEE Transactions on Information Theory.

[6]  Pascal Fua,et al.  An Optimal Policy for Target Localization with Application to Electron Microscopy , 2013, ICML.

[7]  Michael Horstein,et al.  Sequential transmission using noiseless feedback , 1963, IEEE Trans. Inf. Theory.

[8]  Shu Lin,et al.  Construction of Quasi-Cyclic LDPC Codes for AWGN and Binary Erasure Channels: A Finite Field Approach , 2007, IEEE Transactions on Information Theory.

[9]  Shu Lin,et al.  Channel Codes: Classical and Modern , 2009 .

[10]  Alfred O. Hero,et al.  Unequal Error Protection Querying Policies for the Noisy 20 Questions Problem , 2016, IEEE Transactions on Information Theory.

[11]  Daniel J. Costello,et al.  Error Control Coding, Second Edition , 2004 .

[12]  Shu Lin,et al.  Construction of low-density parity-check codes by superposition , 2005, IEEE Transactions on Communications.

[13]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[14]  Twenty Questions with Noise: Bayes Optimal Policies for Entropy Loss , 2012, Journal of Applied Probability.

[15]  Evangelos Eleftheriou,et al.  Regular and irregular progressive edge-growth tanner graphs , 2005, IEEE Transactions on Information Theory.