Ieee Transactions on Information Theory 1 Optimal Grouping for Group Minimax Hypothesis Testing

Bayesian hypothesis testing and minimax hypothesis testing represent extreme instances of detection in which the prior probabilities of the hypotheses are either completely and precisely known, or are completely unknown. Group minimax, also known as Gamma -minimax, is a robust intermediary between Bayesian and minimax hypothesis testing that allows for coarse or partial advance knowledge of the hypothesis priors by using information on sets in which the prior lies. Existing work on group minimax, however, does not consider the question of how to define the sets or groups of priors; it is assumed that the groups are given. In this paper, we propose a novel intermediate detection scheme formulated through the quantization of the space of prior probabilities that optimally determines groups and also representative priors within the groups. We show that when viewed from a quantization perspective, group minimax amounts to determining centroids with a minimax Bayes risk error divergence distortion criterion: the appropriate Bregman divergence for this task. In addition, the optimal partitioning of the space of prior probabilities is a Bregman Voronoi diagram. Together, the optimal grouping and representation points are an epsilon -net with respect to Bayes risk error divergence, and permit a rate-distortion type asymptotic analysis of detection performance with the number of groups. Examples of detecting signals corrupted by additive white Gaussian noise and of distinguishing exponentially-distributed signals are presented.

[1]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[2]  A. Kolmogorov,et al.  Entropy and "-capacity of sets in func-tional spaces , 1961 .

[3]  Alexander V. Trushkin Sufficient conditions for uniqueness of a locally optimal quantizer for a class of convex error weighting functions , 1982, IEEE Trans. Inf. Theory.

[4]  H. Vincent Poor,et al.  Noise Enhanced Hypothesis-Testing in the Restricted Bayesian Framework , 2010, IEEE Transactions on Signal Processing.

[5]  Xin Guo,et al.  On the optimality of conditional expectation as a Bregman predictor , 2005, IEEE Trans. Inf. Theory.

[6]  R. Wijsman,et al.  Continuity of the Bayes Risk , 1970 .

[7]  Robert D. Nowak,et al.  Minimax-Optimal Bounds for Detectors Based on Estimated Prior Probabilities , 2011, IEEE Transactions on Information Theory.

[8]  Kush R. Varshney,et al.  Multilevel minimax hypothesis testing , 2011, 2011 IEEE Statistical Signal Processing Workshop (SSP).

[9]  Xiaolin Wu,et al.  Minimax multiresolution scalar quantization , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[10]  S. Graf,et al.  Foundations of Quantization for Probability Distributions , 2000 .

[11]  Judah Rosenblatt,et al.  On Partial a Priori Information in Statistical Inference , 1967 .

[12]  Frank Nielsen,et al.  Fitting the smallest enclosing Bregman balls , 2005 .

[13]  A. Dawid,et al.  Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory , 2004, math/0410076.

[14]  Inderjit S. Dhillon,et al.  Clustering with Bregman Divergences , 2005, J. Mach. Learn. Res..

[15]  Yuriy A. Reznik,et al.  An Algorithm for Quantization of Discrete Probability Distributions , 2011, 2011 Data Compression Conference.

[16]  Kush R. Varshney,et al.  Quantization of Prior Probabilities for Hypothesis Testing , 2022 .

[17]  Fabrizio Ruggeri Gamma-Minimax Inference † , 2006 .

[18]  Frank Nielsen,et al.  Fitting the Smallest Enclosing Bregman Ball , 2005, ECML.

[19]  H. Robbins Asymptotically Subminimax Solutions of Compound Statistical Decision Problems , 1985 .

[20]  R. Sugden,et al.  Regret Theory: An alternative theory of rational choice under uncertainty Review of Economic Studies , 1982 .

[21]  Frank Nielsen,et al.  Bregman Voronoi Diagrams , 2007, Discret. Comput. Geom..

[22]  Martin Vetterli,et al.  Data Compression and Harmonic Analysis , 1998, IEEE Trans. Inf. Theory.

[23]  K. Stolarsky,et al.  Generalizations of the Logarithmic Mean , 1975 .

[24]  P. Walley,et al.  Robust Bayesian credible intervals and prior ignorance , 1991 .

[25]  H. Robbins The Empirical Bayes Approach to Statistical Decision Problems , 1964 .

[26]  J. L. Hodges,et al.  The use of Previous Experience in Reaching Statistical Decisions , 1952 .

[27]  Vivek K. Goyal,et al.  Quantization of Prior Probabilities for Collaborative Distributed Hypothesis Testing , 2011, IEEE Transactions on Signal Processing.

[28]  Russell A. Gordon,et al.  Using Tangent Lines to Define Means , 2003 .

[29]  Yingbo Hua,et al.  Image vector quantization with minimax L∞ distortion , 1999, IEEE Signal Process. Lett..

[30]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[31]  Ananthram Swami,et al.  Minimax Quantization for Distributed Maximum Likelihood Estimation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[32]  Clifford Hildrethi BAYESIAN STATISTICIANS AND REMOTE CLIENTS , 1963 .

[33]  T. Fine,et al.  Bayes-like Decision Making With Upper and Lower Probabilities , 1982 .

[34]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[35]  Kush R. Varshney,et al.  Categorical decision making by people, committees, and crowds , 2011, 2011 Information Theory and Applications Workshop.

[36]  Frank Nielsen,et al.  Hypothesis Testing, Information Divergence and Computational Geometry , 2013, GSI.

[37]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[38]  Richard Nock,et al.  On Bregman Voronoi diagrams , 2007, SODA '07.

[39]  Abdelhak M. Zoubir,et al.  Robust Distributed Detection , 2013, ArXiv.

[40]  B. Vidakovic Γ-Minimax: A Paradigm for Conservative Robust Bayesians , 2000 .

[41]  Vivek K. Goyal,et al.  Conflict in Distributed Hypothesis Testing with Quantized Prior Probabilities , 2011, 2011 Data Compression Conference.

[42]  Kush R. Varshney,et al.  Bayes Risk Error is a Bregman Divergence , 2011, IEEE Transactions on Signal Processing.

[43]  J. Schreiber Foundations Of Statistics , 2016 .

[44]  Yonina C. Eldar,et al.  Linear minimax regret estimation of deterministic parameters with bounded data uncertainties , 2004, IEEE Transactions on Signal Processing.

[45]  Vivek K. Goyal,et al.  Distributed Decision Making by Categorically-Thinking Agents , 2013, Decision Making and Imperfection.