Extrinsic Jensen-Shannon divergence with application in active hypothesis testing

Consider a decision maker who is responsible to dynamically collect observations so as to enhance his information in a speedy manner about an underlying phenomena of interest while accounting for the penalty of wrong declarations. In this paper, Extrinsic Jensen-Shannon (EJS) divergence is introduced as a measure of information. Using EJS as an information utility, a heuristic policy for selecting actions is proposed. Via numerical and asymptotic optimality analysis, the performance of the proposed policy, hence the applicability of the EJS divergence in the context of the active hypothesis testing is investigated.

[1]  Michael Gastpar,et al.  Anthropic Correction of Information Estimates and Its Application to Neural Coding , 2010, IEEE Transactions on Information Theory.

[2]  Tara Javidi,et al.  Optimal reliability over a DMC with feedback via deterministic sequential coding , 2012, 2012 International Symposium on Information Theory and its Applications.

[3]  I. Grosse,et al.  Analysis of symbolic sequences using the Jensen-Shannon divergence. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Walter T. Federer,et al.  Sequential Design of Experiments , 1967 .

[5]  Dimitri P. Bertsekas,et al.  Universally Measurable Policies in Dynamic Programming , 1979, Math. Oper. Res..

[6]  Alpan Raval,et al.  Detection of genomic islands via segmental genome heterogeneity , 2009, Nucleic acids research.

[7]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[8]  Tara Javidi,et al.  Active Sequential Hypothesis Testing , 2012, ArXiv.

[9]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[10]  Tara Javidi,et al.  Performance bounds for active sequential hypothesis testing , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[11]  Rajesh Sundaresan,et al.  Active sequential hypothesis testing with application to a visual search problem , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[12]  Tara Javidi,et al.  Active hypothesis testing: Sequentiality and adaptivity gains , 2012, 2012 46th Annual Conference on Information Sciences and Systems (CISS).