Bayesian Fisher Information and Detection of a Small Change in a Parameter

We have previously shown how the Bayesian Fisher Information (BFI) is related to the average of the Minimum Probability of Error (MPE) for the task of detecting a small change in a parameter. The prior probabilities for the two hypotheses corresponding to two nearby values of the parameter are derived from the prior distribution on the parameter, as they are for the Ziv-Zakai inequality. The average in this result and others to be discussed is performed over the parameter values using the prior. We extend this result to the case where a cost function is assigned to the detection task. In this case we determine the lowest order approximation of the average of the Bayesian Risk for the detection task. We have shown that there is a similar relation between the average Shannon Information (SI) for this detection task and the BFI, and that there is an integral relation between SI for any detection task and the MPE for that task. We will show the Bayesian perspective on this last result, and how these two results about SI are related.

[1]  H. V. Trees,et al.  Some Lower Bounds on Signal Parameter Estimation , 2007 .

[2]  Johnathan B. Cushing,et al.  Shannon information and ROC analysis in imaging. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  Eric Clarkson,et al.  Shannon information and receiver operating characteristic analysis for multiclass classification in imaging. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  E. Clarkson Probability of error for detecting a change in a parameter and Bayesian Fisher information. , 2020, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Eric Clarkson,et al.  Fisher information and surrogate figures of merit for the task-based assessment of image quality. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Amit Ashok,et al.  Task-specific information for imaging system analysis. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  Eric Clarkson,et al.  The Relation Between Bayesian Fisher Information and Shannon Information for Detecting a Change in a Parameter , 2019, Journal of the Optical Society of America. A, Optics, image science, and vision.