The Relation Between Bayesian Fisher Information and Shannon Information for Detecting a Change in a Parameter

We derive a connection between the performance of statistical estimators and the performance of the ideal observer on related detection tasks. Specifically, we show how the task-specific Shannon information for the task of detecting a change in a parameter is related to the Fisher information and to the Bayesian Fisher information. We have previously shown that this Shannon information is related via an integral transform to the minimum probability of error on the same task. We then outline a circle of relations starting with this minimum probability of error and ensemble mean squared error for an estimator via the Ziv-Zakai inequality, then the ensemble mean squared error and the Bayesian Fisher information via the van Trees inequality, and finally the Bayesian Fisher information and the Shannon information for a detection task via the work presented here.

[1]  Jacob Ziv,et al.  Some lower bounds on signal parameter estimation , 1969, IEEE Trans. Inf. Theory.

[2]  H. Barrett,et al.  Objective assessment of image quality. III. ROC metrics, ideal observers, and likelihood-generating functions. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  Amit Ashok,et al.  Compressive imaging system design using task-specific information. , 2008, Applied optics.

[4]  Fangfang Shen,et al.  Using Fisher information to approximate ideal-observer performance on detection tasks for lumpy-background images. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Eric Clarkson,et al.  Fisher information and surrogate figures of merit for the task-based assessment of image quality. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  R. F.,et al.  Mathematical Statistics , 1944, Nature.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  R. Gill,et al.  Applications of the van Trees inequality : a Bayesian Cramr-Rao bound , 1995 .

[9]  H. V. Trees,et al.  Some Lower Bounds on Signal Parameter Estimation , 2007 .

[10]  Johnathan B. Cushing,et al.  Shannon information and ROC analysis in imaging. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[12]  Matthew A. Kupinski,et al.  Objective Assessment of Image Quality , 2005 .

[13]  Harrison H. Barrett,et al.  Foundations of Image Science , 2003, J. Electronic Imaging.

[14]  Eric Clarkson,et al.  Shannon information and receiver operating characteristic analysis for multiclass classification in imaging. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Amit Ashok,et al.  Task-specific information for imaging system analysis. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Yossef Steinberg,et al.  Extended Ziv-Zakai lower bound for vector parameter estimation , 1997, IEEE Trans. Inf. Theory.

[17]  Eric Clarkson,et al.  Asymptotic ideal observers and surrogate figures of merit for signal detection with list-mode data. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.