Classes of lower bounds on outage error probability and MSE in Bayesian parameter estimation

In this paper, new classes of lower bounds on the outage error probability and on the mean-square-error (MSE) in Bayesian parameter estimation are proposed. The minima of the h-outage error probability and the MSE are obtained by the generalized maximum a-posteriori probability and the minimum MSE (MMSE) estimators, respectively. However, computation of these estimators and their corresponding performance is usually not tractable and thus, lower bounds on these terms can be very useful for performance analysis. The proposed class of lower bounds on the outage error probability is derived using Holder's inequality. This class is utilized to derive a new class of Bayesian MSE bounds. It is shown that for unimodal symmetric conditional probability density functions (pdf) the tightest probability of outage error lower bound in the proposed class attains the minimum probability of outage error and the tightest MSE bound coincides with the MMSE performance. In addition, it is shown that the proposed MSE bounds are always tighter than the Ziv-Zakai lower bound (ZZLB). The proposed bounds are compared with other existing performance lower bounds via some examples.

[1]  L. Breuer Introduction to Stochastic Processes , 2022, Statistical Methods for Climate Scientists.

[2]  Joseph Tabrikian,et al.  A general class of lower bounds on the probability of error in multiple hypothesis testing , 2008, 2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel.

[3]  Joseph Tabrikian,et al.  General Classes of Performance Lower Bounds for Parameter Estimation—Part II: Bayesian Bounds , 2010, IEEE Transactions on Information Theory.

[4]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[5]  Albert A. Mullin,et al.  Extraction of signals from noise , 1970 .

[6]  Jacob Ziv,et al.  Some lower bounds on signal parameter estimation , 1969, IEEE Trans. Inf. Theory.

[7]  H. V. Trees,et al.  Bayesian Bounds for Parameter Estimation and Nonlinear Filtering/Tracking , 2007 .

[8]  Jacob Ziv,et al.  Improved Lower Bounds on Signal Parameter Estimation , 1975, IEEE Trans. Inf. Theory.

[9]  Ehud Weinstein,et al.  A lower bound on the mean-square error in random parameter estimation , 1985, IEEE Trans. Inf. Theory.

[10]  Hagit Messer,et al.  A Barankin-type lower bound on the estimation error of a hybrid parameter vector , 1997, IEEE Trans. Inf. Theory.

[11]  P. Heywood Trigonometric Series , 1968, Nature.

[12]  Neri Merhav,et al.  Relations between entropy and error probability , 1994, IEEE Trans. Inf. Theory.

[13]  Fredrik Athley,et al.  Performance analysis of DOA estimation in the threshold region , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Sandro Bellini,et al.  Bounds on Error in Signal Parameter Estimation , 1974, IEEE Trans. Commun..

[15]  Yossef Steinberg,et al.  Extended Ziv-Zakai lower bound for vector parameter estimation , 1997, IEEE Trans. Inf. Theory.

[16]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[17]  John P. Ianniello,et al.  Lower bounds on worst case probability of large error for two channel time delay estimation , 1985, IEEE Trans. Acoust. Speech Signal Process..

[18]  George L. Turin,et al.  The theory of optimum noise immunity , 1959 .