New observations on efficiency of variance estimation of white Gaussian signal with unknown mean

The uniformly minimum variance unbiased estimator (UMVUE) for mean and variance of white Gaussian noise is known to be not efficient. This is due to the fact that according to the Cramér-Rao bound (CRB), no coupling exists between mean and variance of Gaussian observations, while it is clear that knowledge or lack of knowledge of the mean has impact on estimation of the variance. In this work, we consider the problem of variance estimation in the presence of unknown mean of white Gaussian signals, where the unknown mean is considered to be a nuisance parameter. For this purpose, a Cramér-Rao-type bound on the mean-squared-error (MSE) of non-Bayesian estimators, which has been recently introduced, is analyzed. This bound considers no unbiasedness condition on the nuisance parameters. Alternatively, Lehmann's concept of unbiasedness is imposed for a risk that measures the distance between the estimator and the locally best unbiased estimator, which assumes perfect knowledge of the model parameters. It is analytically shown that the MSE of the well-known UMVUE coincides with the proposed risk-unbiased CRB, and therefore it is called risk-efficient estimator.

[1]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[2]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[3]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[4]  Joseph Tabrikian,et al.  Performance bounds for constrained parameter estimation , 2012, 2012 IEEE 7th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[5]  Don H. Johnson,et al.  Statistical Signal Processing , 2009, Encyclopedia of Biometrics.

[6]  Arthur Albert,et al.  Regression and the Moore-Penrose Pseudoinverse , 2012 .

[7]  N. L. Johnson,et al.  Linear Statistical Inference and Its Applications , 1966 .

[8]  Yonina C. Eldar,et al.  Rethinking biased estimation [Lecture Notes] , 2008, IEEE Signal Processing Magazine.

[9]  Joseph Tabrikian,et al.  Periodic CRB for non-Bayesian parameter estimation , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Joseph Tabrikian,et al.  Bayesian Estimation in the Presence of Deterministic Nuisance Parameters—Part I: Performance Bounds , 2015, IEEE Transactions on Signal Processing.

[11]  Eric Chaumette,et al.  On the influence of detection tests on deterministic parameters estimation , 2006, 2006 14th European Signal Processing Conference.

[12]  Fulvio Gini Estimation strategies in the presence of nuisance parameters , 1996, Signal Process..

[13]  Eric Chaumette,et al.  New Results on Deterministic Cramér–Rao Bounds for Real and Complex Parameters , 2012, IEEE Transactions on Signal Processing.

[14]  Claudia Biermann,et al.  Mathematical Methods Of Statistics , 2016 .

[15]  Jürgen Beyerer Is it useful to know a nuisance parameter? , 1998, Signal Process..

[16]  Joseph Tabrikian,et al.  Non-Bayesian Periodic Cramér-Rao Bound , 2013, IEEE Transactions on Signal Processing.

[17]  Joseph Tabrikian,et al.  Cyclic Barankin-Type Bounds for Non-Bayesian Periodic Parameter Estimation , 2014, IEEE Transactions on Signal Processing.

[18]  Joseph Tabrikian,et al.  Bayesian Estimation in the Presence of Deterministic Nuisance Parameters—Part II: Estimation Methods , 2015, IEEE Transactions on Signal Processing.

[19]  E. Lehmann A General Concept of Unbiasedness , 1951 .

[20]  Alfred O. Hero,et al.  Lower bounds for parametric estimation with constraints , 1990, IEEE Trans. Inf. Theory.

[21]  Yushan Xiao,et al.  Linex Unbiasedness in a Prediction Problem , 2000 .

[22]  T. Nayak,et al.  The concept of risk unbiasedness in statistical prediction , 2010 .

[23]  Joseph Tabrikian,et al.  Bayesian cramér-rao type bound for risk-unbiased estimation with deterministic nuisance parameters , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).