On Constraints in Parameter Estimation and Model Misspecification

Under perfect model specification several deterministic (non-Bayesian) parameter bounds have been established, including the Cramer-Rae, Bhattacharyya, and the Barankin bound; where each is known to apply only to estimators sharing the same mean as a function of the true parameter. This requirement of common mean represents a constraint on the class of estimators. While consideration of model misspecification is an additional complexity, the need for constraints remains a necessary consequence of applying the covariance inequality. These inherent constraints will be examined more closely under misspecification and discussed in detail along with a review of Vuong's original contribution of the misspecified Cramer-Rao bound (MCRB). Recent work derives the same MCRB as Vuong via a different approach, but applicable only to a class of estimators that is more restrictive. An argument is presented herein, however, that broadens this class to include all unbiased estimators of the pseudo-true parameters and strengthens the tie to Vuong's work. Interestingly, an inherent constraint of the covariance inequality, when satisfied by the choice in score function, yields a generalization of the necessary conditions identified by Blyth and Roberts to obtain an inequality of the Cramer-Rae type.

[1]  Christ D. Richmond,et al.  Parameter Bounds on Estimation Accuracy Under Model Misspecification , 2015, IEEE Transactions on Signal Processing.

[2]  L. Scharf,et al.  Statistical Signal Processing: Detection, Estimation, and Time Series Analysis , 1991 .

[3]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[4]  C. Blyth,et al.  Necessary and Sufficient Conditions for Inequalities of Cramer-Rao Type , 1974 .

[5]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[6]  P. J. Huber The behavior of maximum likelihood estimates under nonstandard conditions , 1967 .

[7]  Philippe Forster,et al.  A Fresh Look at the Bayesian Bounds of the Weiss-Weinstein Family , 2008, IEEE Transactions on Signal Processing.

[8]  Fulvio Gini,et al.  Performance Bounds for Parameter Estimation under Misspecified Models: Fundamental Findings and Applications , 2017, IEEE Signal Processing Magazine.

[9]  Fulvio Gini,et al.  The Misspecified Cramer-Rao Bound and Its Application to Scatter Matrix Estimation in Complex Elliptically Symmetric Distributions , 2016, IEEE Transactions on Signal Processing.

[10]  Donald M. Roberts,et al.  On inequalitites of Cramér-Rao type and admissibility proofs , 1972 .

[11]  Jonathan S. Abel,et al.  A bound on mean-square-estimate error , 1993, IEEE Trans. Inf. Theory.

[12]  Philippe Forster,et al.  On lower bounds for deterministic parameter estimation , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  James W. Daniel,et al.  Applied linear algebra (3rd edition) , by Ben Noble and James W. Daniel. Pp 521. £16·95. 1988. ISBN 0-13-040957-X (Prentice-Hall) , 1988, Mathematical Gazette.

[14]  Quang Vuong,et al.  Cramer-Rao Bounds for Misspecified Models , 1986 .

[15]  Joseph P. Romano,et al.  Testing Statistical Hypotheses, Third Edition , 2008, Springer texts in statistics.

[16]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[17]  Louis L. Scharf,et al.  Properties of quadratic covariance bounds , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.