Lower bounds for parametric estimation with constraints

A Chapman-Robbins form of the Barankin bound is used to derive a multiparameter Cramer-Rao (CR) type lower bound on estimator error covariance when the parameter theta in R/sup n/ is constrained to lie in a subset of the parameter space. A simple form for the constrained CR bound is obtained when the constraint set Theta /sub C/, can be expressed as a smooth functional inequality constraint. It is shown that the constrained CR bound is identical to the unconstrained CR bound at the regular points of Theta /sub C/, i.e. where no equality constraints are active. On the other hand, at those points theta in Theta /sub C/ where pure equality constraints are active the full-rank Fisher information matrix in the unconstrained CR bound must be replaced by a rank-reduced Fisher information matrix obtained as a projection of the full-rank Fisher matrix onto the tangent hyperplane of the full-rank Fisher matrix onto the tangent hyperplane of the constraint set at theta . A necessary and sufficient condition involving the forms of the constraint and the likelihood function is given for the bound to be achievable, and examples for which the bound is achieved are presented. In addition to providing a useful generalization of the CR bound, the results permit analysis of the gain in achievable MSE performance due to the imposition of particular constraints on the parameter space without the need for a global reparameterization. >

[1]  K. Deimling.  Nonlinear functional analysis , 1985 .

[2]  Salim E. Roucos,et al.  A two-dimensional maximum entropy spectral estimator , 1980, IEEE Trans. Inf. Theory.

[3]  F. Graybill,et al.  Matrices with Applications in Statistics. , 1984 .

[4]  K. Vastola,et al.  Robust Wiener-Kolmogorov theory , 1984, IEEE Trans. Inf. Theory.

[5]  J. Aitchison,et al.  Maximum-Likelihood Estimation of Parameters Subject to Restraints , 1958 .

[6]  C. C. Wackerman,et al.  Phase-retrieval error: a lower bound , 1987 .

[7]  Alfred O. Hero,et al.  Lower bounds on parametric estimators with constraints , 1988, Fourth Annual ASSP Workshop on Spectrum Estimation and Modeling.

[8]  W. J. Hall,et al.  Information and Asymptotic Efficiency in Parametric-Nonparametric Models , 1983 .

[9]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[10]  G. Stewart.  On the Continuity of the Generalized Inverse , 1969 .

[11]  D. G. Chapman,et al.  Minimum Variance Estimation Without Regularity Assumptions , 1951 .

[12]  James R. Fienup,et al.  Reconstruction And Synthesis Applications Of An Iterative Algorithm , 1984, Other Conferences.

[13]  R. Inkol,et al.  The use of linear constraints to reduce the variance of time of arrival difference estimates for sou , 1983 .

[14]  D. Luenberger.  Optimization by Vector Space Methods , 1968 .

[15]  H. Chernoff.  On the Distribution of the Likelihood Ratio , 1954 .

[16]  L. L. Cam,et al.  Asymptotic Methods In Statistical Decision Theory , 1986 .

[17]  Edward M. Hofstetter,et al.  Barankin Bounds on Parameter Estimation , 1971, IEEE Trans. Inf. Theory.

[18]  R. Kumaresan,et al.  Estimating the Angles of Arrival of Multiple Plane Waves , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[19]  P. A. P. Moran,et al.  Maximum-likelihood estimation in non-standard conditions , 1971, Mathematical Proceedings of the Cambridge Philosophical Society.

[20]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .