Efficient Computation of MSE Lower Bounds via Matching Pursuit

The classes of large-error bounds that are based on the covariance inequality, in both Bayesian and non-Bayesian approaches, are characterized as projection-based bounds. Tightening of bounds in these classes involves high computational complexity due to multidimensional optimization procedure. Consequently, projection-based large-error bounds have little popularity, while small-error bounds are frequently preferred, although they are not necessarily tight. In this letter, we first introduce a unified formulation for Bayesian and non-Bayesian projection-based lower bounds and set a general framework, which allows for their approximation via a greedy-based method. This framework is then used to propose the use of optimized orthogonal matching pursuit approach for computing projection-based large-error bounds. We analyze the complexity of the proposed algorithm and show that it is significantly lower than the complexity of the conventional approach. Finally, we apply the algorithm for the problem of multitone estimation and show that for fixed computational resources, the Weiss–Weinstein bound implemented with the proposed algorithm, provides a tighter bound compared to conventional approaches.

[1]  L. Rebollo-Neira,et al.  Optimized orthogonal matching pursuit approach , 2002, IEEE Signal Processing Letters.

[2]  Mike E. Davies,et al.  Gradient Pursuits , 2008, IEEE Transactions on Signal Processing.

[3]  A. Weiss,et al.  Fundamental limitations in passive time delay estimation--Part I: Narrow-band systems , 1983 .

[4]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[5]  Hagit Messer,et al.  A Barankin-type lower bound on the estimation error of a hybrid parameter vector , 1997, IEEE Trans. Inf. Theory.

[6]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[7]  Joseph Tabrikian,et al.  General Classes of Performance Lower Bounds for Parameter Estimation—Part II: Bayesian Bounds , 2010, IEEE Transactions on Information Theory.

[8]  Kristine L. Bell,et al.  Bayesian Bounds for Parameter Estimation and Nonlinear Filtering/Tracking , 2007 .

[9]  Philippe Forster,et al.  A Useful Form of the Abel Bound and Its Application to Estimator Threshold Prediction , 2007, IEEE Transactions on Signal Processing.

[10]  H. Cramér.  A contribution to the theory of statistical estimation , 1946 .

[11]  Carlos H. Muravchik,et al.  Posterior Cramer-Rao bounds for discrete-time nonlinear filtering , 1998, IEEE Trans. Signal Process..

[12]  Kristine L. Bell,et al.  The Bayesian Abel Bound on the Mean Square Error , 2007 .

[13]  P. Spreij.  Probability and Measure , 1996 .

[14]  Lawrence P. Seidman,et al.  A useful form of the Barankin lower bound and its application to PPM threshold analysis , 1969, IEEE Trans. Inf. Theory.

[15]  Joseph Tabrikian,et al.  General Classes of Performance Lower Bounds for Parameter Estimation—Part I: Non-Bayesian Bounds for Unbiased Estimators , 2010, IEEE Transactions on Information Theory.

[16]  D. Robinson,et al.  Fundamental performance limits in image registration , 2004, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[17]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[18]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[19]  Christ D. Richmond,et al.  Mean-squared error and threshold SNR prediction of maximum-likelihood signal parameter estimation with estimated colored noise covariances , 2006, IEEE Transactions on Information Theory.

[20]  Petre Stoica,et al.  Performance study of conditional and unconditional direction-of-arrival estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[21]  Edward M. Hofstetter,et al.  Barankin Bounds on Parameter Estimation , 1971, IEEE Trans. Inf. Theory.

[22]  Philippe Forster,et al.  On lower bounds for deterministic parameter estimation , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  Ehud Weinstein,et al.  A lower bound on the mean-square error in random parameter estimation , 1985, IEEE Trans. Inf. Theory.

[24]  Bob L. Sturm,et al.  Comparison of orthogonal matching pursuit implementations , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[25]  Li Bo,et al.  Fast OOMP algorithm and its application in compressed sensing , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[26]  J. S. Abel.  A bound on mean square estimate error , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[27]  D. G. Chapman,et al.  Minimum Variance Estimation Without Regularity Assumptions , 1951 .

[28]  E. Barankin.  Locally Best Unbiased Estimates , 1949 .

[29]  Eric Chaumette,et al.  A New Barankin Bound Approximation for the Prediction of the Threshold Region Performance of Maximum Likelihood Estimators , 2008, IEEE Transactions on Signal Processing.

[30]  Umberto Mengali,et al.  The modified Cramer-Rao bound and its application to synchronization problems , 1994, IEEE Trans. Commun..

[31]  Alexandre Renaux.  Weiss–Weinstein Bound for Data-Aided Carrier Estimation , 2007, IEEE Signal Processing Letters.

[32]  Sacha Krstulovic,et al.  Mptk: Matching Pursuit Made Tractable , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[33]  Kristine L. Bell,et al.  A General Class of Lower Bounds in Parameter Estimation , 2007 .

[34]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.